Comparison of Two Exam Evaluation Methods for Objectivity

Saved in:
Bibliographic Details
Title: Comparison of Two Exam Evaluation Methods for Objectivity
Language: English
Authors: Kolarec, Biserka (ORCID 0000-0003-1434-3533), Nincevic, Marina (ORCID 0000-0003-2316-2072)
Source: International Society for Technology, Education, and Science. 2022.
Availability: International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org
Peer Reviewed: Y
Page Count: 11
Publication Date: 2022
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Statistics Education, Mathematics Tests, Evaluation Methods, Test Construction, Task Analysis, Item Analysis, Comparative Analysis, Probability, College Students, Serial Ordering
Abstract: The object of research is a statistics exam that contains problem tasks. One examiner performed two exam evaluation methods to repeatedly evaluate the exam. The goal was to compare the methods for objectivity. One of the two exam evaluation methods we call a serial evaluation method. The serial evaluation method assumes evaluation of all exam tasks of an individual student in sequential order, so evaluation "student by student". Unlike that, a parallel evaluation method assumes the "task by task" evaluation of exams for the whole group of students. A paired samples analysis of exam results indicates a statistically significant difference between methods. Further analysis showed a statistically significant difference in results obtained by the serial evaluation and the repeated serial evaluation, while the difference in results obtained by the parallel evaluation and the repeated parallel evaluation turned out not to be statistically significant. Furthermore, our research gave evidence that the repeated parallel evaluation changes result significantly less than the repeated serial evaluation. Consequently, we consider the parallel evaluation a more objective tool in exam evaluation than the serial evaluation. [For the complete proceedings, see ED631021.]
Abstractor: As Provided
Entry Date: 2023
Accession Number: ED631095
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED631095
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED631095
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Comparison of Two Exam Evaluation Methods for Objectivity
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kolarec%2C+Biserka%22">Kolarec, Biserka</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1434-3533">0000-0003-1434-3533</externalLink>)<br /><searchLink fieldCode="AR" term="%22Nincevic%2C+Marina%22">Nincevic, Marina</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2316-2072">0000-0003-2316-2072</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Society+for+Technology%2C+Education%2C+and+Science%22"><i>International Society for Technology, Education, and Science</i></searchLink>. 2022.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 11
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Statistics+Education%22">Statistics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Tests%22">Mathematics Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Probability%22">Probability</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Serial+Ordering%22">Serial Ordering</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The object of research is a statistics exam that contains problem tasks. One examiner performed two exam evaluation methods to repeatedly evaluate the exam. The goal was to compare the methods for objectivity. One of the two exam evaluation methods we call a serial evaluation method. The serial evaluation method assumes evaluation of all exam tasks of an individual student in sequential order, so evaluation "student by student". Unlike that, a parallel evaluation method assumes the "task by task" evaluation of exams for the whole group of students. A paired samples analysis of exam results indicates a statistically significant difference between methods. Further analysis showed a statistically significant difference in results obtained by the serial evaluation and the repeated serial evaluation, while the difference in results obtained by the parallel evaluation and the repeated parallel evaluation turned out not to be statistically significant. Furthermore, our research gave evidence that the repeated parallel evaluation changes result significantly less than the repeated serial evaluation. Consequently, we consider the parallel evaluation a more objective tool in exam evaluation than the serial evaluation. [For the complete proceedings, see ED631021.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED631095
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED631095
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
    Subjects:
      – SubjectFull: Statistics Education
        Type: general
      – SubjectFull: Mathematics Tests
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Task Analysis
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Probability
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Serial Ordering
        Type: general
    Titles:
      – TitleFull: Comparison of Two Exam Evaluation Methods for Objectivity
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kolarec, Biserka
      – PersonEntity:
          Name:
            NameFull: Nincevic, Marina
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Titles:
            – TitleFull: International Society for Technology, Education, and Science
              Type: main
ResultId 1