Comparison of Two Exam Evaluation Methods for Objectivity
Saved in:
| Title: | Comparison of Two Exam Evaluation Methods for Objectivity |
|---|---|
| Language: | English |
| Authors: | Kolarec, Biserka (ORCID |
| Source: | International Society for Technology, Education, and Science. 2022. |
| Availability: | International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org |
| Peer Reviewed: | Y |
| Page Count: | 11 |
| Publication Date: | 2022 |
| Document Type: | Speeches/Meeting Papers Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Statistics Education, Mathematics Tests, Evaluation Methods, Test Construction, Task Analysis, Item Analysis, Comparative Analysis, Probability, College Students, Serial Ordering |
| Abstract: | The object of research is a statistics exam that contains problem tasks. One examiner performed two exam evaluation methods to repeatedly evaluate the exam. The goal was to compare the methods for objectivity. One of the two exam evaluation methods we call a serial evaluation method. The serial evaluation method assumes evaluation of all exam tasks of an individual student in sequential order, so evaluation "student by student". Unlike that, a parallel evaluation method assumes the "task by task" evaluation of exams for the whole group of students. A paired samples analysis of exam results indicates a statistically significant difference between methods. Further analysis showed a statistically significant difference in results obtained by the serial evaluation and the repeated serial evaluation, while the difference in results obtained by the parallel evaluation and the repeated parallel evaluation turned out not to be statistically significant. Furthermore, our research gave evidence that the repeated parallel evaluation changes result significantly less than the repeated serial evaluation. Consequently, we consider the parallel evaluation a more objective tool in exam evaluation than the serial evaluation. [For the complete proceedings, see ED631021.] |
| Abstractor: | As Provided |
| Entry Date: | 2023 |
| Accession Number: | ED631095 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED631095 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED631095 AccessLevel: 3 PubType: Conference PubTypeId: conference PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Comparison of Two Exam Evaluation Methods for Objectivity – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Kolarec%2C+Biserka%22">Kolarec, Biserka</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1434-3533">0000-0003-1434-3533</externalLink>)<br /><searchLink fieldCode="AR" term="%22Nincevic%2C+Marina%22">Nincevic, Marina</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2316-2072">0000-0003-2316-2072</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22International+Society+for+Technology%2C+Education%2C+and+Science%22"><i>International Society for Technology, Education, and Science</i></searchLink>. 2022. – Name: Avail Label: Availability Group: Avail Data: International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 11 – Name: DatePubCY Label: Publication Date Group: Date Data: 2022 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Speeches/Meeting Papers<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Statistics+Education%22">Statistics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Tests%22">Mathematics Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Probability%22">Probability</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Serial+Ordering%22">Serial Ordering</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The object of research is a statistics exam that contains problem tasks. One examiner performed two exam evaluation methods to repeatedly evaluate the exam. The goal was to compare the methods for objectivity. One of the two exam evaluation methods we call a serial evaluation method. The serial evaluation method assumes evaluation of all exam tasks of an individual student in sequential order, so evaluation "student by student". Unlike that, a parallel evaluation method assumes the "task by task" evaluation of exams for the whole group of students. A paired samples analysis of exam results indicates a statistically significant difference between methods. Further analysis showed a statistically significant difference in results obtained by the serial evaluation and the repeated serial evaluation, while the difference in results obtained by the parallel evaluation and the repeated parallel evaluation turned out not to be statistically significant. Furthermore, our research gave evidence that the repeated parallel evaluation changes result significantly less than the repeated serial evaluation. Consequently, we consider the parallel evaluation a more objective tool in exam evaluation than the serial evaluation. [For the complete proceedings, see ED631021.] – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2023 – Name: AN Label: Accession Number Group: ID Data: ED631095 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED631095 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 11 Subjects: – SubjectFull: Statistics Education Type: general – SubjectFull: Mathematics Tests Type: general – SubjectFull: Evaluation Methods Type: general – SubjectFull: Test Construction Type: general – SubjectFull: Task Analysis Type: general – SubjectFull: Item Analysis Type: general – SubjectFull: Comparative Analysis Type: general – SubjectFull: Probability Type: general – SubjectFull: College Students Type: general – SubjectFull: Serial Ordering Type: general Titles: – TitleFull: Comparison of Two Exam Evaluation Methods for Objectivity Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Kolarec, Biserka – PersonEntity: Name: NameFull: Nincevic, Marina IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2022 Titles: – TitleFull: International Society for Technology, Education, and Science Type: main |
| ResultId | 1 |