Evaluating Scoring Procedures for Context-Dependent Item Sets1.

Saved in:
Bibliographic Details
Title: Evaluating Scoring Procedures for Context-Dependent Item Sets1.
Authors: Keller, Lisa A., Swaminathan, Hariharan, Sireci, Stephen G.
Source: Applied Measurement in Education. 2003, Vol. 16 Issue 3, p207-222. 16p.
Subjects: Test scoring, Educational tests & measurements, Simulation methods & models, Pass-fail grading system, Ability testing, Achievement tests
Abstract: Context-dependent item sets are common on many educational tests. However, they invariably introduce local item dependence, which can lead to improper estimates of examinee scores and test and item statistics. In this article, we evaluate 2 strategies for scoring context-dependent items: ignoring the dependence and scoring dichotomously, or modeling the dependence through polytomous scoring. The results suggest that although dichotomous scoring may overestimate test information, polytomous scoring may underestimate test information and lead to improper examinee classifications when pass/fail decisions are made. The implications of these findings for future research in this area are discussed. [ABSTRACT FROM AUTHOR]
Copyright of Applied Measurement in Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Description
Abstract:Context-dependent item sets are common on many educational tests. However, they invariably introduce local item dependence, which can lead to improper estimates of examinee scores and test and item statistics. In this article, we evaluate 2 strategies for scoring context-dependent items: ignoring the dependence and scoring dichotomously, or modeling the dependence through polytomous scoring. The results suggest that although dichotomous scoring may overestimate test information, polytomous scoring may underestimate test information and lead to improper examinee classifications when pass/fail decisions are made. The implications of these findings for future research in this area are discussed. [ABSTRACT FROM AUTHOR]
ISSN:08957347
DOI:10.1207/S15324818AME1603_3