Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests.
Saved in:
| Title: | Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests. |
|---|---|
| Authors: | Kim, Sooyeon (AUTHOR), Moses, Tim (AUTHOR) |
| Source: | International Journal of Testing. Oct-Dec2013, Vol. 13 Issue 4, p314-328. 15p. 5 Charts, 2 Graphs. |
| Subjects: | Reaction time, Time factors (Learning), Professional licensure examinations, Examinations, Job qualifications |
| Abstract: | The major purpose of this study is to assess the conditions under which single scoring for constructed-response (CR) items is as effective as double scoring in the licensure testing context. We used both empirical datasets of five mixed-format licensure tests collected in actual operational settings and simulated datasets that allowed for the manipulation of two psychometric conditions, namely the proportion of CR components in a test and the magnitudes of correlations between two raters. In general, examinees were classified into the same Pass/Fail category when the contribution of the CR component was low and the interrater correlation was substantial. Under these conditions, the use of single scoring would reduce scoring time and cost without increasing classification inconsistency. [ABSTRACT FROM PUBLISHER] |
| Copyright of International Journal of Testing is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | The major purpose of this study is to assess the conditions under which single scoring for constructed-response (CR) items is as effective as double scoring in the licensure testing context. We used both empirical datasets of five mixed-format licensure tests collected in actual operational settings and simulated datasets that allowed for the manipulation of two psychometric conditions, namely the proportion of CR components in a test and the magnitudes of correlations between two raters. In general, examinees were classified into the same Pass/Fail category when the contribution of the CR component was low and the interrater correlation was substantial. Under these conditions, the use of single scoring would reduce scoring time and cost without increasing classification inconsistency. [ABSTRACT FROM PUBLISHER] |
|---|---|
| ISSN: | 15305058 |
| DOI: | 10.1080/15305058.2013.776050 |
