Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests.

Saved in:
Bibliographic Details
Title: Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests.
Authors: Kim, Sooyeon (AUTHOR), Moses, Tim (AUTHOR)
Source: International Journal of Testing. Oct-Dec2013, Vol. 13 Issue 4, p314-328. 15p. 5 Charts, 2 Graphs.
Subjects: Reaction time, Time factors (Learning), Professional licensure examinations, Examinations, Job qualifications
Abstract: The major purpose of this study is to assess the conditions under which single scoring for constructed-response (CR) items is as effective as double scoring in the licensure testing context. We used both empirical datasets of five mixed-format licensure tests collected in actual operational settings and simulated datasets that allowed for the manipulation of two psychometric conditions, namely the proportion of CR components in a test and the magnitudes of correlations between two raters. In general, examinees were classified into the same Pass/Fail category when the contribution of the CR component was low and the interrater correlation was substantial. Under these conditions, the use of single scoring would reduce scoring time and cost without increasing classification inconsistency. [ABSTRACT FROM PUBLISHER]
Copyright of International Journal of Testing is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 90137501
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kim%2C+Sooyeon%22">Kim, Sooyeon</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Moses%2C+Tim%22">Moses, Tim</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Testing%22">International Journal of Testing</searchLink>. Oct-Dec2013, Vol. 13 Issue 4, p314-328. 15p. 5 Charts, 2 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Reaction+time%22">Reaction time</searchLink><br /><searchLink fieldCode="DE" term="%22Time+factors+%28Learning%29%22">Time factors (Learning)</searchLink><br /><searchLink fieldCode="DE" term="%22Professional+licensure+examinations%22">Professional licensure examinations</searchLink><br /><searchLink fieldCode="DE" term="%22Examinations%22">Examinations</searchLink><br /><searchLink fieldCode="DE" term="%22Job+qualifications%22">Job qualifications</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The major purpose of this study is to assess the conditions under which single scoring for constructed-response (CR) items is as effective as double scoring in the licensure testing context. We used both empirical datasets of five mixed-format licensure tests collected in actual operational settings and simulated datasets that allowed for the manipulation of two psychometric conditions, namely the proportion of CR components in a test and the magnitudes of correlations between two raters. In general, examinees were classified into the same Pass/Fail category when the contribution of the CR component was low and the interrater correlation was substantial. Under these conditions, the use of single scoring would reduce scoring time and cost without increasing classification inconsistency. [ABSTRACT FROM PUBLISHER]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of International Journal of Testing is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=90137501
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/15305058.2013.776050
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 15
        StartPage: 314
    Subjects:
      – SubjectFull: Reaction time
        Type: general
      – SubjectFull: Time factors (Learning)
        Type: general
      – SubjectFull: Professional licensure examinations
        Type: general
      – SubjectFull: Examinations
        Type: general
      – SubjectFull: Job qualifications
        Type: general
    Titles:
      – TitleFull: Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kim, Sooyeon
      – PersonEntity:
          Name:
            NameFull: Moses, Tim
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 10
              Text: Oct-Dec2013
              Type: published
              Y: 2013
          Identifiers:
            – Type: issn-print
              Value: 15305058
          Numbering:
            – Type: volume
              Value: 13
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: International Journal of Testing
              Type: main
ResultId 1