A Comparison of IRT Proficiency Estimation Methods Under Adaptive Multistage Testing.
Saved in:
| Title: | A Comparison of IRT Proficiency Estimation Methods Under Adaptive Multistage Testing. |
|---|---|
| Authors: | Kim, Sooyeon1 skim@ets.org, Moses, Tim2 tmoses@collegeboard.org, Yoo, Hanwook (Henry)1 hyoo@ets.org |
| Source: | Journal of Educational Measurement. Mar2015, Vol. 52 Issue 1, p70-79. 10p. |
| Subject Terms: | *Item response theory, *Educational tests & measurements, *Bayesian analysis, *Educational quality, *Examination item response theory (Education) |
| Abstract: | This inquiry is an investigation of item response theory (IRT) proficiency estimators' accuracy under multistage testing (MST). We chose a two-stage MST design that includes four modules (one at Stage 1, three at Stage 2) and three difficulty paths (low, middle, high). We assembled various two-stage MST panels (i.e., forms) by manipulating two assembly conditions in each module, such as difficulty level and module length. For each panel, we investigated the accuracy of examinees' proficiency levels derived from seven IRT proficiency estimators. The choice of Bayesian (prior) versus non-Bayesian (no prior) estimators was of more practical significance than the choice of number-correct versus item-pattern scoring estimators. The Bayesian estimators were slightly more efficient than the non-Bayesian estimators, resulting in smaller overall error. Possible score changes caused by the use of different proficiency estimators would be nonnegligible, particularly for low- and high-performing examinees. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 101385373 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: A Comparison of IRT Proficiency Estimation Methods Under Adaptive Multistage Testing. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Kim%2C+Sooyeon%22">Kim, Sooyeon</searchLink><relatesTo>1</relatesTo><i> skim@ets.org</i><br /><searchLink fieldCode="AR" term="%22Moses%2C+Tim%22">Moses, Tim</searchLink><relatesTo>2</relatesTo><i> tmoses@collegeboard.org</i><br /><searchLink fieldCode="AR" term="%22Yoo%2C+Hanwook+%28Henry%29%22">Yoo, Hanwook (Henry)</searchLink><relatesTo>1</relatesTo><i> hyoo@ets.org</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Educational+Measurement%22">Journal of Educational Measurement</searchLink>. Mar2015, Vol. 52 Issue 1, p70-79. 10p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Item+response+theory%22">Item response theory</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+tests+%26+measurements%22">Educational tests & measurements</searchLink><br />*<searchLink fieldCode="DE" term="%22Bayesian+analysis%22">Bayesian analysis</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+quality%22">Educational quality</searchLink><br />*<searchLink fieldCode="DE" term="%22Examination+item+response+theory+%28Education%29%22">Examination item response theory (Education)</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This inquiry is an investigation of item response theory (IRT) proficiency estimators' accuracy under multistage testing (MST). We chose a two-stage MST design that includes four modules (one at Stage 1, three at Stage 2) and three difficulty paths (low, middle, high). We assembled various two-stage MST panels (i.e., forms) by manipulating two assembly conditions in each module, such as difficulty level and module length. For each panel, we investigated the accuracy of examinees' proficiency levels derived from seven IRT proficiency estimators. The choice of Bayesian (prior) versus non-Bayesian (no prior) estimators was of more practical significance than the choice of number-correct versus item-pattern scoring estimators. The Bayesian estimators were slightly more efficient than the non-Bayesian estimators, resulting in smaller overall error. Possible score changes caused by the use of different proficiency estimators would be nonnegligible, particularly for low- and high-performing examinees. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=101385373 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/jedm.12063 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 10 StartPage: 70 Subjects: – SubjectFull: Item response theory Type: general – SubjectFull: Educational tests & measurements Type: general – SubjectFull: Bayesian analysis Type: general – SubjectFull: Educational quality Type: general – SubjectFull: Examination item response theory (Education) Type: general Titles: – TitleFull: A Comparison of IRT Proficiency Estimation Methods Under Adaptive Multistage Testing. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Kim, Sooyeon – PersonEntity: Name: NameFull: Moses, Tim – PersonEntity: Name: NameFull: Yoo, Hanwook (Henry) IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 03 Text: Mar2015 Type: published Y: 2015 Identifiers: – Type: issn-print Value: 00220655 Numbering: – Type: volume Value: 52 – Type: issue Value: 1 Titles: – TitleFull: Journal of Educational Measurement Type: main |
| ResultId | 1 |
