Identifying differential item functioning in multi-stage computer adaptive testing.
Saved in:
| Title: | Identifying differential item functioning in multi-stage computer adaptive testing. |
|---|---|
| Authors: | Gierl, Mark J.1 mark.gierl@ualberta.ca, Lai, Hollis1, Li, Johnson1 |
| Source: | Educational Research & Evaluation. Apr2013, Vol. 19 Issue 2/3, p188-203. 16p. |
| Subject Terms: | *Adaptive testing, *Competency tests (Education), *Sequential approach (Teaching method), *Response styles (Examinations), *Adapted examinations, Statistical sampling |
| Abstract: | The purpose of this study is to evaluate the performance of CATSIB (Computer Adaptive Testing-Simultaneous Item Bias Test) for detecting differential item functioning (DIF) when items in the matching and studied subtest are administered adaptively in the context of a realistic multi-stage adaptive test (MST). MST was simulated using a 4-item module in a 7-panel administration. Three independent variables, expected to affect DIF detection rates, were manipulated: item difficulty, sample size, and balanced/unbalanced design. CATSIB met the acceptable criteria, meaning that the Type I error and power rates met 5% and 80%, respectively, for the large reference/moderate focal sample and the large reference/large focal sample conditions. These results indicate that CATSIB can be used to consistently and accurately detect DIF on an MST, but only with moderate to large samples. [ABSTRACT FROM AUTHOR] |
| Copyright of Educational Research & Evaluation is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 86179089 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Identifying differential item functioning in multi-stage computer adaptive testing. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Gierl%2C+Mark+J%2E%22">Gierl, Mark J.</searchLink><relatesTo>1</relatesTo><i> mark.gierl@ualberta.ca</i><br /><searchLink fieldCode="AR" term="%22Lai%2C+Hollis%22">Lai, Hollis</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Li%2C+Johnson%22">Li, Johnson</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Educational+Research+%26+Evaluation%22">Educational Research & Evaluation</searchLink>. Apr2013, Vol. 19 Issue 2/3, p188-203. 16p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Adaptive+testing%22">Adaptive testing</searchLink><br />*<searchLink fieldCode="DE" term="%22Competency+tests+%28Education%29%22">Competency tests (Education)</searchLink><br />*<searchLink fieldCode="DE" term="%22Sequential+approach+%28Teaching+method%29%22">Sequential approach (Teaching method)</searchLink><br />*<searchLink fieldCode="DE" term="%22Response+styles+%28Examinations%29%22">Response styles (Examinations)</searchLink><br />*<searchLink fieldCode="DE" term="%22Adapted+examinations%22">Adapted examinations</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+sampling%22">Statistical sampling</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The purpose of this study is to evaluate the performance of CATSIB (Computer Adaptive Testing-Simultaneous Item Bias Test) for detecting differential item functioning (DIF) when items in the matching and studied subtest are administered adaptively in the context of a realistic multi-stage adaptive test (MST). MST was simulated using a 4-item module in a 7-panel administration. Three independent variables, expected to affect DIF detection rates, were manipulated: item difficulty, sample size, and balanced/unbalanced design. CATSIB met the acceptable criteria, meaning that the Type I error and power rates met 5% and 80%, respectively, for the large reference/moderate focal sample and the large reference/large focal sample conditions. These results indicate that CATSIB can be used to consistently and accurately detect DIF on an MST, but only with moderate to large samples. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Educational Research & Evaluation is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=86179089 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/13803611.2013.767622 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 188 Subjects: – SubjectFull: Adaptive testing Type: general – SubjectFull: Competency tests (Education) Type: general – SubjectFull: Sequential approach (Teaching method) Type: general – SubjectFull: Response styles (Examinations) Type: general – SubjectFull: Adapted examinations Type: general – SubjectFull: Statistical sampling Type: general Titles: – TitleFull: Identifying differential item functioning in multi-stage computer adaptive testing. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Gierl, Mark J. – PersonEntity: Name: NameFull: Lai, Hollis – PersonEntity: Name: NameFull: Li, Johnson IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Text: Apr2013 Type: published Y: 2013 Identifiers: – Type: issn-print Value: 13803611 Numbering: – Type: volume Value: 19 – Type: issue Value: 2/3 Titles: – TitleFull: Educational Research & Evaluation Type: main |
| ResultId | 1 |
