Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework.
Saved in:
| Title: | Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework. |
|---|---|
| Authors: | Lim, Hwanggyu1 (AUTHOR), Zhu, Danqi2 (AUTHOR), Choe, Edison M.3 (AUTHOR), Han, KyungT.4 (AUTHOR) |
| Source: | Journal of Educational Measurement. Dec2024, Vol. 61 Issue 4, p656-681. 26p. |
| Subject Terms: | *Item response theory, False positive error, Error rates, Empirical research |
| Abstract: | This study presents a generalized version of the residual differential item functioning (RDIF) detection framework in item response theory, named GRDIF, to analyze differential item functioning (DIF) in multiple groups. The GRDIF framework retains the advantages of the original RDIF framework, such as computational efficiency and ease of implementation. The performance of GRDIF was assessed through a simulation study and compared with existing DIF detection methods, including the generalized Mantel‐Haenszel, Lasso‐DIF, and alignment methods. Results showed that the GRDIF framework demonstrated well‐controlled Type I error rates close to the nominal level of.05 and satisfactory power in detecting uniform, nonuniform, and mixed DIF across different simulated conditions. Each of the three GRDIF statistics, GRDIFR$GRDI{{F}_R}$, GRDIFS$GRDI{{F}_S}$, and GRDIFRS$GRDI{{F}_{RS}}$, effectively detected the specific type of DIF for which it was designed, with GRDIFRS$GRDI{{F}_{RS}}$ exhibiting the most robust performance across all types of DIF. The GRDIF framework outperformed other DIF detection methods under various conditions, suggesting its potential for practical applications, particularly in large‐scale assessments involving multiple groups. Additionally, an empirical study demonstrated the efficacy and utility of the GRDIF framework in conducting DIF analysis with a high‐stakes assessment data set. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 181921599 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Lim%2C+Hwanggyu%22">Lim, Hwanggyu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Zhu%2C+Danqi%22">Zhu, Danqi</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Choe%2C+Edison+M%2E%22">Choe, Edison M.</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Han%2C+KyungT%2E%22">Han, KyungT.</searchLink><relatesTo>4</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Educational+Measurement%22">Journal of Educational Measurement</searchLink>. Dec2024, Vol. 61 Issue 4, p656-681. 26p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Item+response+theory%22">Item response theory</searchLink><br /><searchLink fieldCode="DE" term="%22False+positive+error%22">False positive error</searchLink><br /><searchLink fieldCode="DE" term="%22Error+rates%22">Error rates</searchLink><br /><searchLink fieldCode="DE" term="%22Empirical+research%22">Empirical research</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This study presents a generalized version of the residual differential item functioning (RDIF) detection framework in item response theory, named GRDIF, to analyze differential item functioning (DIF) in multiple groups. The GRDIF framework retains the advantages of the original RDIF framework, such as computational efficiency and ease of implementation. The performance of GRDIF was assessed through a simulation study and compared with existing DIF detection methods, including the generalized Mantel‐Haenszel, Lasso‐DIF, and alignment methods. Results showed that the GRDIF framework demonstrated well‐controlled Type I error rates close to the nominal level of.05 and satisfactory power in detecting uniform, nonuniform, and mixed DIF across different simulated conditions. Each of the three GRDIF statistics, GRDIFR$GRDI{{F}_R}$, GRDIFS$GRDI{{F}_S}$, and GRDIFRS$GRDI{{F}_{RS}}$, effectively detected the specific type of DIF for which it was designed, with GRDIFRS$GRDI{{F}_{RS}}$ exhibiting the most robust performance across all types of DIF. The GRDIF framework outperformed other DIF detection methods under various conditions, suggesting its potential for practical applications, particularly in large‐scale assessments involving multiple groups. Additionally, an empirical study demonstrated the efficacy and utility of the GRDIF framework in conducting DIF analysis with a high‐stakes assessment data set. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=181921599 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/jedm.12415 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 26 StartPage: 656 Subjects: – SubjectFull: Item response theory Type: general – SubjectFull: False positive error Type: general – SubjectFull: Error rates Type: general – SubjectFull: Empirical research Type: general Titles: – TitleFull: Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Lim, Hwanggyu – PersonEntity: Name: NameFull: Zhu, Danqi – PersonEntity: Name: NameFull: Choe, Edison M. – PersonEntity: Name: NameFull: Han, KyungT. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 12 Text: Dec2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 00220655 Numbering: – Type: volume Value: 61 – Type: issue Value: 4 Titles: – TitleFull: Journal of Educational Measurement Type: main |
| ResultId | 1 |