Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework.
Saved in:
| Title: | Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework. |
|---|---|
| Authors: | Lim, Hwanggyu1 (AUTHOR), Zhu, Danqi2 (AUTHOR), Choe, Edison M.3 (AUTHOR), Han, KyungT.4 (AUTHOR) |
| Source: | Journal of Educational Measurement. Dec2024, Vol. 61 Issue 4, p656-681. 26p. |
| Subject Terms: | *Item response theory, False positive error, Error rates, Empirical research |
| Abstract: | This study presents a generalized version of the residual differential item functioning (RDIF) detection framework in item response theory, named GRDIF, to analyze differential item functioning (DIF) in multiple groups. The GRDIF framework retains the advantages of the original RDIF framework, such as computational efficiency and ease of implementation. The performance of GRDIF was assessed through a simulation study and compared with existing DIF detection methods, including the generalized Mantel‐Haenszel, Lasso‐DIF, and alignment methods. Results showed that the GRDIF framework demonstrated well‐controlled Type I error rates close to the nominal level of.05 and satisfactory power in detecting uniform, nonuniform, and mixed DIF across different simulated conditions. Each of the three GRDIF statistics, GRDIFR$GRDI{{F}_R}$, GRDIFS$GRDI{{F}_S}$, and GRDIFRS$GRDI{{F}_{RS}}$, effectively detected the specific type of DIF for which it was designed, with GRDIFRS$GRDI{{F}_{RS}}$ exhibiting the most robust performance across all types of DIF. The GRDIF framework outperformed other DIF detection methods under various conditions, suggesting its potential for practical applications, particularly in large‐scale assessments involving multiple groups. Additionally, an empirical study demonstrated the efficacy and utility of the GRDIF framework in conducting DIF analysis with a high‐stakes assessment data set. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | This study presents a generalized version of the residual differential item functioning (RDIF) detection framework in item response theory, named GRDIF, to analyze differential item functioning (DIF) in multiple groups. The GRDIF framework retains the advantages of the original RDIF framework, such as computational efficiency and ease of implementation. The performance of GRDIF was assessed through a simulation study and compared with existing DIF detection methods, including the generalized Mantel‐Haenszel, Lasso‐DIF, and alignment methods. Results showed that the GRDIF framework demonstrated well‐controlled Type I error rates close to the nominal level of.05 and satisfactory power in detecting uniform, nonuniform, and mixed DIF across different simulated conditions. Each of the three GRDIF statistics, GRDIFR$GRDI{{F}_R}$, GRDIFS$GRDI{{F}_S}$, and GRDIFRS$GRDI{{F}_{RS}}$, effectively detected the specific type of DIF for which it was designed, with GRDIFRS$GRDI{{F}_{RS}}$ exhibiting the most robust performance across all types of DIF. The GRDIF framework outperformed other DIF detection methods under various conditions, suggesting its potential for practical applications, particularly in large‐scale assessments involving multiple groups. Additionally, an empirical study demonstrated the efficacy and utility of the GRDIF framework in conducting DIF analysis with a high‐stakes assessment data set. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 00220655 |
| DOI: | 10.1111/jedm.12415 |
