Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework
Saved in:
| Title: | Detecting Differential Item Functioning among Multiple Groups Using IRT Residual DIF Framework |
|---|---|
| Language: | English |
| Authors: | Hwanggyu Lim, Danqi Zhu, Edison M. Choe, Kyung T. Han |
| Source: | Journal of Educational Measurement. 2024 61(4):656-681. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 26 |
| Publication Date: | 2024 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Item Response Theory, Test Bias, Test Reliability, Test Construction, Group Testing, Error of Measurement |
| DOI: | 10.1111/jedm.12415 |
| ISSN: | 0022-0655 1745-3984 |
| Abstract: | This study presents a generalized version of the residual differential item functioning (RDIF) detection framework in item response theory, named GRDIF, to analyze differential item functioning (DIF) in multiple groups. The GRDIF framework retains the advantages of the original RDIF framework, such as computational efficiency and ease of implementation. The performance of GRDIF was assessed through a simulation study and compared with existing DIF detection methods, including the generalized Mantel-Haenszel, Lasso-DIF, and alignment methods. Results showed that the GRDIF framework demonstrated well-controlled Type I error rates close to the nominal level of .05 and satisfactory power in detecting uniform, nonuniform, and mixed DIF across different simulated conditions. Each of the three GRDIF statistics, GRDIF[subscript R], GRDIF[subscript S], and GRDIF[subscript RS], effectively detected the specific type of DIF for which it was designed, with GRDIF[subscript RS] exhibiting the most robust performance across all types of DIF. The GRDIF framework outperformed other DIF detection methods under various conditions, suggesting its potential for practical applications, particularly in large-scale assessments involving multiple groups. Additionally, an empirical study demonstrated the efficacy and utility of the GRDIF framework in conducting DIF analysis with a high-stakes assessment data set. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1455024 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | This study presents a generalized version of the residual differential item functioning (RDIF) detection framework in item response theory, named GRDIF, to analyze differential item functioning (DIF) in multiple groups. The GRDIF framework retains the advantages of the original RDIF framework, such as computational efficiency and ease of implementation. The performance of GRDIF was assessed through a simulation study and compared with existing DIF detection methods, including the generalized Mantel-Haenszel, Lasso-DIF, and alignment methods. Results showed that the GRDIF framework demonstrated well-controlled Type I error rates close to the nominal level of .05 and satisfactory power in detecting uniform, nonuniform, and mixed DIF across different simulated conditions. Each of the three GRDIF statistics, GRDIF[subscript R], GRDIF[subscript S], and GRDIF[subscript RS], effectively detected the specific type of DIF for which it was designed, with GRDIF[subscript RS] exhibiting the most robust performance across all types of DIF. The GRDIF framework outperformed other DIF detection methods under various conditions, suggesting its potential for practical applications, particularly in large-scale assessments involving multiple groups. Additionally, an empirical study demonstrated the efficacy and utility of the GRDIF framework in conducting DIF analysis with a high-stakes assessment data set. |
|---|---|
| ISSN: | 0022-0655 1745-3984 |
| DOI: | 10.1111/jedm.12415 |
