Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups
Saved in:
| Title: | Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups |
|---|---|
| Language: | English |
| Authors: | Sean Joo, Montserrat Valdivia, Dubravka Svetina Valdivia, Leslie Rutkowski |
| Source: | Journal of Educational and Behavioral Statistics. 2024 49(3):465-493. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 29 |
| Publication Date: | 2024 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | International Assessment, Monte Carlo Methods, Statistical Studies, Error of Measurement, Weighted Scores, Test Norms, Item Response Theory, Measurement Techniques |
| Assessment and Survey Identifiers: | Program for International Student Assessment |
| DOI: | 10.3102/10769986231183326 |
| ISSN: | 1076-9986 1935-1054 |
| Abstract: | Evaluating scale comparability in international large-scale assessments depends on measurement invariance (MI). The root mean square deviation (RMSD) is a standard method for establishing MI in several programs, such as the Programme for International Student Assessment and the Programme for the International Assessment of Adult Competencies. Previous research showed that the RMSD was unable to detect departures from MI when the latent trait distribution was far from item difficulty. In this study, we developed three alternative approaches to the original RMSD: equal, item information, and b-norm weighted RMSDs. Specifically, we considered the item-centered normalized weight distributions to compute the item characteristic curve difference in the RMSD procedure more efficiently. We further compared all methods' performance via a simulation study and the item information and b-norm weighted RMSDs showed the most promising results. An empirical example is demonstrated, and implications for researchers are discussed. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| Accession Number: | EJ1425737 |
| Database: | ERIC |
| Abstract: | Evaluating scale comparability in international large-scale assessments depends on measurement invariance (MI). The root mean square deviation (RMSD) is a standard method for establishing MI in several programs, such as the Programme for International Student Assessment and the Programme for the International Assessment of Adult Competencies. Previous research showed that the RMSD was unable to detect departures from MI when the latent trait distribution was far from item difficulty. In this study, we developed three alternative approaches to the original RMSD: equal, item information, and b-norm weighted RMSDs. Specifically, we considered the item-centered normalized weight distributions to compute the item characteristic curve difference in the RMSD procedure more efficiently. We further compared all methods' performance via a simulation study and the item information and b-norm weighted RMSDs showed the most promising results. An empirical example is demonstrated, and implications for researchers are discussed. |
|---|---|
| ISSN: | 1076-9986 1935-1054 |
| DOI: | 10.3102/10769986231183326 |
