Empirical Bayes Versus Standard Mantel-Haenszel Statistics for Detecting Differential Item Functioning Under Small Sample Conditions.

Saved in:
Bibliographic Details
Title: Empirical Bayes Versus Standard Mantel-Haenszel Statistics for Detecting Differential Item Functioning Under Small Sample Conditions.
Authors: Fidalgo, Ángel M., Hashimoto, Kanako, Bartram, Dave, Muñiz, Jose
Source: Journal of Experimental Education. Summer2007, Vol. 75 Issue 4, p293-314. 22p. 7 Charts, 1 Graph.
Subjects: Statistical sampling, Computer simulation, Statistics, Error analysis in mathematics, Estimation theory, Item response theory
Abstract: In this study, the authors assess several strategies created on the basis of the Mantel-Haenszel (MH) procedure for conducting differential item functioning (DIF) analysis with small samples. One of the analytical strategies is a loss function (LF) that uses empirical Bayes Mantel-Haenszel estimators, whereas the other strategies use the classical MH statistics (the MH chisquare statistic using high levels of significance [0.20] or empirical criteria on the basis of the magnitude of the MH-delta estimator). The authors conducted a series of computer simulations in which they manipulated different types of tests, sample sizes, and ability distributions. The results show that the loss function does not offer advantages, in terms of power and Type I error rate, over other analytical strategies that use the classical MH statistics. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Description
Abstract:In this study, the authors assess several strategies created on the basis of the Mantel-Haenszel (MH) procedure for conducting differential item functioning (DIF) analysis with small samples. One of the analytical strategies is a loss function (LF) that uses empirical Bayes Mantel-Haenszel estimators, whereas the other strategies use the classical MH statistics (the MH chisquare statistic using high levels of significance [0.20] or empirical criteria on the basis of the magnitude of the MH-delta estimator). The authors conducted a series of computer simulations in which they manipulated different types of tests, sample sizes, and ability distributions. The results show that the loss function does not offer advantages, in terms of power and Type I error rate, over other analytical strategies that use the classical MH statistics. [ABSTRACT FROM AUTHOR]
ISSN:00220973
DOI:10.3200/JEXE.75.4.293-316