Beyond Matching on the Mean in Developmental Disabilities Research

Saved in:
Bibliographic Details
Title: Beyond Matching on the Mean in Developmental Disabilities Research
Language: English
Authors: Facon, Bruno, Magis, David, Belmont, John M.
Source: Research in Developmental Disabilities: A Multidisciplinary Journal. Nov-Dec 2011 32(6):2134-2147.
Availability: Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Peer Reviewed: Y
Page Count: 14
Publication Date: 2011
Document Type: Journal Articles
Reports - Evaluative
Descriptors: Test Bias, Developmental Disabilities, Scores, Statistical Analysis, Matched Groups, Statistical Bias, Statistics, Item Response Theory, Test Items
DOI: 10.1016/j.ridd.2011.07.029
ISSN: 0891-4222
Abstract: The matching of groups is a traditional way to control for confounding variables in developmental disabilities research. The equivalency of means across groups is routinely checked for these variables, but not the homogeneity of their variances or the shapes of their distributions. In the present paper, it is argued that group matching can go seriously wrong unless it directly confronts the distributional concerns by the use of well-known statistical indices and very simple graphical displays of the distributions. The question of the equivalency of item response profiles is also addressed since two participants or two groups of participants can obtain the same overall score on the matching variable by passing different items. In this case, the matching cannot be considered satisfactory because of poor concordance between the molar (overall score) and molecular (item scores) levels of matching. Angoff's Delta plot method, a statistical approach for detecting differential item functioning across small groups is described. It is promising as a simple way to prove whole test/individual item correspondence and, in addition, a useful tool for making post hoc statistical analyses at the item level on the dependent variables. (Contains 1 table and 6 figures.)
Abstractor: As Provided
Entry Date: 2011
Accession Number: EJ942656
Database: ERIC
Description
Abstract:The matching of groups is a traditional way to control for confounding variables in developmental disabilities research. The equivalency of means across groups is routinely checked for these variables, but not the homogeneity of their variances or the shapes of their distributions. In the present paper, it is argued that group matching can go seriously wrong unless it directly confronts the distributional concerns by the use of well-known statistical indices and very simple graphical displays of the distributions. The question of the equivalency of item response profiles is also addressed since two participants or two groups of participants can obtain the same overall score on the matching variable by passing different items. In this case, the matching cannot be considered satisfactory because of poor concordance between the molar (overall score) and molecular (item scores) levels of matching. Angoff's Delta plot method, a statistical approach for detecting differential item functioning across small groups is described. It is promising as a simple way to prove whole test/individual item correspondence and, in addition, a useful tool for making post hoc statistical analyses at the item level on the dependent variables. (Contains 1 table and 6 figures.)
ISSN:0891-4222
DOI:10.1016/j.ridd.2011.07.029