Beyond Matching on the Mean in Developmental Disabilities Research

Saved in:
Bibliographic Details
Title: Beyond Matching on the Mean in Developmental Disabilities Research
Language: English
Authors: Facon, Bruno, Magis, David, Belmont, John M.
Source: Research in Developmental Disabilities: A Multidisciplinary Journal. Nov-Dec 2011 32(6):2134-2147.
Availability: Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Peer Reviewed: Y
Page Count: 14
Publication Date: 2011
Document Type: Journal Articles
Reports - Evaluative
Descriptors: Test Bias, Developmental Disabilities, Scores, Statistical Analysis, Matched Groups, Statistical Bias, Statistics, Item Response Theory, Test Items
DOI: 10.1016/j.ridd.2011.07.029
ISSN: 0891-4222
Abstract: The matching of groups is a traditional way to control for confounding variables in developmental disabilities research. The equivalency of means across groups is routinely checked for these variables, but not the homogeneity of their variances or the shapes of their distributions. In the present paper, it is argued that group matching can go seriously wrong unless it directly confronts the distributional concerns by the use of well-known statistical indices and very simple graphical displays of the distributions. The question of the equivalency of item response profiles is also addressed since two participants or two groups of participants can obtain the same overall score on the matching variable by passing different items. In this case, the matching cannot be considered satisfactory because of poor concordance between the molar (overall score) and molecular (item scores) levels of matching. Angoff's Delta plot method, a statistical approach for detecting differential item functioning across small groups is described. It is promising as a simple way to prove whole test/individual item correspondence and, in addition, a useful tool for making post hoc statistical analyses at the item level on the dependent variables. (Contains 1 table and 6 figures.)
Abstractor: As Provided
Entry Date: 2011
Accession Number: EJ942656
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ942656
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Beyond Matching on the Mean in Developmental Disabilities Research
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Facon%2C+Bruno%22">Facon, Bruno</searchLink><br /><searchLink fieldCode="AR" term="%22Magis%2C+David%22">Magis, David</searchLink><br /><searchLink fieldCode="AR" term="%22Belmont%2C+John+M%2E%22">Belmont, John M.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Research+in+Developmental+Disabilities%3A+A+Multidisciplinary+Journal%22"><i>Research in Developmental Disabilities: A Multidisciplinary Journal</i></searchLink>. Nov-Dec 2011 32(6):2134-2147.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2011
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Bias%22">Test Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Developmental+Disabilities%22">Developmental Disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Analysis%22">Statistical Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Matched+Groups%22">Matched Groups</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Bias%22">Statistical Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1016/j.ridd.2011.07.029
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0891-4222
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The matching of groups is a traditional way to control for confounding variables in developmental disabilities research. The equivalency of means across groups is routinely checked for these variables, but not the homogeneity of their variances or the shapes of their distributions. In the present paper, it is argued that group matching can go seriously wrong unless it directly confronts the distributional concerns by the use of well-known statistical indices and very simple graphical displays of the distributions. The question of the equivalency of item response profiles is also addressed since two participants or two groups of participants can obtain the same overall score on the matching variable by passing different items. In this case, the matching cannot be considered satisfactory because of poor concordance between the molar (overall score) and molecular (item scores) levels of matching. Angoff's Delta plot method, a statistical approach for detecting differential item functioning across small groups is described. It is promising as a simple way to prove whole test/individual item correspondence and, in addition, a useful tool for making post hoc statistical analyses at the item level on the dependent variables. (Contains 1 table and 6 figures.)
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2011
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ942656
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ942656
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.ridd.2011.07.029
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 2134
    Subjects:
      – SubjectFull: Test Bias
        Type: general
      – SubjectFull: Developmental Disabilities
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Statistical Analysis
        Type: general
      – SubjectFull: Matched Groups
        Type: general
      – SubjectFull: Statistical Bias
        Type: general
      – SubjectFull: Statistics
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Test Items
        Type: general
    Titles:
      – TitleFull: Beyond Matching on the Mean in Developmental Disabilities Research
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Facon, Bruno
      – PersonEntity:
          Name:
            NameFull: Magis, David
      – PersonEntity:
          Name:
            NameFull: Belmont, John M.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2011
          Identifiers:
            – Type: issn-print
              Value: 0891-4222
          Numbering:
            – Type: volume
              Value: 32
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Research in Developmental Disabilities: A Multidisciplinary Journal
              Type: main
ResultId 1