View in EDS

Item Purification Does Not Always Improve DIF Detection: A Counterexample with Angoff's Delta Plot

Saved in:
Bibliographic Details
Title: Item Purification Does Not Always Improve DIF Detection: A Counterexample with Angoff's Delta Plot
Language: English
Authors: Magis, David, Facon, Bruno
Source: Educational and Psychological Measurement. Apr 2013 73(2):293-311.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 19
Publication Date: 2013
Document Type: Journal Articles
Reports - Research
Education Level: Early Childhood Education
Preschool Education
Kindergarten
Primary Education
Descriptors: Test Bias, Test Items, Statistical Analysis, Error of Measurement, Preschool Children, Kindergarten, Young Children, Down Syndrome, Mental Retardation, Tests
Assessment and Survey Identifiers: Boehm Test of Basic Concepts
DOI: 10.1177/0013164412451903
ISSN: 0013-1644
Abstract: Item purification is an iterative process that is often advocated as improving the identification of items affected by differential item functioning (DIF). With test-score-based DIF detection methods, item purification iteratively removes the items currently flagged as DIF from the test scores to get purified sets of items, unaffected by DIF. The purpose of this article is to highlight that item purification is not always useful and that a single run of the DIF method may return equally suitable results. Angoff's Delta plot is considered as a counterexample DIF method, with a recent improvement to the derivation of the classification threshold. Several possible item purification processes may be defined with this method, and all of them are compared through a simulation study and a real data set analysis. It appears that none of these purification processes clearly improves the Delta plot performance. A tentative explanation is drawn from the conceptual difference between the modified Delta plot and the other traditional DIF methods. (Contains 4 figures and 1 table.)
Abstractor: As Provided
Number of References: 36
Entry Date: 2014
Accession Number: EJ1010165
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1010165
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Item Purification Does Not Always Improve DIF Detection: A Counterexample with Angoff's Delta Plot
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Magis%2C+David%22">Magis, David</searchLink><br /><searchLink fieldCode="AR" term="%22Facon%2C+Bruno%22">Facon, Bruno</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Educational+and+Psychological+Measurement%22"><i>Educational and Psychological Measurement</i></searchLink>. Apr 2013 73(2):293-311.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 19
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2013
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="EL" term="%22Kindergarten%22">Kindergarten</searchLink><br /><searchLink fieldCode="EL" term="%22Primary+Education%22">Primary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Bias%22">Test Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Analysis%22">Statistical Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Error+of+Measurement%22">Error of Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Children%22">Preschool Children</searchLink><br /><searchLink fieldCode="DE" term="%22Kindergarten%22">Kindergarten</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Children%22">Young Children</searchLink><br /><searchLink fieldCode="DE" term="%22Down+Syndrome%22">Down Syndrome</searchLink><br /><searchLink fieldCode="DE" term="%22Mental+Retardation%22">Mental Retardation</searchLink><br /><searchLink fieldCode="DE" term="%22Tests%22">Tests</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Boehm+Test+of+Basic+Concepts%22">Boehm Test of Basic Concepts</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/0013164412451903
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0013-1644
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Item purification is an iterative process that is often advocated as improving the identification of items affected by differential item functioning (DIF). With test-score-based DIF detection methods, item purification iteratively removes the items currently flagged as DIF from the test scores to get purified sets of items, unaffected by DIF. The purpose of this article is to highlight that item purification is not always useful and that a single run of the DIF method may return equally suitable results. Angoff's Delta plot is considered as a counterexample DIF method, with a recent improvement to the derivation of the classification threshold. Several possible item purification processes may be defined with this method, and all of them are compared through a simulation study and a real data set analysis. It appears that none of these purification processes clearly improves the Delta plot performance. A tentative explanation is drawn from the conceptual difference between the modified Delta plot and the other traditional DIF methods. (Contains 4 figures and 1 table.)
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 36
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2014
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1010165
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1010165
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/0013164412451903
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 293
    Subjects:
      – SubjectFull: Test Bias
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Statistical Analysis
        Type: general
      – SubjectFull: Error of Measurement
        Type: general
      – SubjectFull: Preschool Children
        Type: general
      – SubjectFull: Kindergarten
        Type: general
      – SubjectFull: Young Children
        Type: general
      – SubjectFull: Down Syndrome
        Type: general
      – SubjectFull: Mental Retardation
        Type: general
      – SubjectFull: Tests
        Type: general
      – SubjectFull: Boehm Test of Basic Concepts
        Type: general
    Titles:
      – TitleFull: Item Purification Does Not Always Improve DIF Detection: A Counterexample with Angoff's Delta Plot
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Magis, David
      – PersonEntity:
          Name:
            NameFull: Facon, Bruno
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Type: published
              Y: 2013
          Identifiers:
            – Type: issn-print
              Value: 0013-1644
          Numbering:
            – Type: volume
              Value: 73
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Educational and Psychological Measurement
              Type: main
ResultId 1