View in EDS

Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups

Saved in:
Bibliographic Details
Title: Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups
Language: English
Authors: Sean Joo, Montserrat Valdivia, Dubravka Svetina Valdivia, Leslie Rutkowski
Source: Journal of Educational and Behavioral Statistics. 2024 49(3):465-493.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 29
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: International Assessment, Monte Carlo Methods, Statistical Studies, Error of Measurement, Weighted Scores, Test Norms, Item Response Theory, Measurement Techniques
Assessment and Survey Identifiers: Program for International Student Assessment
DOI: 10.3102/10769986231183326
ISSN: 1076-9986
1935-1054
Abstract: Evaluating scale comparability in international large-scale assessments depends on measurement invariance (MI). The root mean square deviation (RMSD) is a standard method for establishing MI in several programs, such as the Programme for International Student Assessment and the Programme for the International Assessment of Adult Competencies. Previous research showed that the RMSD was unable to detect departures from MI when the latent trait distribution was far from item difficulty. In this study, we developed three alternative approaches to the original RMSD: equal, item information, and b-norm weighted RMSDs. Specifically, we considered the item-centered normalized weight distributions to compute the item characteristic curve difference in the RMSD procedure more efficiently. We further compared all methods' performance via a simulation study and the item information and b-norm weighted RMSDs showed the most promising results. An empirical example is demonstrated, and implications for researchers are discussed.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1425737
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1425737
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sean+Joo%22">Sean Joo</searchLink><br /><searchLink fieldCode="AR" term="%22Montserrat+Valdivia%22">Montserrat Valdivia</searchLink><br /><searchLink fieldCode="AR" term="%22Dubravka+Svetina+Valdivia%22">Dubravka Svetina Valdivia</searchLink><br /><searchLink fieldCode="AR" term="%22Leslie+Rutkowski%22">Leslie Rutkowski</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Educational+and+Behavioral+Statistics%22"><i>Journal of Educational and Behavioral Statistics</i></searchLink>. 2024 49(3):465-493.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 29
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22International+Assessment%22">International Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Monte+Carlo+Methods%22">Monte Carlo Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Studies%22">Statistical Studies</searchLink><br /><searchLink fieldCode="DE" term="%22Error+of+Measurement%22">Error of Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Weighted+Scores%22">Weighted Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Norms%22">Test Norms</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement+Techniques%22">Measurement Techniques</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Program+for+International+Student+Assessment%22">Program for International Student Assessment</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.3102/10769986231183326
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1076-9986<br />1935-1054
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Evaluating scale comparability in international large-scale assessments depends on measurement invariance (MI). The root mean square deviation (RMSD) is a standard method for establishing MI in several programs, such as the Programme for International Student Assessment and the Programme for the International Assessment of Adult Competencies. Previous research showed that the RMSD was unable to detect departures from MI when the latent trait distribution was far from item difficulty. In this study, we developed three alternative approaches to the original RMSD: equal, item information, and b-norm weighted RMSDs. Specifically, we considered the item-centered normalized weight distributions to compute the item characteristic curve difference in the RMSD procedure more efficiently. We further compared all methods' performance via a simulation study and the item information and b-norm weighted RMSDs showed the most promising results. An empirical example is demonstrated, and implications for researchers are discussed.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1425737
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1425737
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.3102/10769986231183326
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 29
        StartPage: 465
    Subjects:
      – SubjectFull: International Assessment
        Type: general
      – SubjectFull: Monte Carlo Methods
        Type: general
      – SubjectFull: Statistical Studies
        Type: general
      – SubjectFull: Error of Measurement
        Type: general
      – SubjectFull: Weighted Scores
        Type: general
      – SubjectFull: Test Norms
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Measurement Techniques
        Type: general
      – SubjectFull: Program for International Student Assessment
        Type: general
    Titles:
      – TitleFull: Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sean Joo
      – PersonEntity:
          Name:
            NameFull: Montserrat Valdivia
      – PersonEntity:
          Name:
            NameFull: Dubravka Svetina Valdivia
      – PersonEntity:
          Name:
            NameFull: Leslie Rutkowski
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 1076-9986
            – Type: issn-electronic
              Value: 1935-1054
          Numbering:
            – Type: volume
              Value: 49
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Journal of Educational and Behavioral Statistics
              Type: main
ResultId 1