Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption.

Saved in:
Bibliographic Details
Title: Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption.
Authors: Cook KF (AUTHOR), Kallen MA (AUTHOR), Amtmann D (AUTHOR), Cook, Karon F (AUTHOR), Kallen, Michael A (AUTHOR), Amtmann, Dagmar (AUTHOR)
Source: Quality of Life Research. May2009, Vol. 18 Issue 4, p447-460. 14p.
Abstract: Purpose: Confirmatory factor analysis fit criteria typically are used to evaluate the unidimensionality of item banks. This study explored the degree to which the values of these statistics are affected by two characteristics of item banks developed to measure health outcomes: large numbers of items and nonnormal data.Methods: Analyses were conducted on simulated and observed data. Observed data were responses to the Patient-Reported Outcome Measurement Information System (PROMIS) Pain Impact Item Bank. Simulated data fit the graded response model and conformed to a normal distribution or mirrored the distribution of the observed data. Confirmatory factor analyses (CFA), parallel analysis, and bifactor analysis were conducted.Results: CFA fit values were found to be sensitive to data distribution and number of items. In some instances impact of distribution and item number was quite large.Conclusions: We concluded that using traditional cutoffs and standards for CFA fit statistics is not recommended for establishing unidimensionality of item banks. An investigative approach is favored over reliance on published criteria. We found bifactor analysis to be appealing in this regard because it allows evaluation of the relative impact of secondary dimensions. In addition to these methodological conclusions, we judged the items of the PROMIS Pain Impact bank to be sufficiently unidimensional for item response theory (IRT) modeling. [ABSTRACT FROM AUTHOR]
Copyright of Quality of Life Research is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 105492181
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Cook+KF%22">Cook KF</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kallen+MA%22">Kallen MA</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Amtmann+D%22">Amtmann D</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Cook%2C+Karon+F%22">Cook, Karon F</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kallen%2C+Michael+A%22">Kallen, Michael A</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Amtmann%2C+Dagmar%22">Amtmann, Dagmar</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Quality+of+Life+Research%22">Quality of Life Research</searchLink>. May2009, Vol. 18 Issue 4, p447-460. 14p.
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: <bold>Purpose: </bold>Confirmatory factor analysis fit criteria typically are used to evaluate the unidimensionality of item banks. This study explored the degree to which the values of these statistics are affected by two characteristics of item banks developed to measure health outcomes: large numbers of items and nonnormal data.<bold>Methods: </bold>Analyses were conducted on simulated and observed data. Observed data were responses to the Patient-Reported Outcome Measurement Information System (PROMIS) Pain Impact Item Bank. Simulated data fit the graded response model and conformed to a normal distribution or mirrored the distribution of the observed data. Confirmatory factor analyses (CFA), parallel analysis, and bifactor analysis were conducted.<bold>Results: </bold>CFA fit values were found to be sensitive to data distribution and number of items. In some instances impact of distribution and item number was quite large.<bold>Conclusions: </bold>We concluded that using traditional cutoffs and standards for CFA fit statistics is not recommended for establishing unidimensionality of item banks. An investigative approach is favored over reliance on published criteria. We found bifactor analysis to be appealing in this regard because it allows evaluation of the relative impact of secondary dimensions. In addition to these methodological conclusions, we judged the items of the PROMIS Pain Impact bank to be sufficiently unidimensional for item response theory (IRT) modeling. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Quality of Life Research is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=105492181
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11136-009-9464-4
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 447
    Titles:
      – TitleFull: Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Cook KF
      – PersonEntity:
          Name:
            NameFull: Kallen MA
      – PersonEntity:
          Name:
            NameFull: Amtmann D
      – PersonEntity:
          Name:
            NameFull: Cook, Karon F
      – PersonEntity:
          Name:
            NameFull: Kallen, Michael A
      – PersonEntity:
          Name:
            NameFull: Amtmann, Dagmar
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2009
              Type: published
              Y: 2009
          Identifiers:
            – Type: issn-print
              Value: 09629343
          Numbering:
            – Type: volume
              Value: 18
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Quality of Life Research
              Type: main
ResultId 1