View in EDS

Internal validation methods to detect patient characteristics associated with differential item functioning in patient-reported outcome measures.

Saved in:
Bibliographic Details
Title: Internal validation methods to detect patient characteristics associated with differential item functioning in patient-reported outcome measures.
Authors: Bodawatte Gedara, Muditha (AUTHOR), Jiang, Depeng (AUTHOR), Kim, Sunmee (AUTHOR), Sanusi, Ridwan (AUTHOR), Sajobi, Tolulope (AUTHOR), Lix, Lisa M. (AUTHOR)
Source: Quality of Life Research. May2026, Vol. 35 Issue 5, p1-14. 14p.
Subjects: Model validation, Machine learning, Simulation methods & models, Patient reported outcome measures, Item response theory, Recursive partitioning
Abstract: Purpose: Differential item functioning (DIF) detection methods are one tool to assess validity of patient-reported outcome measures (PROMs). Given the growing interest in machine-learning models for the analysis of PROMs data, including for DIF detection, internal cross-validation (CV) is recommended to assess model performance. We compared two CV methods for DIF models in simulated and real-world data. Methods: Two common CV methods, k-fold and holdout CV, were compared for a machine-learning recursive partitioning model to detect DIF. Simulation parameters included sample size, number of items and covariates associated with DIF, and DIF effect size. Simulation performance was assessed using true positive rate (TPR; power) and false positive rate (FPR; Type I error) for items, covariates, and all item-covariate combinations. DIF performance was also assessed in real-world Hospital Anxiety and Depression Scale (HADS) item responses using area under the receiver operating characteristic (AUROC) curve. Results: In simulations, TPRs for consistently identifying items and covariates associated with DIF increased as DIF effect size, sample size, and number of items increased for both CV methods. The 10-fold CV method had the highest TPR in many conditions reaching nearly 100% at the item-covariate level while the 50% holdout CV method had the lowest FPR. For HADS items, DIF detection varied between CV methods, with AUROC ranging from 0.74 to 0.80. Conclusion: The choice of a CV method for a machine-learning model to detect DIF affected consistency of DIF item detection. The 10-fold CV method was advantageous for balancing systematic error and data stability. [ABSTRACT FROM AUTHOR]
Copyright of Quality of Life Research is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 192687326
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Internal validation methods to detect patient characteristics associated with differential item functioning in patient-reported outcome measures.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Bodawatte+Gedara%2C+Muditha%22">Bodawatte Gedara, Muditha</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Jiang%2C+Depeng%22">Jiang, Depeng</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kim%2C+Sunmee%22">Kim, Sunmee</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Sanusi%2C+Ridwan%22">Sanusi, Ridwan</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Sajobi%2C+Tolulope%22">Sajobi, Tolulope</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lix%2C+Lisa+M%2E%22">Lix, Lisa M.</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Quality+of+Life+Research%22">Quality of Life Research</searchLink>. May2026, Vol. 35 Issue 5, p1-14. 14p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Model+validation%22">Model validation</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Simulation+methods+%26+models%22">Simulation methods & models</searchLink><br /><searchLink fieldCode="DE" term="%22Patient+reported+outcome+measures%22">Patient reported outcome measures</searchLink><br /><searchLink fieldCode="DE" term="%22Item+response+theory%22">Item response theory</searchLink><br /><searchLink fieldCode="DE" term="%22Recursive+partitioning%22">Recursive partitioning</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Differential item functioning (DIF) detection methods are one tool to assess validity of patient-reported outcome measures (PROMs). Given the growing interest in machine-learning models for the analysis of PROMs data, including for DIF detection, internal cross-validation (CV) is recommended to assess model performance. We compared two CV methods for DIF models in simulated and real-world data. Methods: Two common CV methods, k-fold and holdout CV, were compared for a machine-learning recursive partitioning model to detect DIF. Simulation parameters included sample size, number of items and covariates associated with DIF, and DIF effect size. Simulation performance was assessed using true positive rate (TPR; power) and false positive rate (FPR; Type I error) for items, covariates, and all item-covariate combinations. DIF performance was also assessed in real-world Hospital Anxiety and Depression Scale (HADS) item responses using area under the receiver operating characteristic (AUROC) curve. Results: In simulations, TPRs for consistently identifying items and covariates associated with DIF increased as DIF effect size, sample size, and number of items increased for both CV methods. The 10-fold CV method had the highest TPR in many conditions reaching nearly 100% at the item-covariate level while the 50% holdout CV method had the lowest FPR. For HADS items, DIF detection varied between CV methods, with AUROC ranging from 0.74 to 0.80. Conclusion: The choice of a CV method for a machine-learning model to detect DIF affected consistency of DIF item detection. The 10-fold CV method was advantageous for balancing systematic error and data stability. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Quality of Life Research is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=192687326
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11136-026-04196-x
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 1
    Subjects:
      – SubjectFull: Model validation
        Type: general
      – SubjectFull: Machine learning
        Type: general
      – SubjectFull: Simulation methods & models
        Type: general
      – SubjectFull: Patient reported outcome measures
        Type: general
      – SubjectFull: Item response theory
        Type: general
      – SubjectFull: Recursive partitioning
        Type: general
    Titles:
      – TitleFull: Internal validation methods to detect patient characteristics associated with differential item functioning in patient-reported outcome measures.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Bodawatte Gedara, Muditha
      – PersonEntity:
          Name:
            NameFull: Jiang, Depeng
      – PersonEntity:
          Name:
            NameFull: Kim, Sunmee
      – PersonEntity:
          Name:
            NameFull: Sanusi, Ridwan
      – PersonEntity:
          Name:
            NameFull: Sajobi, Tolulope
      – PersonEntity:
          Name:
            NameFull: Lix, Lisa M.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 09629343
          Numbering:
            – Type: volume
              Value: 35
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Quality of Life Research
              Type: main
ResultId 1