Assessing the equivalence of Web-based and paper-and-pencil questionnaires using differential item and test functioning (DIF and DTF) analysis: a case of the Four-Dimensional Symptom Questionnaire (4DSQ).

Saved in:
Bibliographic Details
Title: Assessing the equivalence of Web-based and paper-and-pencil questionnaires using differential item and test functioning (DIF and DTF) analysis: a case of the Four-Dimensional Symptom Questionnaire (4DSQ).
Authors: Terluin, Berend, Brouwers, Evelien P. M., Marchand, Miquelle A. G., de Vet, Henrica C. W.
Source: Quality of Life Research. May2018, Vol. 27 Issue 5, p1191-1200. 10p. 1 Diagram, 5 Charts, 2 Graphs.
Subjects: Internet questionnaires, Health surveys, Psychological distress, Mental depression, Anxiety, Somatization disorder, Psychometrics, Questionnaires, Research evaluation, Data analysis software, Descriptive statistics, Differential item functioning (Research bias)
Abstract: Purpose: Many paper-and-pencil (P&P) questionnaires have been migrated to electronic platforms. Differential item and test functioning (DIF and DTF) analysis constitutes a superior research design to assess measurement equivalence across modes of administration. The purpose of this study was to demonstrate an item response theory (IRT)-based DIF and DTF analysis to assess the measurement equivalence of a Web-based version and the original P&P format of the Four-Dimensional Symptom Questionnaire (4DSQ), measuring distress, depression, anxiety, and somatization.Methods: The P&P group (n = 2031) and the Web group (n = 958) consisted of primary care psychology clients. Unidimensionality and local independence of the 4DSQ scales were examined using IRT and Yen's Q3. Bifactor modeling was used to assess the scales' essential unidimensionality. Measurement equivalence was assessed using IRT-based DIF analysis using a 3-stage approach: linking on the latent mean and variance, selection of anchor items, and DIF testing using the Wald test. DTF was evaluated by comparing expected scale scores as a function of the latent trait.Results: The 4DSQ scales proved to be essentially unidimensional in both modalities. Five items, belonging to the distress and somatization scales, displayed small amounts of DIF. DTF analysis revealed that the impact of DIF on the scale level was negligible.Conclusions: IRT-based DIF and DTF analysis is demonstrated as a way to assess the equivalence of Web-based and P&P questionnaire modalities. Data obtained with the Web-based 4DSQ are equivalent to data obtained with the P&P version. [ABSTRACT FROM AUTHOR]
Copyright of Quality of Life Research is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 128968845
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Assessing the equivalence of Web-based and paper-and-pencil questionnaires using differential item and test functioning (DIF and DTF) analysis: a case of the Four-Dimensional Symptom Questionnaire (4DSQ).
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Terluin%2C+Berend%22">Terluin, Berend</searchLink><br /><searchLink fieldCode="AR" term="%22Brouwers%2C+Evelien+P%2E+M%2E%22">Brouwers, Evelien P. M.</searchLink><br /><searchLink fieldCode="AR" term="%22Marchand%2C+Miquelle+A%2E+G%2E%22">Marchand, Miquelle A. G.</searchLink><br /><searchLink fieldCode="AR" term="%22de+Vet%2C+Henrica+C%2E+W%2E%22">de Vet, Henrica C. W.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Quality+of+Life+Research%22">Quality of Life Research</searchLink>. May2018, Vol. 27 Issue 5, p1191-1200. 10p. 1 Diagram, 5 Charts, 2 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Internet+questionnaires%22">Internet questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Health+surveys%22">Health surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+distress%22">Psychological distress</searchLink><br /><searchLink fieldCode="DE" term="%22Mental+depression%22">Mental depression</searchLink><br /><searchLink fieldCode="DE" term="%22Anxiety%22">Anxiety</searchLink><br /><searchLink fieldCode="DE" term="%22Somatization+disorder%22">Somatization disorder</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Questionnaires%22">Questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Research+evaluation%22">Research evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis+software%22">Data analysis software</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Differential+item+functioning+%28Research+bias%29%22">Differential item functioning (Research bias)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: <bold>Purpose: </bold>Many paper-and-pencil (P&P) questionnaires have been migrated to electronic platforms. Differential item and test functioning (DIF and DTF) analysis constitutes a superior research design to assess measurement equivalence across modes of administration. The purpose of this study was to demonstrate an item response theory (IRT)-based DIF and DTF analysis to assess the measurement equivalence of a Web-based version and the original P&P format of the Four-Dimensional Symptom Questionnaire (4DSQ), measuring distress, depression, anxiety, and somatization.<bold>Methods: </bold>The P&P group (n = 2031) and the Web group (n = 958) consisted of primary care psychology clients. Unidimensionality and local independence of the 4DSQ scales were examined using IRT and Yen's Q3. Bifactor modeling was used to assess the scales' essential unidimensionality. Measurement equivalence was assessed using IRT-based DIF analysis using a 3-stage approach: linking on the latent mean and variance, selection of anchor items, and DIF testing using the Wald test. DTF was evaluated by comparing expected scale scores as a function of the latent trait.<bold>Results: </bold>The 4DSQ scales proved to be essentially unidimensional in both modalities. Five items, belonging to the distress and somatization scales, displayed small amounts of DIF. DTF analysis revealed that the impact of DIF on the scale level was negligible.<bold>Conclusions: </bold>IRT-based DIF and DTF analysis is demonstrated as a way to assess the equivalence of Web-based and P&P questionnaire modalities. Data obtained with the Web-based 4DSQ are equivalent to data obtained with the P&P version. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Quality of Life Research is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=128968845
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11136-018-1816-5
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 10
        StartPage: 1191
    Subjects:
      – SubjectFull: Internet questionnaires
        Type: general
      – SubjectFull: Health surveys
        Type: general
      – SubjectFull: Psychological distress
        Type: general
      – SubjectFull: Mental depression
        Type: general
      – SubjectFull: Anxiety
        Type: general
      – SubjectFull: Somatization disorder
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Questionnaires
        Type: general
      – SubjectFull: Research evaluation
        Type: general
      – SubjectFull: Data analysis software
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Differential item functioning (Research bias)
        Type: general
    Titles:
      – TitleFull: Assessing the equivalence of Web-based and paper-and-pencil questionnaires using differential item and test functioning (DIF and DTF) analysis: a case of the Four-Dimensional Symptom Questionnaire (4DSQ).
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Terluin, Berend
      – PersonEntity:
          Name:
            NameFull: Brouwers, Evelien P. M.
      – PersonEntity:
          Name:
            NameFull: Marchand, Miquelle A. G.
      – PersonEntity:
          Name:
            NameFull: de Vet, Henrica C. W.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2018
              Type: published
              Y: 2018
          Identifiers:
            – Type: issn-print
              Value: 09629343
          Numbering:
            – Type: volume
              Value: 27
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Quality of Life Research
              Type: main
ResultId 1