A Comprehensive Multivariate Generalizability Theory-Based Analysis of Responses to the IPIP-NEO-120.

Saved in:
Bibliographic Details
Title: A Comprehensive Multivariate Generalizability Theory-Based Analysis of Responses to the IPIP-NEO-120.
Authors: Vispoel, Walter P. (AUTHOR), Hong, Hyeri (AUTHOR), Lee, Hyeryung (AUTHOR), Chen, Tingting (AUTHOR)
Source: Journal of Personality Assessment. Jul/Aug2026, Vol. 108 Issue 4, p464-476. 13p.
Subjects: Generalizability theory, Psychometrics, Data quality, Personality assessment, Five-factor model of personality, Personality questionnaires, Psychological tests
Abstract: The 120-item International Personality Item Pool-NEO questionnaire (IPIP-NEO-120) was recently developed to measure the same Big Five global domain and nested facet constructs included in the 240-item Revised NEO Personality Inventory (NEO PI-R) but more efficiently and at no cost to users. We summarize evidence of reliability and validity for IPIP-NEO-120 scores reported in previous research and further evaluate the psychometric properties of those scores using multivariate generalizability theory (MGT) procedures based on data collected from 447,500 respondents. We used MGT techniques to derive indices of score accuracy for both norm- and criterion-referencing purposes, produce more appropriate indices of accuracy for domain composite scores, estimate correlations between facet scores within each domain corrected for measurement error, and determine value gained when reporting facet in addition to domain scores. Results revealed that indices of score accuracy for domains generally exceeded those for facets, that facet score constructs were more strongly intercorrelated than would otherwise be inferred, and that 28 out of the 30 facet subscales provided added value beyond associated domain scales. We identify facet subscales most in need of improvement and provide code in R to enable readers to apply all demonstrated techniques to their own data. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Personality Assessment is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 194542287
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Comprehensive Multivariate Generalizability Theory-Based Analysis of Responses to the IPIP-NEO-120.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Vispoel%2C+Walter+P%2E%22">Vispoel, Walter P.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Hong%2C+Hyeri%22">Hong, Hyeri</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lee%2C+Hyeryung%22">Lee, Hyeryung</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Tingting%22">Chen, Tingting</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Personality+Assessment%22">Journal of Personality Assessment</searchLink>. Jul/Aug2026, Vol. 108 Issue 4, p464-476. 13p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Generalizability+theory%22">Generalizability theory</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Data+quality%22">Data quality</searchLink><br /><searchLink fieldCode="DE" term="%22Personality+assessment%22">Personality assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Five-factor+model+of+personality%22">Five-factor model of personality</searchLink><br /><searchLink fieldCode="DE" term="%22Personality+questionnaires%22">Personality questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+tests%22">Psychological tests</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The 120-item International Personality Item Pool-NEO questionnaire (IPIP-NEO-120) was recently developed to measure the same Big Five global domain and nested facet constructs included in the 240-item Revised NEO Personality Inventory (NEO PI-R) but more efficiently and at no cost to users. We summarize evidence of reliability and validity for IPIP-NEO-120 scores reported in previous research and further evaluate the psychometric properties of those scores using multivariate generalizability theory (MGT) procedures based on data collected from 447,500 respondents. We used MGT techniques to derive indices of score accuracy for both norm- and criterion-referencing purposes, produce more appropriate indices of accuracy for domain composite scores, estimate correlations between facet scores within each domain corrected for measurement error, and determine value gained when reporting facet in addition to domain scores. Results revealed that indices of score accuracy for domains generally exceeded those for facets, that facet score constructs were more strongly intercorrelated than would otherwise be inferred, and that 28 out of the 30 facet subscales provided added value beyond associated domain scales. We identify facet subscales most in need of improvement and provide code in R to enable readers to apply all demonstrated techniques to their own data. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Personality Assessment is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=194542287
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/00223891.2025.2606013
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 464
    Subjects:
      – SubjectFull: Generalizability theory
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Data quality
        Type: general
      – SubjectFull: Personality assessment
        Type: general
      – SubjectFull: Five-factor model of personality
        Type: general
      – SubjectFull: Personality questionnaires
        Type: general
      – SubjectFull: Psychological tests
        Type: general
    Titles:
      – TitleFull: A Comprehensive Multivariate Generalizability Theory-Based Analysis of Responses to the IPIP-NEO-120.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Vispoel, Walter P.
      – PersonEntity:
          Name:
            NameFull: Hong, Hyeri
      – PersonEntity:
          Name:
            NameFull: Lee, Hyeryung
      – PersonEntity:
          Name:
            NameFull: Chen, Tingting
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul/Aug2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 00223891
          Numbering:
            – Type: volume
              Value: 108
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Journal of Personality Assessment
              Type: main
ResultId 1