View in EDS

The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores

Saved in:
Bibliographic Details
Title: The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores
Language: English
Authors: Kroc, Edward (ORCID 0000-0001-6576-6144), Olvera Astivia, Oscar L.
Source: Educational and Psychological Measurement. Jun 2022 82(3):517-538.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 22
Publication Date: 2022
Document Type: Journal Articles
Reports - Evaluative
Descriptors: Multivariate Analysis, Cutting Scores, Classification, Measurement, Tests, Test Reliability, Scoring Formulas
DOI: 10.1177/00131644211023569
ISSN: 0013-1644
Abstract: Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test, what is not properly recognized is that such a test loses power to meaningfully discriminate between target groups with each new subscale that is introduced. We quantify and describe this property via an analytical exposition highlighting the counterintuitive geometry implied by marginal threshold-setting in multiple dimensions. Recommendations are presented that encourage applied researchers to think jointly, rather than marginally, when setting cutoff scores to ensure an informative test.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1336696
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1336696
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kroc%2C+Edward%22">Kroc, Edward</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6576-6144">0000-0001-6576-6144</externalLink>)<br /><searchLink fieldCode="AR" term="%22Olvera+Astivia%2C+Oscar+L%2E%22">Olvera Astivia, Oscar L.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Educational+and+Psychological+Measurement%22"><i>Educational and Psychological Measurement</i></searchLink>. Jun 2022 82(3):517-538.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 22
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Multivariate+Analysis%22">Multivariate Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Cutting+Scores%22">Cutting Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Classification%22">Classification</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement%22">Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Tests%22">Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring+Formulas%22">Scoring Formulas</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/00131644211023569
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0013-1644
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test, what is not properly recognized is that such a test loses power to meaningfully discriminate between target groups with each new subscale that is introduced. We quantify and describe this property via an analytical exposition highlighting the counterintuitive geometry implied by marginal threshold-setting in multiple dimensions. Recommendations are presented that encourage applied researchers to think jointly, rather than marginally, when setting cutoff scores to ensure an informative test.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1336696
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1336696
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/00131644211023569
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
        StartPage: 517
    Subjects:
      – SubjectFull: Multivariate Analysis
        Type: general
      – SubjectFull: Cutting Scores
        Type: general
      – SubjectFull: Classification
        Type: general
      – SubjectFull: Measurement
        Type: general
      – SubjectFull: Tests
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Scoring Formulas
        Type: general
    Titles:
      – TitleFull: The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kroc, Edward
      – PersonEntity:
          Name:
            NameFull: Olvera Astivia, Oscar L.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 0013-1644
          Numbering:
            – Type: volume
              Value: 82
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Educational and Psychological Measurement
              Type: main
ResultId 1