The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores
Saved in:
| Title: | The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores |
|---|---|
| Language: | English |
| Authors: | Kroc, Edward (ORCID |
| Source: | Educational and Psychological Measurement. Jun 2022 82(3):517-538. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 22 |
| Publication Date: | 2022 |
| Document Type: | Journal Articles Reports - Evaluative |
| Descriptors: | Multivariate Analysis, Cutting Scores, Classification, Measurement, Tests, Test Reliability, Scoring Formulas |
| DOI: | 10.1177/00131644211023569 |
| ISSN: | 0013-1644 |
| Abstract: | Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test, what is not properly recognized is that such a test loses power to meaningfully discriminate between target groups with each new subscale that is introduced. We quantify and describe this property via an analytical exposition highlighting the counterintuitive geometry implied by marginal threshold-setting in multiple dimensions. Recommendations are presented that encourage applied researchers to think jointly, rather than marginally, when setting cutoff scores to ensure an informative test. |
| Abstractor: | As Provided |
| Entry Date: | 2022 |
| Accession Number: | EJ1336696 |
| Database: | ERIC |
| Abstract: | Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test, what is not properly recognized is that such a test loses power to meaningfully discriminate between target groups with each new subscale that is introduced. We quantify and describe this property via an analytical exposition highlighting the counterintuitive geometry implied by marginal threshold-setting in multiple dimensions. Recommendations are presented that encourage applied researchers to think jointly, rather than marginally, when setting cutoff scores to ensure an informative test. |
|---|---|
| ISSN: | 0013-1644 |
| DOI: | 10.1177/00131644211023569 |
