QuaRCS Light: Validation of an Abbreviated Assessment of Undergraduate Numeracy and Mathematics Affect
Saved in:
| Title: | QuaRCS Light: Validation of an Abbreviated Assessment of Undergraduate Numeracy and Mathematics Affect |
|---|---|
| Language: | English |
| Authors: | Isaac S. Rosenthal, Kate Follette, Vonna L. Hemmler, Catherine Sarosi, Sanlyn Buxner, Erin Galyen, Margaret Shea, Soon-Young Shimizu, Brendan Seto |
| Source: | Numeracy. 2026 19(1). |
| Availability: | National Numeracy Network. 906 West 2nd Avenue, Suite 100, Spokane, WA 99201. Tel: 507-222-5239; Web site: https://digitalcommons.usf.edu/numeracy/ |
| Peer Reviewed: | Y |
| Page Count: | 38 |
| Publication Date: | 2026 |
| Sponsoring Agency: | National Science Foundation (NSF), Division of Undergraduate Education (DUE) |
| Contract Number: | 2044372 |
| Document Type: | Journal Articles Reports - Research Tests/Questionnaires |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Undergraduate Students, Numeracy, Affective Measures, Test Validity, College Science, Mathematics Anxiety, Test Reliability, Scores, Test Length, Student Attitudes, Attitude Measures, Sense of Belonging, Metacognition, Cognitive Structures |
| ISSN: | 1936-4660 |
| Abstract: | In this study, we present evidence for the validity of a shortened form of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a validated instrument assessing the numeracy and math-related affect of undergraduate students in general education/introductory science courses. Previously published analyses of QuaRCS data revealed that 1) roughly 30% of students found the assessment boring, leading to lower self-reported effort and 2) affective factors (e.g. numerical self-efficacy) were significant predictors of QuaRCS score. As a result, we reduced the length of the assessment from 25 to 15 quantitative items, and expanded the affective variable selection from three to eight to include math related anxiety, situational math affect, sense of belonging, growth mindset and metacognition. We administered the abbreviated assessment ("QuaRCS light") to roughly 15,000 students across 18 institutions and validated it with classical test theory and item response theory based methods. We found, despite a modest decrease in reliability, students' effort scores were significantly higher on QuaRCS light, justifying this tradeoff. In addition, we validated the new affective factors using exploratory and confirmatory factor analysis. When included in a linear regression model as predictors of QuaRCS score, these 8 factors explain 31% of the observed score variance, increasing to 49% when student confidence, effort, and calculator usage are included. Our findings emphasize the importance of affective factors in understanding and fostering numeracy, and this work informs the design of more holistic and effective assessments that are appropriate for assessing numeracy in diverse student populations. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1495350 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1495350 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1495350 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: QuaRCS Light: Validation of an Abbreviated Assessment of Undergraduate Numeracy and Mathematics Affect – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Isaac+S%2E+Rosenthal%22">Isaac S. Rosenthal</searchLink><br /><searchLink fieldCode="AR" term="%22Kate+Follette%22">Kate Follette</searchLink><br /><searchLink fieldCode="AR" term="%22Vonna+L%2E+Hemmler%22">Vonna L. Hemmler</searchLink><br /><searchLink fieldCode="AR" term="%22Catherine+Sarosi%22">Catherine Sarosi</searchLink><br /><searchLink fieldCode="AR" term="%22Sanlyn+Buxner%22">Sanlyn Buxner</searchLink><br /><searchLink fieldCode="AR" term="%22Erin+Galyen%22">Erin Galyen</searchLink><br /><searchLink fieldCode="AR" term="%22Margaret+Shea%22">Margaret Shea</searchLink><br /><searchLink fieldCode="AR" term="%22Soon-Young+Shimizu%22">Soon-Young Shimizu</searchLink><br /><searchLink fieldCode="AR" term="%22Brendan+Seto%22">Brendan Seto</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Numeracy%22"><i>Numeracy</i></searchLink>. 2026 19(1). – Name: Avail Label: Availability Group: Avail Data: National Numeracy Network. 906 West 2nd Avenue, Suite 100, Spokane, WA 99201. Tel: 507-222-5239; Web site: https://digitalcommons.usf.edu/numeracy/ – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 38 – Name: DatePubCY Label: Publication Date Group: Date Data: 2026 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: National Science Foundation (NSF), Division of Undergraduate Education (DUE) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: 2044372 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research<br />Tests/Questionnaires – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Numeracy%22">Numeracy</searchLink><br /><searchLink fieldCode="DE" term="%22Affective+Measures%22">Affective Measures</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22College+Science%22">College Science</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Anxiety%22">Mathematics Anxiety</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Length%22">Test Length</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Attitude+Measures%22">Attitude Measures</searchLink><br /><searchLink fieldCode="DE" term="%22Sense+of+Belonging%22">Sense of Belonging</searchLink><br /><searchLink fieldCode="DE" term="%22Metacognition%22">Metacognition</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Structures%22">Cognitive Structures</searchLink> – Name: ISSN Label: ISSN Group: ISSN Data: 1936-4660 – Name: Abstract Label: Abstract Group: Ab Data: In this study, we present evidence for the validity of a shortened form of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a validated instrument assessing the numeracy and math-related affect of undergraduate students in general education/introductory science courses. Previously published analyses of QuaRCS data revealed that 1) roughly 30% of students found the assessment boring, leading to lower self-reported effort and 2) affective factors (e.g. numerical self-efficacy) were significant predictors of QuaRCS score. As a result, we reduced the length of the assessment from 25 to 15 quantitative items, and expanded the affective variable selection from three to eight to include math related anxiety, situational math affect, sense of belonging, growth mindset and metacognition. We administered the abbreviated assessment ("QuaRCS light") to roughly 15,000 students across 18 institutions and validated it with classical test theory and item response theory based methods. We found, despite a modest decrease in reliability, students' effort scores were significantly higher on QuaRCS light, justifying this tradeoff. In addition, we validated the new affective factors using exploratory and confirmatory factor analysis. When included in a linear regression model as predictors of QuaRCS score, these 8 factors explain 31% of the observed score variance, increasing to 49% when student confidence, effort, and calculator usage are included. Our findings emphasize the importance of affective factors in understanding and fostering numeracy, and this work informs the design of more holistic and effective assessments that are appropriate for assessing numeracy in diverse student populations. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: EJ1495350 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1495350 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 38 Subjects: – SubjectFull: Undergraduate Students Type: general – SubjectFull: Numeracy Type: general – SubjectFull: Affective Measures Type: general – SubjectFull: Test Validity Type: general – SubjectFull: College Science Type: general – SubjectFull: Mathematics Anxiety Type: general – SubjectFull: Test Reliability Type: general – SubjectFull: Scores Type: general – SubjectFull: Test Length Type: general – SubjectFull: Student Attitudes Type: general – SubjectFull: Attitude Measures Type: general – SubjectFull: Sense of Belonging Type: general – SubjectFull: Metacognition Type: general – SubjectFull: Cognitive Structures Type: general Titles: – TitleFull: QuaRCS Light: Validation of an Abbreviated Assessment of Undergraduate Numeracy and Mathematics Affect Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Isaac S. Rosenthal – PersonEntity: Name: NameFull: Kate Follette – PersonEntity: Name: NameFull: Vonna L. Hemmler – PersonEntity: Name: NameFull: Catherine Sarosi – PersonEntity: Name: NameFull: Sanlyn Buxner – PersonEntity: Name: NameFull: Erin Galyen – PersonEntity: Name: NameFull: Margaret Shea – PersonEntity: Name: NameFull: Soon-Young Shimizu – PersonEntity: Name: NameFull: Brendan Seto IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2026 Identifiers: – Type: issn-electronic Value: 1936-4660 Numbering: – Type: volume Value: 19 – Type: issue Value: 1 Titles: – TitleFull: Numeracy Type: main |
| ResultId | 1 |