Principal Component Analysis on the Covariance Matrix for Data Reduction in Large-Scale Assessments

Saved in:
Bibliographic Details
Title: Principal Component Analysis on the Covariance Matrix for Data Reduction in Large-Scale Assessments
Language: English
Authors: Paul A. Jewsbury (ORCID 0000-0001-5571-4623), Matthew S. Johnson
Source: Large-scale Assessments in Education. 2025 13.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 40
Publication Date: 2025
Sponsoring Agency: National Center for Education Statistics (NCES) (ED/IES)
Contract Number: 91990019C0045
Document Type: Journal Articles
Reports - Research
Descriptors: Factor Analysis, Matrices, Regression (Statistics), Educational Assessment, Evaluation Methods, Statistical Distributions, Data Analysis, Correlation, Sample Size, Statistical Bias, Error Patterns, Statistical Inference, National Competency Tests
Assessment and Survey Identifiers: National Assessment of Educational Progress
DOI: 10.1186/s40536-025-00264-9
ISSN: 2196-0739
Abstract: The standard methodology for many large-scale assessments in education involves regressing latent variables on numerous contextual variables to estimate proficiency distributions. To reduce the number of contextual variables used in the regression and improve estimation, we propose and evaluate principal component analysis on the covariance matrix as a data reduction method for the contextual variables. This adjustment, compared to the conventional use of a correlation matrix, weights variables with respect to sample size. In a simulation study involving low test reliability for a subset of the sample, we found that PCA-covariance substantially reduces estimation bias and mean squared error. We demonstrate how a large-scale assessment can transition to using PCA-covariance without impacting primary trend inferences using data from the 2022 National Assessment of Educational Progress (NAEP). Our findings demonstrate that PCA-covariance accommodates a broader reporting scope with improved estimation.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2025
Accession Number: EJ1483248
Database: ERIC
Description
Abstract:The standard methodology for many large-scale assessments in education involves regressing latent variables on numerous contextual variables to estimate proficiency distributions. To reduce the number of contextual variables used in the regression and improve estimation, we propose and evaluate principal component analysis on the covariance matrix as a data reduction method for the contextual variables. This adjustment, compared to the conventional use of a correlation matrix, weights variables with respect to sample size. In a simulation study involving low test reliability for a subset of the sample, we found that PCA-covariance substantially reduces estimation bias and mean squared error. We demonstrate how a large-scale assessment can transition to using PCA-covariance without impacting primary trend inferences using data from the 2022 National Assessment of Educational Progress (NAEP). Our findings demonstrate that PCA-covariance accommodates a broader reporting scope with improved estimation.
ISSN:2196-0739
DOI:10.1186/s40536-025-00264-9