A Comprehensive Psychometric Validation of Student Online Readiness.
Saved in:
| Title: | A Comprehensive Psychometric Validation of Student Online Readiness. |
|---|---|
| Authors: | Kellam, Hugh1 hugh.kellam@uta.edu, Liu, Jin1 jin.liu@uta.edu, Gilmore, Tranell1 tranell.gilmore@uta.edu |
| Source: | Electronic Journal of e-Learning. 2026, Vol. 24 Issue 4, p106-118. 13p. |
| Subject Terms: | *Learning readiness, *Preparedness, *Higher education, *Educational support, *Online education, Psychometrics, Fairness |
| Abstract: | As online and hybrid education continue to expand, institutions require valid and equitable tools to identify students who may need additional support before beginning online coursework. Although numerous online readiness assessments have been developed, relatively few have undergone comprehensive psychometric validation, and most have not established measurement invariance across demographic groups, limiting confidence in subgroup comparisons and the use of readiness assessments for equity-informed decision-making. The purpose of this study was to provide a comprehensive psychometric validation of the Online Readiness and Student Success Assessment (ORSSA), a five-factor instrument designed to measure Learning Organization, Learning Preferences, Learning Skills, Technical Readiness Access, and Technical Readiness Skills among incoming online university students. Data were collected from 2,669 undergraduate students enrolled in online degree and certificate programs at a large public R1 university in the southern United States. Confirmatory factor analysis (CFA) using weighted least squares mean and variance adjusted (WLSMV) estimation was conducted to evaluate the proposed factor structure. Additional analyses examined model-based reliability (McDonald's omega), convergent and discriminant validity, measurement invariance across gender, ethnicity, and first-generation status, and Multiple Indicators Multiple Causes (MIMIC) modeling to investigate relationships between demographic characteristics and online readiness factors. Results supported the proposed five-factor model, which demonstrated superior fit relative to alternative models, strong standardized factor loadings, excellent model-based reliability, and satisfactory evidence of convergent and discriminant validity. Measurement invariance analyses demonstrated that the ORSSA functions equivalently across gender, ethnicity, and first-generation status, supporting meaningful and fair comparisons among demographic groups. MIMIC analyses further identified significant demographic differences across several readiness dimensions, particularly in Learning Organization, Learning Skills, and Technical Readiness, while also revealing higher online learning preferences among some historically underrepresented student groups. These findings establish the ORSSA as a psychometrically robust and equitable measure of online readiness that extends beyond traditional readiness assessments by integrating comprehensive validation procedures with demographic fairness testing. The instrument provides higher education institutions with actionable information that can be used during student onboarding to identify readiness strengths and potential barriers, enabling targeted interventions, personalized student support, and data-informed strategies to improve retention and success in online learning environments. [ABSTRACT FROM AUTHOR] |
| Copyright of Electronic Journal of e-Learning is the property of Academic Conferences & Publishing International Ltd. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 196822500 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: A Comprehensive Psychometric Validation of Student Online Readiness. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Kellam%2C+Hugh%22">Kellam, Hugh</searchLink><relatesTo>1</relatesTo><i> hugh.kellam@uta.edu</i><br /><searchLink fieldCode="AR" term="%22Liu%2C+Jin%22">Liu, Jin</searchLink><relatesTo>1</relatesTo><i> jin.liu@uta.edu</i><br /><searchLink fieldCode="AR" term="%22Gilmore%2C+Tranell%22">Gilmore, Tranell</searchLink><relatesTo>1</relatesTo><i> tranell.gilmore@uta.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Electronic+Journal+of+e-Learning%22">Electronic Journal of e-Learning</searchLink>. 2026, Vol. 24 Issue 4, p106-118. 13p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Learning+readiness%22">Learning readiness</searchLink><br />*<searchLink fieldCode="DE" term="%22Preparedness%22">Preparedness</searchLink><br />*<searchLink fieldCode="DE" term="%22Higher+education%22">Higher education</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+support%22">Educational support</searchLink><br />*<searchLink fieldCode="DE" term="%22Online+education%22">Online education</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Fairness%22">Fairness</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: As online and hybrid education continue to expand, institutions require valid and equitable tools to identify students who may need additional support before beginning online coursework. Although numerous online readiness assessments have been developed, relatively few have undergone comprehensive psychometric validation, and most have not established measurement invariance across demographic groups, limiting confidence in subgroup comparisons and the use of readiness assessments for equity-informed decision-making. The purpose of this study was to provide a comprehensive psychometric validation of the Online Readiness and Student Success Assessment (ORSSA), a five-factor instrument designed to measure Learning Organization, Learning Preferences, Learning Skills, Technical Readiness Access, and Technical Readiness Skills among incoming online university students. Data were collected from 2,669 undergraduate students enrolled in online degree and certificate programs at a large public R1 university in the southern United States. Confirmatory factor analysis (CFA) using weighted least squares mean and variance adjusted (WLSMV) estimation was conducted to evaluate the proposed factor structure. Additional analyses examined model-based reliability (McDonald's omega), convergent and discriminant validity, measurement invariance across gender, ethnicity, and first-generation status, and Multiple Indicators Multiple Causes (MIMIC) modeling to investigate relationships between demographic characteristics and online readiness factors. Results supported the proposed five-factor model, which demonstrated superior fit relative to alternative models, strong standardized factor loadings, excellent model-based reliability, and satisfactory evidence of convergent and discriminant validity. Measurement invariance analyses demonstrated that the ORSSA functions equivalently across gender, ethnicity, and first-generation status, supporting meaningful and fair comparisons among demographic groups. MIMIC analyses further identified significant demographic differences across several readiness dimensions, particularly in Learning Organization, Learning Skills, and Technical Readiness, while also revealing higher online learning preferences among some historically underrepresented student groups. These findings establish the ORSSA as a psychometrically robust and equitable measure of online readiness that extends beyond traditional readiness assessments by integrating comprehensive validation procedures with demographic fairness testing. The instrument provides higher education institutions with actionable information that can be used during student onboarding to identify readiness strengths and potential barriers, enabling targeted interventions, personalized student support, and data-informed strategies to improve retention and success in online learning environments. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Electronic Journal of e-Learning is the property of Academic Conferences & Publishing International Ltd. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=196822500 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.34190/ejel.24.4.4768 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 13 StartPage: 106 Subjects: – SubjectFull: Learning readiness Type: general – SubjectFull: Preparedness Type: general – SubjectFull: Higher education Type: general – SubjectFull: Educational support Type: general – SubjectFull: Online education Type: general – SubjectFull: Psychometrics Type: general – SubjectFull: Fairness Type: general Titles: – TitleFull: A Comprehensive Psychometric Validation of Student Online Readiness. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Kellam, Hugh – PersonEntity: Name: NameFull: Liu, Jin – PersonEntity: Name: NameFull: Gilmore, Tranell IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 10 Text: 2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 14794403 Numbering: – Type: volume Value: 24 – Type: issue Value: 4 Titles: – TitleFull: Electronic Journal of e-Learning Type: main |
| ResultId | 1 |