Same Same yet Different: Equivalence of the Multidimensional Assessment of Vocational Competence Across Test Formats.
Saved in:
| Title: | Same Same yet Different: Equivalence of the Multidimensional Assessment of Vocational Competence Across Test Formats. |
|---|---|
| Authors: | Ma, Beifang1 (AUTHOR) beifang.ma@uni-due.de, Krötz, Maximilian2 (AUTHOR), Deutscher, Viola3 (AUTHOR), Winther, Esther1 (AUTHOR) |
| Source: | International Journal of Training & Development. Dec2025, Vol. 29 Issue 4, p433-448. 16p. |
| Subject Terms: | *Test validity, *Item response theory, *Vocational education, *Cognitive load, Psychometrics |
| Abstract: | The rapid digital transformation of vocational education and training (VET) has underscored the need to adapt traditional assessment methods to digital formats. However, when transitioning to digital modes, it is crucial to consider factors beyond mere technical implementation, particularly the potential impact of altered presentation formats on the validity of assessment outcomes. This study explores these considerations in the context of computer‐based assessments, focusing on validating a digital format for evaluating vocational‐economic competence. A particular emphasis was placed on ensuring measurement invariance between digital and paper‐pencil formats, taking into account the effects of assessment layout, including cognitive load, the split‐attention effect, and environmental factors such as context dependence and the digital literacy of test‐takers. Furthermore, this study outlines a guideline‐compliant validation procedure for the digital version of a vocational‐economic competence assessment. To achieve this, we employed multi‐group confirmatory factor analysis (MGCFA) and a multidimensional item response theory (IRT) model to assess measurement invariance and estimate person abilities across the two formats. Validity evidence obtained includes both measurement invariance across subgroups and the assessment's dimensionality. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Training & Development is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 189133092 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Same Same yet Different: Equivalence of the Multidimensional Assessment of Vocational Competence Across Test Formats. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Ma%2C+Beifang%22">Ma, Beifang</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> beifang.ma@uni-due.de</i><br /><searchLink fieldCode="AR" term="%22Krötz%2C+Maximilian%22">Krötz, Maximilian</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Deutscher%2C+Viola%22">Deutscher, Viola</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Winther%2C+Esther%22">Winther, Esther</searchLink><relatesTo>1</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Training+%26+Development%22">International Journal of Training & Development</searchLink>. Dec2025, Vol. 29 Issue 4, p433-448. 16p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Test+validity%22">Test validity</searchLink><br />*<searchLink fieldCode="DE" term="%22Item+response+theory%22">Item response theory</searchLink><br />*<searchLink fieldCode="DE" term="%22Vocational+education%22">Vocational education</searchLink><br />*<searchLink fieldCode="DE" term="%22Cognitive+load%22">Cognitive load</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The rapid digital transformation of vocational education and training (VET) has underscored the need to adapt traditional assessment methods to digital formats. However, when transitioning to digital modes, it is crucial to consider factors beyond mere technical implementation, particularly the potential impact of altered presentation formats on the validity of assessment outcomes. This study explores these considerations in the context of computer‐based assessments, focusing on validating a digital format for evaluating vocational‐economic competence. A particular emphasis was placed on ensuring measurement invariance between digital and paper‐pencil formats, taking into account the effects of assessment layout, including cognitive load, the split‐attention effect, and environmental factors such as context dependence and the digital literacy of test‐takers. Furthermore, this study outlines a guideline‐compliant validation procedure for the digital version of a vocational‐economic competence assessment. To achieve this, we employed multi‐group confirmatory factor analysis (MGCFA) and a multidimensional item response theory (IRT) model to assess measurement invariance and estimate person abilities across the two formats. Validity evidence obtained includes both measurement invariance across subgroups and the assessment's dimensionality. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Training & Development is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=189133092 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/ijtd.12372 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 433 Subjects: – SubjectFull: Test validity Type: general – SubjectFull: Item response theory Type: general – SubjectFull: Vocational education Type: general – SubjectFull: Cognitive load Type: general – SubjectFull: Psychometrics Type: general Titles: – TitleFull: Same Same yet Different: Equivalence of the Multidimensional Assessment of Vocational Competence Across Test Formats. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Ma, Beifang – PersonEntity: Name: NameFull: Krötz, Maximilian – PersonEntity: Name: NameFull: Deutscher, Viola – PersonEntity: Name: NameFull: Winther, Esther IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 12 Text: Dec2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 13603736 Numbering: – Type: volume Value: 29 – Type: issue Value: 4 Titles: – TitleFull: International Journal of Training & Development Type: main |
| ResultId | 1 |
