Development and Validation of Digital Assessment Literacy Self-Efficacy Scale

Saved in:
Bibliographic Details
Title: Development and Validation of Digital Assessment Literacy Self-Efficacy Scale
Language: English
Authors: Ruhan Karadag Yilmaz (ORCID 0000-0003-3254-8890), Ilhan Koyuncu (ORCID 0000-0002-0009-5279)
Source: International Journal of Assessment Tools in Education. 2025 12(3):806-824.
Availability: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
Peer Reviewed: Y
Page Count: 19
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Secondary Education
Elementary Secondary Education
Descriptors: Self Concept Measures, Self Efficacy, Assessment Literacy, Elementary School Teachers, Secondary School Teachers, Test Construction, Test Validity, Foreign Countries, Test Reliability, Factor Structure, Construct Validity
Geographic Terms: Turkey
ISSN: 2148-7456
Abstract: This study aimed to develop a scale to measure teachers' digital assessment literacy self-efficacy. Teachers were selected from all regions of Turkey and different branches at primary, secondary, and high school levels to enhance generalization and diversity. The data was collected from 314 teachers for the exploratory factor analysis and 296 for the confirmatory factor analysis. Various evidence was obtained regarding the validity and reliability of the Digital Assessment Literacy Self-Efficacy Scale (DALSS). The exploratory factor analysis results revealed that DALSS was found to have a 3-factor structure with 24 items. The dimensions were named as "Using appropriate tool and assessment type", "Feedback and developing appropriate tools for the objectives and levels," and "Preparing exams and evaluating the usability of the scores." Confirmatory factor analysis (CFA) results showed that the hypothetical structure of the scale fit the data. Second-order CFA also confirmed the 3-factor structure of digital assessment literacy self-efficacy. Convergent and divergent validity results proved evidence for construct validity. Analyses based on known-group validity revealed that the DALSS is a discriminative instrument. The internal consistency reliability values of DALSS and its factors were found to vary between 0.96 and 0.98. The findings for practice revealed that although DALSS scores did not differentiate according to gender, professional experience and teaching level, they significantly differed in terms of teaching fields.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1482869
Database: ERIC
Description
Abstract:This study aimed to develop a scale to measure teachers' digital assessment literacy self-efficacy. Teachers were selected from all regions of Turkey and different branches at primary, secondary, and high school levels to enhance generalization and diversity. The data was collected from 314 teachers for the exploratory factor analysis and 296 for the confirmatory factor analysis. Various evidence was obtained regarding the validity and reliability of the Digital Assessment Literacy Self-Efficacy Scale (DALSS). The exploratory factor analysis results revealed that DALSS was found to have a 3-factor structure with 24 items. The dimensions were named as "Using appropriate tool and assessment type", "Feedback and developing appropriate tools for the objectives and levels," and "Preparing exams and evaluating the usability of the scores." Confirmatory factor analysis (CFA) results showed that the hypothetical structure of the scale fit the data. Second-order CFA also confirmed the 3-factor structure of digital assessment literacy self-efficacy. Convergent and divergent validity results proved evidence for construct validity. Analyses based on known-group validity revealed that the DALSS is a discriminative instrument. The internal consistency reliability values of DALSS and its factors were found to vary between 0.96 and 0.98. The findings for practice revealed that although DALSS scores did not differentiate according to gender, professional experience and teaching level, they significantly differed in terms of teaching fields.
ISSN:2148-7456