Development and Validation of Digital Assessment Literacy Self-Efficacy Scale

Saved in:
Bibliographic Details
Title: Development and Validation of Digital Assessment Literacy Self-Efficacy Scale
Language: English
Authors: Ruhan Karadag Yilmaz (ORCID 0000-0003-3254-8890), Ilhan Koyuncu (ORCID 0000-0002-0009-5279)
Source: International Journal of Assessment Tools in Education. 2025 12(3):806-824.
Availability: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
Peer Reviewed: Y
Page Count: 19
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Secondary Education
Elementary Secondary Education
Descriptors: Self Concept Measures, Self Efficacy, Assessment Literacy, Elementary School Teachers, Secondary School Teachers, Test Construction, Test Validity, Foreign Countries, Test Reliability, Factor Structure, Construct Validity
Geographic Terms: Turkey
ISSN: 2148-7456
Abstract: This study aimed to develop a scale to measure teachers' digital assessment literacy self-efficacy. Teachers were selected from all regions of Turkey and different branches at primary, secondary, and high school levels to enhance generalization and diversity. The data was collected from 314 teachers for the exploratory factor analysis and 296 for the confirmatory factor analysis. Various evidence was obtained regarding the validity and reliability of the Digital Assessment Literacy Self-Efficacy Scale (DALSS). The exploratory factor analysis results revealed that DALSS was found to have a 3-factor structure with 24 items. The dimensions were named as "Using appropriate tool and assessment type", "Feedback and developing appropriate tools for the objectives and levels," and "Preparing exams and evaluating the usability of the scores." Confirmatory factor analysis (CFA) results showed that the hypothetical structure of the scale fit the data. Second-order CFA also confirmed the 3-factor structure of digital assessment literacy self-efficacy. Convergent and divergent validity results proved evidence for construct validity. Analyses based on known-group validity revealed that the DALSS is a discriminative instrument. The internal consistency reliability values of DALSS and its factors were found to vary between 0.96 and 0.98. The findings for practice revealed that although DALSS scores did not differentiate according to gender, professional experience and teaching level, they significantly differed in terms of teaching fields.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1482869
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1482869
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1482869
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Development and Validation of Digital Assessment Literacy Self-Efficacy Scale
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ruhan+Karadag+Yilmaz%22">Ruhan Karadag Yilmaz</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3254-8890">0000-0003-3254-8890</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ilhan+Koyuncu%22">Ilhan Koyuncu</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-0009-5279">0000-0002-0009-5279</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Assessment+Tools+in+Education%22"><i>International Journal of Assessment Tools in Education</i></searchLink>. 2025 12(3):806-824.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 19
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Self+Concept+Measures%22">Self Concept Measures</searchLink><br /><searchLink fieldCode="DE" term="%22Self+Efficacy%22">Self Efficacy</searchLink><br /><searchLink fieldCode="DE" term="%22Assessment+Literacy%22">Assessment Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Teachers%22">Elementary School Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Teachers%22">Secondary School Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Factor+Structure%22">Factor Structure</searchLink><br /><searchLink fieldCode="DE" term="%22Construct+Validity%22">Construct Validity</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Turkey%22">Turkey</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2148-7456
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study aimed to develop a scale to measure teachers' digital assessment literacy self-efficacy. Teachers were selected from all regions of Turkey and different branches at primary, secondary, and high school levels to enhance generalization and diversity. The data was collected from 314 teachers for the exploratory factor analysis and 296 for the confirmatory factor analysis. Various evidence was obtained regarding the validity and reliability of the Digital Assessment Literacy Self-Efficacy Scale (DALSS). The exploratory factor analysis results revealed that DALSS was found to have a 3-factor structure with 24 items. The dimensions were named as "Using appropriate tool and assessment type", "Feedback and developing appropriate tools for the objectives and levels," and "Preparing exams and evaluating the usability of the scores." Confirmatory factor analysis (CFA) results showed that the hypothetical structure of the scale fit the data. Second-order CFA also confirmed the 3-factor structure of digital assessment literacy self-efficacy. Convergent and divergent validity results proved evidence for construct validity. Analyses based on known-group validity revealed that the DALSS is a discriminative instrument. The internal consistency reliability values of DALSS and its factors were found to vary between 0.96 and 0.98. The findings for practice revealed that although DALSS scores did not differentiate according to gender, professional experience and teaching level, they significantly differed in terms of teaching fields.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1482869
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1482869
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 806
    Subjects:
      – SubjectFull: Self Concept Measures
        Type: general
      – SubjectFull: Self Efficacy
        Type: general
      – SubjectFull: Assessment Literacy
        Type: general
      – SubjectFull: Elementary School Teachers
        Type: general
      – SubjectFull: Secondary School Teachers
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Factor Structure
        Type: general
      – SubjectFull: Construct Validity
        Type: general
      – SubjectFull: Turkey
        Type: general
    Titles:
      – TitleFull: Development and Validation of Digital Assessment Literacy Self-Efficacy Scale
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ruhan Karadag Yilmaz
      – PersonEntity:
          Name:
            NameFull: Ilhan Koyuncu
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2148-7456
          Numbering:
            – Type: volume
              Value: 12
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: International Journal of Assessment Tools in Education
              Type: main
ResultId 1