Design and Validation of the AI‐Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale) for Secondary School Students in Jordan: Insights From the Network Analysis Perspective.

Saved in:
Bibliographic Details
Title: Design and Validation of the AI‐Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale) for Secondary School Students in Jordan: Insights From the Network Analysis Perspective.
Authors: Ayasrah, Mohammad Nayef, Khasawneh, Mohamad Ahmad Saleem, Almulla, Mazen Omar, Aboutaleb, Amoura Hassan
Source: Journal of Computer Assisted Learning. Oct2025, Vol. 41 Issue 5, p1-23. 23p.
Subjects: Psychological resilience, Scale analysis (Psychology), Emotion regulation, Cognitive testing, Cronbach's alpha, Data analysis, Research funding, High school students, Artificial intelligence, Research methodology evaluation, Interviewing, Research evaluation, Learning, Chi-squared test, Descriptive statistics, Self-control, Problem solving, Experimental design, Research methodology, Psychometrics, Cluster sampling, Intraclass correlation, Statistical reliability, Statistics, Factor analysis, Calibration, Reliability (Personality trait), Discriminant analysis, Adolescence
Geographic Terms: Jordan
Abstract: Background: One area that has been dramatically changed by artificial intelligence (AI) is educational environments. Chatbots, Recommender Systems, Adaptive Learning Systems and Large Language Models have been emerging as practical tools for facilitating learning. However, using such tools appropriately is challenging. In this regard, the construct of metacognitive learning resilience has been receiving growing attention, especially in the face of uncertainties and adversities associated with AI‐supported learning. Objectives: The current research aimed to develop and evaluate the psychometric properties of the AI‐Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale). This scale was developed to assess students' ability to cognitively and emotionally manage learning challenges in AI‐enhanced learning settings. Methods: This study, which had a mixed‐method research design, was performed in Jordan in 2025. A pool of items, developed based on a systematic review of theoretical literature and semi‐structured interviews, was used. Then, content validation and the pilot phase were used to modify items. Exploratory factor analysis (EFA), confirmatory factor analysis (CFA), exploratory graph analysis (EGA) and Random Forest Modelling (RFM) were used to assess construct validity of this scale. In addition, Cronbach's alpha (α) and McDonald's omega (ω) were used to assess reliability. Finally, the intraclass correlation coefficient (ICC) was performed in addition to evaluating test–retest reliability. Results and Conclusions: EFA results revealed six factors: Self‐Awareness and Metacognitive Regulation in AI‐Mediated Learning; Cognitive Adaptability in Dynamic AI‐Based Learning Contexts; Emotional Stability During AI‐Integrated Learning Challenges; Strategic Perseverance in AI‐Supported Problem‐Solving; Motivational Resilience Amid AI‐Driven Learning Difficulties; and Reflective Recalibration of Learning through AI Feedback. These six factors collectively explained 66.21% of the total variance. CFA fit indices (CFI = 0.917, RMSEA = 0.079) and reliability indicators, including Cronbach's alpha (0.897–0.948), McDonald's omega (0.892–0.950) and Composite Reliability (CR: 0.888–0.954), were all within acceptable ranges. Moreover, convergent and discriminant validity were confirmed using the Average Variance Extracted (AVE). The measurement invariance test across gender indicated that the scale maintains stable measurement properties for both males and females. Findings suggest that the AIIMLR Scale is a valid and reliable tool for assessing metacognitive learning resilience in AI‐enhanced educational settings. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Computer Assisted Learning is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 188234224
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Design and Validation of the AI‐Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale) for Secondary School Students in Jordan: Insights From the Network Analysis Perspective.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ayasrah%2C+Mohammad+Nayef%22">Ayasrah, Mohammad Nayef</searchLink><br /><searchLink fieldCode="AR" term="%22Khasawneh%2C+Mohamad+Ahmad+Saleem%22">Khasawneh, Mohamad Ahmad Saleem</searchLink><br /><searchLink fieldCode="AR" term="%22Almulla%2C+Mazen+Omar%22">Almulla, Mazen Omar</searchLink><br /><searchLink fieldCode="AR" term="%22Aboutaleb%2C+Amoura+Hassan%22">Aboutaleb, Amoura Hassan</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Computer+Assisted+Learning%22">Journal of Computer Assisted Learning</searchLink>. Oct2025, Vol. 41 Issue 5, p1-23. 23p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Psychological+resilience%22">Psychological resilience</searchLink><br /><searchLink fieldCode="DE" term="%22Scale+analysis+%28Psychology%29%22">Scale analysis (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Emotion+regulation%22">Emotion regulation</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+testing%22">Cognitive testing</searchLink><br /><searchLink fieldCode="DE" term="%22Cronbach's+alpha%22">Cronbach's alpha</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis%22">Data analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Research+funding%22">Research funding</searchLink><br /><searchLink fieldCode="DE" term="%22High+school+students%22">High school students</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Research+methodology+evaluation%22">Research methodology evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Interviewing%22">Interviewing</searchLink><br /><searchLink fieldCode="DE" term="%22Research+evaluation%22">Research evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Learning%22">Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Chi-squared+test%22">Chi-squared test</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Self-control%22">Self-control</searchLink><br /><searchLink fieldCode="DE" term="%22Problem+solving%22">Problem solving</searchLink><br /><searchLink fieldCode="DE" term="%22Experimental+design%22">Experimental design</searchLink><br /><searchLink fieldCode="DE" term="%22Research+methodology%22">Research methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Cluster+sampling%22">Cluster sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Intraclass+correlation%22">Intraclass correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+reliability%22">Statistical reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Factor+analysis%22">Factor analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Calibration%22">Calibration</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability+%28Personality+trait%29%22">Reliability (Personality trait)</searchLink><br /><searchLink fieldCode="DE" term="%22Discriminant+analysis%22">Discriminant analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Adolescence%22">Adolescence</searchLink>
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Jordan%22">Jordan</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Background: One area that has been dramatically changed by artificial intelligence (AI) is educational environments. Chatbots, Recommender Systems, Adaptive Learning Systems and Large Language Models have been emerging as practical tools for facilitating learning. However, using such tools appropriately is challenging. In this regard, the construct of metacognitive learning resilience has been receiving growing attention, especially in the face of uncertainties and adversities associated with AI‐supported learning. Objectives: The current research aimed to develop and evaluate the psychometric properties of the AI‐Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale). This scale was developed to assess students' ability to cognitively and emotionally manage learning challenges in AI‐enhanced learning settings. Methods: This study, which had a mixed‐method research design, was performed in Jordan in 2025. A pool of items, developed based on a systematic review of theoretical literature and semi‐structured interviews, was used. Then, content validation and the pilot phase were used to modify items. Exploratory factor analysis (EFA), confirmatory factor analysis (CFA), exploratory graph analysis (EGA) and Random Forest Modelling (RFM) were used to assess construct validity of this scale. In addition, Cronbach's alpha (α) and McDonald's omega (ω) were used to assess reliability. Finally, the intraclass correlation coefficient (ICC) was performed in addition to evaluating test–retest reliability. Results and Conclusions: EFA results revealed six factors: Self‐Awareness and Metacognitive Regulation in AI‐Mediated Learning; Cognitive Adaptability in Dynamic AI‐Based Learning Contexts; Emotional Stability During AI‐Integrated Learning Challenges; Strategic Perseverance in AI‐Supported Problem‐Solving; Motivational Resilience Amid AI‐Driven Learning Difficulties; and Reflective Recalibration of Learning through AI Feedback. These six factors collectively explained 66.21% of the total variance. CFA fit indices (CFI = 0.917, RMSEA = 0.079) and reliability indicators, including Cronbach's alpha (0.897–0.948), McDonald's omega (0.892–0.950) and Composite Reliability (CR: 0.888–0.954), were all within acceptable ranges. Moreover, convergent and discriminant validity were confirmed using the Average Variance Extracted (AVE). The measurement invariance test across gender indicated that the scale maintains stable measurement properties for both males and females. Findings suggest that the AIIMLR Scale is a valid and reliable tool for assessing metacognitive learning resilience in AI‐enhanced educational settings. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Computer Assisted Learning is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=188234224
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/jcal.70127
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
        StartPage: 1
    Subjects:
      – SubjectFull: Psychological resilience
        Type: general
      – SubjectFull: Scale analysis (Psychology)
        Type: general
      – SubjectFull: Emotion regulation
        Type: general
      – SubjectFull: Cognitive testing
        Type: general
      – SubjectFull: Cronbach's alpha
        Type: general
      – SubjectFull: Data analysis
        Type: general
      – SubjectFull: Research funding
        Type: general
      – SubjectFull: High school students
        Type: general
      – SubjectFull: Artificial intelligence
        Type: general
      – SubjectFull: Research methodology evaluation
        Type: general
      – SubjectFull: Interviewing
        Type: general
      – SubjectFull: Research evaluation
        Type: general
      – SubjectFull: Learning
        Type: general
      – SubjectFull: Chi-squared test
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Self-control
        Type: general
      – SubjectFull: Problem solving
        Type: general
      – SubjectFull: Experimental design
        Type: general
      – SubjectFull: Research methodology
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Cluster sampling
        Type: general
      – SubjectFull: Intraclass correlation
        Type: general
      – SubjectFull: Statistical reliability
        Type: general
      – SubjectFull: Statistics
        Type: general
      – SubjectFull: Factor analysis
        Type: general
      – SubjectFull: Calibration
        Type: general
      – SubjectFull: Reliability (Personality trait)
        Type: general
      – SubjectFull: Discriminant analysis
        Type: general
      – SubjectFull: Adolescence
        Type: general
      – SubjectFull: Jordan
        Type: general
    Titles:
      – TitleFull: Design and Validation of the AI‐Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale) for Secondary School Students in Jordan: Insights From the Network Analysis Perspective.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ayasrah, Mohammad Nayef
      – PersonEntity:
          Name:
            NameFull: Khasawneh, Mohamad Ahmad Saleem
      – PersonEntity:
          Name:
            NameFull: Almulla, Mazen Omar
      – PersonEntity:
          Name:
            NameFull: Aboutaleb, Amoura Hassan
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 10
              Text: Oct2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 02664909
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Journal of Computer Assisted Learning
              Type: main
ResultId 1