Meta[superscript 2]: A Meta-Analysis and Psychometric Evaluation of the Metacognitive Awareness Inventory (MAI) in the Context of Health Professions Education
Saved in:
| Title: | Meta[superscript 2]: A Meta-Analysis and Psychometric Evaluation of the Metacognitive Awareness Inventory (MAI) in the Context of Health Professions Education |
|---|---|
| Language: | English |
| Authors: | Andrew S. Cale (ORCID |
| Source: | Anatomical Sciences Education. 2025 18(8):786-801. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 16 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Information Analyses Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Meta Analysis, Psychometrics, Metacognition, Measures (Individuals), Allied Health Occupations Education, Medical Education, Medical Students, Test Validity, Test Reliability, Likert Scales, Test Content, Item Response Theory, Test Format |
| DOI: | 10.1002/ase.70085 |
| ISSN: | 1935-9772 1935-9780 |
| Abstract: | To keep pace with medicine's unpredictable changes, medical trainees must learn to accurately monitor and evaluate themselves via metacognition (i.e., thinking about thinking). The Metacognitive Awareness Inventory (MAI) can assess and guide the metacognitive development of trainees. This study summarizes existing psychometric evidence and meta-analyzes the internal consistency of the MAI across studies involving health professions education. In 2023, a literature search was performed across six databases for records that met predefined inclusion criteria. After two rounds of screening, MAI validity and reliability data were extracted from the eligible studies for analysis. Validity evidence for the dichotomous, five-point Likert, and sliding analog versions of the MAI were rated and analyzed according to "test content," "response processes," "internal structure," "relations to other variables," and "consequences of testing." The internal consistency range (min-max) of the MAI was estimated using random-effects, restricted maximum likelihood (REML) meta-analysis. Among the 1966 records screened, 23 studies met the inclusion criteria. The five-point Likert version of the MAI was the most supported, with validity evidence in the "test content," "internal structure," and "relations to other variables" categories. None of the MAI versions presented evidence related to "response processes" or "consequences of testing." The lowest aggregated internal consistency was estimated to be 0.805 and the highest as 0.844, suggesting very good reliability. The five-point Likert scale version of the MAI is most supported for use in health professions education, though validation efforts should continue to address all five sources of validity. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1479215 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1479215 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Meta[superscript 2]: A Meta-Analysis and Psychometric Evaluation of the Metacognitive Awareness Inventory (MAI) in the Context of Health Professions Education – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Andrew+S%2E+Cale%22">Andrew S. Cale</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7158-3977">0000-0001-7158-3977</externalLink>)<br /><searchLink fieldCode="AR" term="%22Elizabeth+R%2E+Agosto%22">Elizabeth R. Agosto</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5355-8401">0000-0001-5355-8401</externalLink>)<br /><searchLink fieldCode="AR" term="%22Brenda+Kucha+Anak+Ganeng%22">Brenda Kucha Anak Ganeng</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2765-3944">0000-0003-2765-3944</externalLink>)<br /><searchLink fieldCode="AR" term="%22Megan+E%2E+Kruskie%22">Megan E. Kruskie</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0002-9150-5532">0009-0002-9150-5532</externalLink>)<br /><searchLink fieldCode="AR" term="%22Margaret+A%2E+McNulty%22">Margaret A. McNulty</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6638-253X">0000-0001-6638-253X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Kyle+A%2E+Robertson%22">Kyle A. Robertson</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5236-5106">0000-0001-5236-5106</externalLink>)<br /><searchLink fieldCode="AR" term="%22Cecelia+J%2E+Vetter%22">Cecelia J. Vetter</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7477-1911">0000-0002-7477-1911</externalLink>)<br /><searchLink fieldCode="AR" term="%22Sabrina+C%2E+Woods%22">Sabrina C. Woods</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0008-8174-8796">0009-0008-8174-8796</externalLink>)<br /><searchLink fieldCode="AR" term="%22Md%2E+Nazmul+Karim%22">Md. Nazmul Karim</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2604-9649">0000-0003-2604-9649</externalLink>)<br /><searchLink fieldCode="AR" term="%22Adam+B%2E+Wilson%22">Adam B. Wilson</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-1221-5602">0000-0002-1221-5602</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Anatomical+Sciences+Education%22"><i>Anatomical Sciences Education</i></searchLink>. 2025 18(8):786-801. – Name: Avail Label: Availability Group: Avail Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 16 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Information Analyses<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Meta+Analysis%22">Meta Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Metacognition%22">Metacognition</searchLink><br /><searchLink fieldCode="DE" term="%22Measures+%28Individuals%29%22">Measures (Individuals)</searchLink><br /><searchLink fieldCode="DE" term="%22Allied+Health+Occupations+Education%22">Allied Health Occupations Education</searchLink><br /><searchLink fieldCode="DE" term="%22Medical+Education%22">Medical Education</searchLink><br /><searchLink fieldCode="DE" term="%22Medical+Students%22">Medical Students</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Likert+Scales%22">Likert Scales</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Content%22">Test Content</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1002/ase.70085 – Name: ISSN Label: ISSN Group: ISSN Data: 1935-9772<br />1935-9780 – Name: Abstract Label: Abstract Group: Ab Data: To keep pace with medicine's unpredictable changes, medical trainees must learn to accurately monitor and evaluate themselves via metacognition (i.e., thinking about thinking). The Metacognitive Awareness Inventory (MAI) can assess and guide the metacognitive development of trainees. This study summarizes existing psychometric evidence and meta-analyzes the internal consistency of the MAI across studies involving health professions education. In 2023, a literature search was performed across six databases for records that met predefined inclusion criteria. After two rounds of screening, MAI validity and reliability data were extracted from the eligible studies for analysis. Validity evidence for the dichotomous, five-point Likert, and sliding analog versions of the MAI were rated and analyzed according to "test content," "response processes," "internal structure," "relations to other variables," and "consequences of testing." The internal consistency range (min-max) of the MAI was estimated using random-effects, restricted maximum likelihood (REML) meta-analysis. Among the 1966 records screened, 23 studies met the inclusion criteria. The five-point Likert version of the MAI was the most supported, with validity evidence in the "test content," "internal structure," and "relations to other variables" categories. None of the MAI versions presented evidence related to "response processes" or "consequences of testing." The lowest aggregated internal consistency was estimated to be 0.805 and the highest as 0.844, suggesting very good reliability. The five-point Likert scale version of the MAI is most supported for use in health professions education, though validation efforts should continue to address all five sources of validity. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: EJ1479215 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1479215 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/ase.70085 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 786 Subjects: – SubjectFull: Meta Analysis Type: general – SubjectFull: Psychometrics Type: general – SubjectFull: Metacognition Type: general – SubjectFull: Measures (Individuals) Type: general – SubjectFull: Allied Health Occupations Education Type: general – SubjectFull: Medical Education Type: general – SubjectFull: Medical Students Type: general – SubjectFull: Test Validity Type: general – SubjectFull: Test Reliability Type: general – SubjectFull: Likert Scales Type: general – SubjectFull: Test Content Type: general – SubjectFull: Item Response Theory Type: general – SubjectFull: Test Format Type: general Titles: – TitleFull: Meta[superscript 2]: A Meta-Analysis and Psychometric Evaluation of the Metacognitive Awareness Inventory (MAI) in the Context of Health Professions Education Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Andrew S. Cale – PersonEntity: Name: NameFull: Elizabeth R. Agosto – PersonEntity: Name: NameFull: Brenda Kucha Anak Ganeng – PersonEntity: Name: NameFull: Megan E. Kruskie – PersonEntity: Name: NameFull: Margaret A. McNulty – PersonEntity: Name: NameFull: Kyle A. Robertson – PersonEntity: Name: NameFull: Cecelia J. Vetter – PersonEntity: Name: NameFull: Sabrina C. Woods – PersonEntity: Name: NameFull: Md. Nazmul Karim – PersonEntity: Name: NameFull: Adam B. Wilson IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 08 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 1935-9772 – Type: issn-electronic Value: 1935-9780 Numbering: – Type: volume Value: 18 – Type: issue Value: 8 Titles: – TitleFull: Anatomical Sciences Education Type: main |
| ResultId | 1 |
