View in EDS

Competency evaluation using randomized testing: feasibility of a new structured assessment method.

Saved in:
Bibliographic Details
Title: Competency evaluation using randomized testing: feasibility of a new structured assessment method.
Authors: Hashim, M. Jawad1 (AUTHOR) jhashim@uaeu.ac.ae, Kieu, Alexander1 (AUTHOR)
Source: Advances in Physiology Education. Sep2025, Vol. 49 Issue 3, p801-806. 6p.
Subject Terms: *Clinical competence, *Medical students, *Outcome-based education, *Educational outcomes, Statistical reliability
Abstract: Assessing the clinical competence of health care students is challenging as it involves direct observation of practical performance. We evaluated the effectiveness of a new format for assessing practical skills: competency evaluation using randomized testing (CERT). CERT is a structured assessment format that uses random variants within each station. CERT is designed to be authentic, learner centered, and competency oriented. We conducted a controlled trial of CERT among final-year medical students in a clinical clerkship. There were 33 medical students in the intervention (CERT) group and 33 in the control group. The CERT sessions included six stations, each using variations to protect the integrity of exam content. Each of the six stations had four variants, which were randomly assigned to students. Scores were adjusted based on the difficulty level of each variant. The primary outcome measure was performance on a standardized posttest. Learning scores were higher in the intervention group [mean National Board of Medical Examiners (NBME) adjusted scores: 72.9 vs. 61.1 in control group; P < 0.001]. Students who entered the session later did not have higher scores compared to those who finished earlier. Scores from the new format correlated with NBME marks. The new format was rated highly by medical students. CERT, a structured assessment using randomized variations in stations, is a feasible and potentially valid format for evaluating clinical competence. By using random variations, CERT protects the integrity of assessment, allows flexible scheduling, and facilitates assessment of a large number of candidates. NEW & NOTEWORTHY: Competency evaluation using randomized testing (CERT) is a new format for assessing practical skills. It uses random variations to protect the integrity of the examination content. This allows candidates to be scheduled individually without having to keep them in a waiting room. We evaluated the feasibility of CERT at a medical college and found that it led to improved learning outcomes and high satisfaction ratings. CERT facilitates the assessment of clinical competencies. [ABSTRACT FROM AUTHOR]
Copyright of Advances in Physiology Education is the property of American Physiological Society and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 187950954
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Competency evaluation using randomized testing: feasibility of a new structured assessment method.
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Hashim%2C+M%2E+Jawad%22&quot;&gt;Hashim, M. Jawad&lt;/searchLink&gt;&lt;relatesTo&gt;1&lt;/relatesTo&gt; (AUTHOR)&lt;i&gt; jhashim@uaeu.ac.ae&lt;/i&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Kieu%2C+Alexander%22&quot;&gt;Kieu, Alexander&lt;/searchLink&gt;&lt;relatesTo&gt;1&lt;/relatesTo&gt; (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;JN&quot; term=&quot;%22Advances+in+Physiology+Education%22&quot;&gt;Advances in Physiology Education&lt;/searchLink&gt;. Sep2025, Vol. 49 Issue 3, p801-806. 6p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Clinical+competence%22&quot;&gt;Clinical competence&lt;/searchLink&gt;&lt;br /&gt;*&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Medical+students%22&quot;&gt;Medical students&lt;/searchLink&gt;&lt;br /&gt;*&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Outcome-based+education%22&quot;&gt;Outcome-based education&lt;/searchLink&gt;&lt;br /&gt;*&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Educational+outcomes%22&quot;&gt;Educational outcomes&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Statistical+reliability%22&quot;&gt;Statistical reliability&lt;/searchLink&gt;
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Assessing the clinical competence of health care students is challenging as it involves direct observation of practical performance. We evaluated the effectiveness of a new format for assessing practical skills: competency evaluation using randomized testing (CERT). CERT is a structured assessment format that uses random variants within each station. CERT is designed to be authentic, learner centered, and competency oriented. We conducted a controlled trial of CERT among final-year medical students in a clinical clerkship. There were 33 medical students in the intervention (CERT) group and 33 in the control group. The CERT sessions included six stations, each using variations to protect the integrity of exam content. Each of the six stations had four variants, which were randomly assigned to students. Scores were adjusted based on the difficulty level of each variant. The primary outcome measure was performance on a standardized posttest. Learning scores were higher in the intervention group [mean National Board of Medical Examiners (NBME) adjusted scores: 72.9 vs. 61.1 in control group; P &lt; 0.001]. Students who entered the session later did not have higher scores compared to those who finished earlier. Scores from the new format correlated with NBME marks. The new format was rated highly by medical students. CERT, a structured assessment using randomized variations in stations, is a feasible and potentially valid format for evaluating clinical competence. By using random variations, CERT protects the integrity of assessment, allows flexible scheduling, and facilitates assessment of a large number of candidates. NEW &amp; NOTEWORTHY: Competency evaluation using randomized testing (CERT) is a new format for assessing practical skills. It uses random variations to protect the integrity of the examination content. This allows candidates to be scheduled individually without having to keep them in a waiting room. We evaluated the feasibility of CERT at a medical college and found that it led to improved learning outcomes and high satisfaction ratings. CERT facilitates the assessment of clinical competencies. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: &lt;i&gt;Copyright of Advances in Physiology Education is the property of American Physiological Society and its content may not be copied or emailed to multiple sites without the copyright holder&#39;s express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.&lt;/i&gt; (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=187950954
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1152/advan.00111.2025
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 6
        StartPage: 801
    Subjects:
      – SubjectFull: Clinical competence
        Type: general
      – SubjectFull: Medical students
        Type: general
      – SubjectFull: Outcome-based education
        Type: general
      – SubjectFull: Educational outcomes
        Type: general
      – SubjectFull: Statistical reliability
        Type: general
    Titles:
      – TitleFull: Competency evaluation using randomized testing: feasibility of a new structured assessment method.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hashim, M. Jawad
      – PersonEntity:
          Name:
            NameFull: Kieu, Alexander
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Text: Sep2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 10434046
          Numbering:
            – Type: volume
              Value: 49
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Advances in Physiology Education
              Type: main
ResultId 1