View in EDS

Agreement, calibration, and failure of three large language models as high-stakes multimodal ospe graders: a comparative psychometric analysis.

Saved in:
Bibliographic Details
Title: Agreement, calibration, and failure of three large language models as high-stakes multimodal ospe graders: a comparative psychometric analysis.
Authors: Akhund SA; Department of Medical Education and Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Qazi S; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Mazhar MA; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Shaikh AA; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Atif E; College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Shaikh A; College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Shaibah H; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., Elsheikh Musa MA; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia., N Qazi S; Department of Life Sciences, College of Science and General Studies, Alfaisal University, Riyadh, Saudi Arabia., Khan MA; Department of Life Sciences, College of Science and General Studies, Alfaisal University, Riyadh, Saudi Arabia., Obeidat A; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.
Source: Medical education online [Med Educ Online] 2026 Dec 31; Vol. 31 (1), pp. 2684837. Date of Electronic Publication: 2026 Jul 08.
Publication Type: Journal Article; Comparative Study
Journal Info: Publisher: Taylor & Francis Country of Publication: United States NLM ID: 9806550 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1087-2981 (Electronic) Linking ISSN: 10872981 NLM ISO Abbreviation: Med Educ Online Subsets: MEDLINE
Database: MEDLINE Ultimate
FullText Text:
  Availability: 0
Header DbId: mdl
DbLabel: MEDLINE Ultimate
An: 42421433
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Agreement, calibration, and failure of three large language models as high-stakes multimodal ospe graders: a comparative psychometric analysis.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Akhund+SA%22">Akhund SA</searchLink>; Department of Medical Education and Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Qazi+S%22">Qazi S</searchLink>; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Mazhar+MA%22">Mazhar MA</searchLink>; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Shaikh+AA%22">Shaikh AA</searchLink>; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Atif+E%22">Atif E</searchLink>; College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Shaikh+A%22">Shaikh A</searchLink>; College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Shaibah+H%22">Shaibah H</searchLink>; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Elsheikh+Musa+MA%22">Elsheikh Musa MA</searchLink>; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22N+Qazi+S%22">N Qazi S</searchLink>; Department of Life Sciences, College of Science and General Studies, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Khan+MA%22">Khan MA</searchLink>; Department of Life Sciences, College of Science and General Studies, Alfaisal University, Riyadh, Saudi Arabia.<br /><searchLink fieldCode="AU" term="%22Obeidat+A%22">Obeidat A</searchLink>; Department of Anatomy, College of Medicine, Alfaisal University, Riyadh, Saudi Arabia.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%229806550%22">Medical education online</searchLink> [Med Educ Online] 2026 Dec 31; Vol. 31 (1), pp. 2684837. <i>Date of Electronic Publication: </i>2026 Jul 08.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article; Comparative Study
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22Taylor+%26+Francis%22">Taylor & Francis </searchLink><i>Country of Publication: </i>United States <i>NLM ID: </i>9806550 <i>Publication Model: </i>Print-Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>1087-2981 (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%2210872981%22">10872981 </searchLink><i>NLM ISO Abbreviation: </i>Med Educ Online <i>Subsets: </i>MEDLINE
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=mdl&AN=42421433
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10872981.2026.2684837
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        StartPage: 2684837
    Titles:
      – TitleFull: Agreement, calibration, and failure of three large language models as high-stakes multimodal ospe graders: a comparative psychometric analysis.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Akhund SA
      – PersonEntity:
          Name:
            NameFull: Qazi S
      – PersonEntity:
          Name:
            NameFull: Mazhar MA
      – PersonEntity:
          Name:
            NameFull: Shaikh AA
      – PersonEntity:
          Name:
            NameFull: Atif E
      – PersonEntity:
          Name:
            NameFull: Shaikh A
      – PersonEntity:
          Name:
            NameFull: Shaibah H
      – PersonEntity:
          Name:
            NameFull: Elsheikh Musa MA
      – PersonEntity:
          Name:
            NameFull: N Qazi S
      – PersonEntity:
          Name:
            NameFull: Khan MA
      – PersonEntity:
          Name:
            NameFull: Obeidat A
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 31
              M: 12
              Text: 2026 Dec 31
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-electronic
              Value: 1087-2981
          Numbering:
            – Type: volume
              Value: 31
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Medical education online
              Type: main
ResultId 1