View in EDS

Transforming Combat Casualty Care Training: Generative AI-Enabled Adaptive Learning in Forward Medical Settings

Saved in:
Bibliographic Details
Title: Transforming Combat Casualty Care Training: Generative AI-Enabled Adaptive Learning in Forward Medical Settings
Language: English
Authors: Alan D. Koenig, John J. Lee, Eric Savitsky, Gabriele Nataneli, Karson Lindstrom, David L. Schriger, Tyler Savitsky, National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
Source: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 2025.
Availability: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
Peer Reviewed: N
Page Count: 20
Publication Date: 2025
Document Type: Reports - Research
Descriptors: Artificial Intelligence, Computer Uses in Education, Medical Education, Multiple Choice Tests, Cost Effectiveness, Military Personnel, Electronic Learning, War, Conflict
Abstract: The urgent need to train military and civilian responders in combat casualty care during large-scale operations presents challenges due to the variability of learner preparedness and the resource demands of traditional curriculum development. This study examines the application of generative artificial intelligence (AI) in authoring and evaluating multiple-choice question-and-answer (QA) sets for medical training, with a specific focus on far-forward combat environments. Leveraging OpenAI's latest large language models (LLMs)--including GPT-4 (Open AI, 2023), GPT-4o (OpenAI, 2024a), o1, (OpenAI, 2024c) and o1-mini (OpenAI, 2024d)--the study compares AI-generated QA sets to those created by a seasoned human subject matter expert (SME), using National Board of Medical Examiners (NBME) guidelines as the benchmark. Results show that GPT-4o produced high-quality QA sets in 86.6% of cases, while interrater agreement between human and AI raters was strong (Krippendorff's [alpha] = 0.85; Gwet's AC2 = 0.96). The AI-generated QA sets were created with a 31-fold time savings and over 4,000-fold cost reduction relative to SME-authored items. Beyond performance metrics, the study introduces a replicable human-in-the-loop methodology for AI-assisted educational assessment design, striking a balance between scalability and pedagogical integrity. This framework provides a viable path for integrating LLMs into adaptive learning systems across various domains, while emphasizing the continued need for expert oversight to ensure contextual fidelity, instructional relevance, and quality assurance.
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED676628
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED676628
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED676628
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Transforming Combat Casualty Care Training: Generative AI-Enabled Adaptive Learning in Forward Medical Settings
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Alan+D%2E+Koenig%22">Alan D. Koenig</searchLink><br /><searchLink fieldCode="AR" term="%22John+J%2E+Lee%22">John J. Lee</searchLink><br /><searchLink fieldCode="AR" term="%22Eric+Savitsky%22">Eric Savitsky</searchLink><br /><searchLink fieldCode="AR" term="%22Gabriele+Nataneli%22">Gabriele Nataneli</searchLink><br /><searchLink fieldCode="AR" term="%22Karson+Lindstrom%22">Karson Lindstrom</searchLink><br /><searchLink fieldCode="AR" term="%22David+L%2E+Schriger%22">David L. Schriger</searchLink><br /><searchLink fieldCode="AR" term="%22Tyler+Savitsky%22">Tyler Savitsky</searchLink><br /><searchLink fieldCode="AR" term="%22National+Center+for+Research+on+Evaluation%2C+Standards%2C+and+Student+Testing+%28CRESST%29%22">National Center for Research on Evaluation, Standards, and Student Testing (CRESST)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22National+Center+for+Research+on+Evaluation%2C+Standards%2C+and+Student+Testing+%28CRESST%29%22"><i>National Center for Research on Evaluation, Standards, and Student Testing (CRESST)</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 20
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Uses+in+Education%22">Computer Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Medical+Education%22">Medical Education</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Choice+Tests%22">Multiple Choice Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Cost+Effectiveness%22">Cost Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Military+Personnel%22">Military Personnel</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+Learning%22">Electronic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22War%22">War</searchLink><br /><searchLink fieldCode="DE" term="%22Conflict%22">Conflict</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The urgent need to train military and civilian responders in combat casualty care during large-scale operations presents challenges due to the variability of learner preparedness and the resource demands of traditional curriculum development. This study examines the application of generative artificial intelligence (AI) in authoring and evaluating multiple-choice question-and-answer (QA) sets for medical training, with a specific focus on far-forward combat environments. Leveraging OpenAI's latest large language models (LLMs)--including GPT-4 (Open AI, 2023), GPT-4o (OpenAI, 2024a), o1, (OpenAI, 2024c) and o1-mini (OpenAI, 2024d)--the study compares AI-generated QA sets to those created by a seasoned human subject matter expert (SME), using National Board of Medical Examiners (NBME) guidelines as the benchmark. Results show that GPT-4o produced high-quality QA sets in 86.6% of cases, while interrater agreement between human and AI raters was strong (Krippendorff's [alpha] = 0.85; Gwet's AC2 = 0.96). The AI-generated QA sets were created with a 31-fold time savings and over 4,000-fold cost reduction relative to SME-authored items. Beyond performance metrics, the study introduces a replicable human-in-the-loop methodology for AI-assisted educational assessment design, striking a balance between scalability and pedagogical integrity. This framework provides a viable path for integrating LLMs into adaptive learning systems across various domains, while emphasizing the continued need for expert oversight to ensure contextual fidelity, instructional relevance, and quality assurance.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED676628
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED676628
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Computer Uses in Education
        Type: general
      – SubjectFull: Medical Education
        Type: general
      – SubjectFull: Multiple Choice Tests
        Type: general
      – SubjectFull: Cost Effectiveness
        Type: general
      – SubjectFull: Military Personnel
        Type: general
      – SubjectFull: Electronic Learning
        Type: general
      – SubjectFull: War
        Type: general
      – SubjectFull: Conflict
        Type: general
    Titles:
      – TitleFull: Transforming Combat Casualty Care Training: Generative AI-Enabled Adaptive Learning in Forward Medical Settings
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
      – PersonEntity:
          Name:
            NameFull: Alan D. Koenig
      – PersonEntity:
          Name:
            NameFull: John J. Lee
      – PersonEntity:
          Name:
            NameFull: Eric Savitsky
      – PersonEntity:
          Name:
            NameFull: Gabriele Nataneli
      – PersonEntity:
          Name:
            NameFull: Karson Lindstrom
      – PersonEntity:
          Name:
            NameFull: David L. Schriger
      – PersonEntity:
          Name:
            NameFull: Tyler Savitsky
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Type: published
              Y: 2025
          Titles:
            – TitleFull: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
              Type: main
ResultId 1