View in EDS HTML Full Text PDF Full Text

ChatGPT to generate clinical vignettes for teaching and multiple-choice questions for assessment: A randomized controlled experiment.

Saved in:
Bibliographic Details
Title: ChatGPT to generate clinical vignettes for teaching and multiple-choice questions for assessment: A randomized controlled experiment.
Authors: Coşkun, Özlem1 ocoskun@gazi.edu.tr, Kıyak, Yavuz Selim1, Budakoğlu, Işıl İrem1
Source: Medical Teacher. Feb2025, Vol. 47 Issue 2, p268-274. 7p.
Subject Terms: *Medical education, *Rating of students, *Teaching methods, *Medical students, *Case studies, *Automation, *Learning strategies, Statistical power analysis, Scale analysis (Psychology), Statistical sampling, Randomized controlled trials, Psychometrics, Chatbots
Geographic Terms: Türkiye
Abstract: Aim: This study aimed to evaluate the real-life performance of clinical vignettes and multiple-choice questions generated by using ChatGPT. Methods: This was a randomized controlled study in an evidence-based medicine training program. We randomly assigned seventy-four medical students to two groups. The ChatGPT group received ill-defined cases generated by ChatGPT, while the control group received human-written cases. At the end of the training, they evaluated the cases by rating 10 statements using a Likert scale. They also answered 15 multiple-choice questions (MCQs) generated by ChatGPT. The case evaluations of the two groups were compared. Some psychometric characteristics (item difficulty and point-biserial correlations) of the test were also reported. Results: None of the scores in 10 statements regarding the cases showed a significant difference between the ChatGPT group and the control group (p >.05). In the test, only six MCQs had acceptable levels (higher than 0.30) of point-biserial correlation, and five items could be considered acceptable in classroom settings. Conclusions: The results showed that the quality of the vignettes are comparable to those created by human authors, and some multiple-questions have acceptable psychometric characteristics. ChatGPT has potential in generating clinical vignettes for teaching and MCQs for assessment in medical education. [ABSTRACT FROM AUTHOR]
Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 182876605
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: ChatGPT to generate clinical vignettes for teaching and multiple-choice questions for assessment: A randomized controlled experiment.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Coşkun%2C+Özlem%22">Coşkun, Özlem</searchLink><relatesTo>1</relatesTo><i> ocoskun@gazi.edu.tr</i><br /><searchLink fieldCode="AR" term="%22Kıyak%2C+Yavuz+Selim%22">Kıyak, Yavuz Selim</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Budakoğlu%2C+Işıl+İrem%22">Budakoğlu, Işıl İrem</searchLink><relatesTo>1</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Medical+Teacher%22">Medical Teacher</searchLink>. Feb2025, Vol. 47 Issue 2, p268-274. 7p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Medical+education%22">Medical education</searchLink><br />*<searchLink fieldCode="DE" term="%22Rating+of+students%22">Rating of students</searchLink><br />*<searchLink fieldCode="DE" term="%22Teaching+methods%22">Teaching methods</searchLink><br />*<searchLink fieldCode="DE" term="%22Medical+students%22">Medical students</searchLink><br />*<searchLink fieldCode="DE" term="%22Case+studies%22">Case studies</searchLink><br />*<searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br />*<searchLink fieldCode="DE" term="%22Learning+strategies%22">Learning strategies</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+power+analysis%22">Statistical power analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Scale+analysis+%28Psychology%29%22">Scale analysis (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+sampling%22">Statistical sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Randomized+controlled+trials%22">Randomized controlled trials</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Chatbots%22">Chatbots</searchLink>
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Türkiye%22">Türkiye</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Aim: This study aimed to evaluate the real-life performance of clinical vignettes and multiple-choice questions generated by using ChatGPT. Methods: This was a randomized controlled study in an evidence-based medicine training program. We randomly assigned seventy-four medical students to two groups. The ChatGPT group received ill-defined cases generated by ChatGPT, while the control group received human-written cases. At the end of the training, they evaluated the cases by rating 10 statements using a Likert scale. They also answered 15 multiple-choice questions (MCQs) generated by ChatGPT. The case evaluations of the two groups were compared. Some psychometric characteristics (item difficulty and point-biserial correlations) of the test were also reported. Results: None of the scores in 10 statements regarding the cases showed a significant difference between the ChatGPT group and the control group (p >.05). In the test, only six MCQs had acceptable levels (higher than 0.30) of point-biserial correlation, and five items could be considered acceptable in classroom settings. Conclusions: The results showed that the quality of the vignettes are comparable to those created by human authors, and some multiple-questions have acceptable psychometric characteristics. ChatGPT has potential in generating clinical vignettes for teaching and MCQs for assessment in medical education. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=182876605
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/0142159X.2024.2327477
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
        StartPage: 268
    Subjects:
      – SubjectFull: Medical education
        Type: general
      – SubjectFull: Rating of students
        Type: general
      – SubjectFull: Teaching methods
        Type: general
      – SubjectFull: Medical students
        Type: general
      – SubjectFull: Case studies
        Type: general
      – SubjectFull: Automation
        Type: general
      – SubjectFull: Learning strategies
        Type: general
      – SubjectFull: Statistical power analysis
        Type: general
      – SubjectFull: Scale analysis (Psychology)
        Type: general
      – SubjectFull: Statistical sampling
        Type: general
      – SubjectFull: Randomized controlled trials
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Chatbots
        Type: general
      – SubjectFull: Türkiye
        Type: general
    Titles:
      – TitleFull: ChatGPT to generate clinical vignettes for teaching and multiple-choice questions for assessment: A randomized controlled experiment.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Coşkun, Özlem
      – PersonEntity:
          Name:
            NameFull: Kıyak, Yavuz Selim
      – PersonEntity:
          Name:
            NameFull: Budakoğlu, Işıl İrem
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 02
              Text: Feb2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 0142159X
          Numbering:
            – Type: volume
              Value: 47
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Medical Teacher
              Type: main
ResultId 1