View in EDS HTML Full Text PDF Full Text

Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity.

Saved in:
Bibliographic Details
Title: Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity.
Authors: Maicher, Kellen R.1 Kellen.Maicher@osumc.edu, Stiff, Adam2, Scholl, Marisa3, White, Michael2, Fosler-Lussier, Eric2,4, Schuler, William4, Serai, Prashant1, Sunder, Vishal1, Forrestal, Hannah1, Mendella, Lexi1, Adib, Mahsa1, Bratton, Camille1, Lee, Kevin1, Danforth, Douglas R.3
Source: Medical Teacher. Mar2023, Vol. 45 Issue 3, p279-285. 7p.
Subject Terms: *Artificial intelligence, Natural language processing, Automatic speech recognition
Abstract: Advances in natural language understanding have facilitated the development of Virtual Standardized Patients (VSPs) that may soon rival human patients in conversational ability. We describe herein the development of an artificial intelligence (AI) system for VSPs enabling students to practice their history taking skills. Our system consists of (1) Automated Speech Recognition (ASR), (2) hybrid AI for question identification, (3) classifier to choose between the two systems, and (4) automated speech generation. We analyzed the accuracy of the ASR, the two AI systems, the classifier, and student feedback with 620 first year medical students from 2018 to 2021. System accuracy improved from ∼75% in 2018 to ∼90% in 2021 as refinements in algorithms and additional training data were utilized. Student feedback was positive, and most students felt that practicing with the VSPs was a worthwhile experience. We have developed a novel hybrid dialogue system that enables artificially intelligent VSPs to correctly answer student questions at levels comparable with human SPs. This system allows trainees to practice and refine their history-taking skills before interacting with human patients. [ABSTRACT FROM AUTHOR]
Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 162080760
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Maicher%2C+Kellen+R%2E%22">Maicher, Kellen R.</searchLink><relatesTo>1</relatesTo><i> Kellen.Maicher@osumc.edu</i><br /><searchLink fieldCode="AR" term="%22Stiff%2C+Adam%22">Stiff, Adam</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Scholl%2C+Marisa%22">Scholl, Marisa</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22White%2C+Michael%22">White, Michael</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Fosler-Lussier%2C+Eric%22">Fosler-Lussier, Eric</searchLink><relatesTo>2,4</relatesTo><br /><searchLink fieldCode="AR" term="%22Schuler%2C+William%22">Schuler, William</searchLink><relatesTo>4</relatesTo><br /><searchLink fieldCode="AR" term="%22Serai%2C+Prashant%22">Serai, Prashant</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Sunder%2C+Vishal%22">Sunder, Vishal</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Forrestal%2C+Hannah%22">Forrestal, Hannah</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Mendella%2C+Lexi%22">Mendella, Lexi</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Adib%2C+Mahsa%22">Adib, Mahsa</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Bratton%2C+Camille%22">Bratton, Camille</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Lee%2C+Kevin%22">Lee, Kevin</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Danforth%2C+Douglas+R%2E%22">Danforth, Douglas R.</searchLink><relatesTo>3</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Medical+Teacher%22">Medical Teacher</searchLink>. Mar2023, Vol. 45 Issue 3, p279-285. 7p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+language+processing%22">Natural language processing</searchLink><br /><searchLink fieldCode="DE" term="%22Automatic+speech+recognition%22">Automatic speech recognition</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Advances in natural language understanding have facilitated the development of Virtual Standardized Patients (VSPs) that may soon rival human patients in conversational ability. We describe herein the development of an artificial intelligence (AI) system for VSPs enabling students to practice their history taking skills. Our system consists of (1) Automated Speech Recognition (ASR), (2) hybrid AI for question identification, (3) classifier to choose between the two systems, and (4) automated speech generation. We analyzed the accuracy of the ASR, the two AI systems, the classifier, and student feedback with 620 first year medical students from 2018 to 2021. System accuracy improved from ∼75% in 2018 to ∼90% in 2021 as refinements in algorithms and additional training data were utilized. Student feedback was positive, and most students felt that practicing with the VSPs was a worthwhile experience. We have developed a novel hybrid dialogue system that enables artificially intelligent VSPs to correctly answer student questions at levels comparable with human SPs. This system allows trainees to practice and refine their history-taking skills before interacting with human patients. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=162080760
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/0142159X.2022.2130216
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
        StartPage: 279
    Subjects:
      – SubjectFull: Artificial intelligence
        Type: general
      – SubjectFull: Natural language processing
        Type: general
      – SubjectFull: Automatic speech recognition
        Type: general
    Titles:
      – TitleFull: Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Maicher, Kellen R.
      – PersonEntity:
          Name:
            NameFull: Stiff, Adam
      – PersonEntity:
          Name:
            NameFull: Scholl, Marisa
      – PersonEntity:
          Name:
            NameFull: White, Michael
      – PersonEntity:
          Name:
            NameFull: Fosler-Lussier, Eric
      – PersonEntity:
          Name:
            NameFull: Schuler, William
      – PersonEntity:
          Name:
            NameFull: Serai, Prashant
      – PersonEntity:
          Name:
            NameFull: Sunder, Vishal
      – PersonEntity:
          Name:
            NameFull: Forrestal, Hannah
      – PersonEntity:
          Name:
            NameFull: Mendella, Lexi
      – PersonEntity:
          Name:
            NameFull: Adib, Mahsa
      – PersonEntity:
          Name:
            NameFull: Bratton, Camille
      – PersonEntity:
          Name:
            NameFull: Lee, Kevin
      – PersonEntity:
          Name:
            NameFull: Danforth, Douglas R.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Text: Mar2023
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 0142159X
          Numbering:
            – Type: volume
              Value: 45
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Medical Teacher
              Type: main
ResultId 1