View in EDS

Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-Judge.

Saved in:
Bibliographic Details
Title: Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-Judge.
Authors: Croxford E; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA., Gao Y; Department of Biomedical Informatics, University of Colorado - Anschutz Medical, Aurora, USA., First E; Epic Systems, Verona, USA., Pellegrino N; Epic Systems, Verona, USA., Schnier M; Epic Systems, Verona, USA., Caskey J; Department of Medicine, University of Wisconsin, Madison, USA., Oguss M; Department of Medicine, University of Wisconsin, Madison, USA., Wills G; UW Health, Madison, USA., Chen G; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA., Dligach D; Department of Medicine, University of Wisconsin, Madison, USA.; Department of Computer Science, Loyola University, Chicago, USA., Churpek MM; Department of Medicine, University of Wisconsin, Madison, USA.; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA.; UW Health, Madison, USA., Mayampurath A; Department of Medicine, University of Wisconsin, Madison, USA.; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA., Liao F; UW Health, Madison, USA.; BerbeeWalsh Department of Emergency Medicine, University of Wisconsin, Madison, USA., Goswami C; UW Health, Madison, USA., Wong KK; Epic Systems, Verona, USA.; UW Health, Madison, USA., Patterson BW; UW Health, Madison, USA.; BerbeeWalsh Department of Emergency Medicine, University of Wisconsin, Madison, USA., Afshar M; UW Health, Madison, USA.; Department of Medicine, University of Wisconsin, Madison, USA.
Source: MedRxiv : the preprint server for health sciences [medRxiv] 2025 May 06. Date of Electronic Publication: 2025 May 06.
Publication Type: Journal Article; Preprint
Journal Info: Country of Publication: United States NLM ID: 101767986 Publication Model: Electronic Cited Medium: Internet NLM ISO Abbreviation: medRxiv Subsets: PubMed not MEDLINE
Database: MEDLINE Ultimate
FullText Text:
  Availability: 0
Header DbId: mdl
DbLabel: MEDLINE Ultimate
An: 40313300
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-Judge.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Croxford+E%22">Croxford E</searchLink>; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Gao+Y%22">Gao Y</searchLink>; Department of Biomedical Informatics, University of Colorado - Anschutz Medical, Aurora, USA.<br /><searchLink fieldCode="AU" term="%22First+E%22">First E</searchLink>; Epic Systems, Verona, USA.<br /><searchLink fieldCode="AU" term="%22Pellegrino+N%22">Pellegrino N</searchLink>; Epic Systems, Verona, USA.<br /><searchLink fieldCode="AU" term="%22Schnier+M%22">Schnier M</searchLink>; Epic Systems, Verona, USA.<br /><searchLink fieldCode="AU" term="%22Caskey+J%22">Caskey J</searchLink>; Department of Medicine, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Oguss+M%22">Oguss M</searchLink>; Department of Medicine, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Wills+G%22">Wills G</searchLink>; UW Health, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Chen+G%22">Chen G</searchLink>; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Dligach+D%22">Dligach D</searchLink>; Department of Medicine, University of Wisconsin, Madison, USA.; Department of Computer Science, Loyola University, Chicago, USA.<br /><searchLink fieldCode="AU" term="%22Churpek+MM%22">Churpek MM</searchLink>; Department of Medicine, University of Wisconsin, Madison, USA.; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA.; UW Health, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Mayampurath+A%22">Mayampurath A</searchLink>; Department of Medicine, University of Wisconsin, Madison, USA.; Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Liao+F%22">Liao F</searchLink>; UW Health, Madison, USA.; BerbeeWalsh Department of Emergency Medicine, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Goswami+C%22">Goswami C</searchLink>; UW Health, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Wong+KK%22">Wong KK</searchLink>; Epic Systems, Verona, USA.; UW Health, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Patterson+BW%22">Patterson BW</searchLink>; UW Health, Madison, USA.; BerbeeWalsh Department of Emergency Medicine, University of Wisconsin, Madison, USA.<br /><searchLink fieldCode="AU" term="%22Afshar+M%22">Afshar M</searchLink>; UW Health, Madison, USA.; Department of Medicine, University of Wisconsin, Madison, USA.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22101767986%22">MedRxiv : the preprint server for health sciences</searchLink> [medRxiv] 2025 May 06. <i>Date of Electronic Publication: </i>2025 May 06.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article; Preprint
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Country of Publication: </i>United States <i>NLM ID: </i>101767986 <i>Publication Model: </i>Electronic <i>Cited Medium: </i>Internet <i>NLM ISO Abbreviation: </i>medRxiv <i>Subsets: </i>PubMed not MEDLINE
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=mdl&AN=40313300
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1101/2025.04.22.25326219
    Languages:
      – Code: eng
        Text: English
    Titles:
      – TitleFull: Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-Judge.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Croxford E
      – PersonEntity:
          Name:
            NameFull: Gao Y
      – PersonEntity:
          Name:
            NameFull: First E
      – PersonEntity:
          Name:
            NameFull: Pellegrino N
      – PersonEntity:
          Name:
            NameFull: Schnier M
      – PersonEntity:
          Name:
            NameFull: Caskey J
      – PersonEntity:
          Name:
            NameFull: Oguss M
      – PersonEntity:
          Name:
            NameFull: Wills G
      – PersonEntity:
          Name:
            NameFull: Chen G
      – PersonEntity:
          Name:
            NameFull: Dligach D
      – PersonEntity:
          Name:
            NameFull: Churpek MM
      – PersonEntity:
          Name:
            NameFull: Mayampurath A
      – PersonEntity:
          Name:
            NameFull: Liao F
      – PersonEntity:
          Name:
            NameFull: Goswami C
      – PersonEntity:
          Name:
            NameFull: Wong KK
      – PersonEntity:
          Name:
            NameFull: Patterson BW
      – PersonEntity:
          Name:
            NameFull: Afshar M
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 06
              M: 05
              Text: 2025 May 06
              Type: published
              Y: 2025
          Titles:
            – TitleFull: MedRxiv : the preprint server for health sciences
              Type: main
ResultId 1