A patient-derived benchmark for evaluating large language models in connective tissue diseases: blinded multi-stakeholder assessment and guideline comparison.

Saved in:
Bibliographic Details
Title: A patient-derived benchmark for evaluating large language models in connective tissue diseases: blinded multi-stakeholder assessment and guideline comparison.
Authors: Kremer P; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany., Knitza J; Institute for Digital Medicine, Philipps-Universität Marburg, University Hospital of Giessen and Marburg, Baldingerstrasse, Marburg, Germany., Reichard A; Rheumazentrum Lübeck, Lübeck, Germany., Holzer MT; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany., Xiong T; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany., Schnoor U; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany., Melderis S; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany., Kötter I; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.; Clinic for Rheumatology and Clinical Immunology, Auenlandklinik Bad Bramstedt, Bad Bramstedt, Germany., Haase I; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany., Krusche M; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. m.krusche@uke.de.
Source: Rheumatology international [Rheumatol Int] 2026 Jul 14; Vol. 46 (8). Date of Electronic Publication: 2026 Jul 14.
Publication Type: Journal Article; Observational Study; Comparative Study
Journal Info: Publisher: Springer International Country of Publication: Germany NLM ID: 8206885 Publication Model: Electronic Cited Medium: Internet ISSN: 1437-160X (Electronic) Linking ISSN: 01728172 NLM ISO Abbreviation: Rheumatol Int Subsets: MEDLINE
Database: MEDLINE Ultimate
FullText Text:
  Availability: 0
Header DbId: mdl
DbLabel: MEDLINE Ultimate
An: 42443611
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A patient-derived benchmark for evaluating large language models in connective tissue diseases: blinded multi-stakeholder assessment and guideline comparison.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Kremer+P%22">Kremer P</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.<br /><searchLink fieldCode="AU" term="%22Knitza+J%22">Knitza J</searchLink>; Institute for Digital Medicine, Philipps-Universität Marburg, University Hospital of Giessen and Marburg, Baldingerstrasse, Marburg, Germany.<br /><searchLink fieldCode="AU" term="%22Reichard+A%22">Reichard A</searchLink>; Rheumazentrum Lübeck, Lübeck, Germany.<br /><searchLink fieldCode="AU" term="%22Holzer+MT%22">Holzer MT</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.<br /><searchLink fieldCode="AU" term="%22Xiong+T%22">Xiong T</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.<br /><searchLink fieldCode="AU" term="%22Schnoor+U%22">Schnoor U</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.<br /><searchLink fieldCode="AU" term="%22Melderis+S%22">Melderis S</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.<br /><searchLink fieldCode="AU" term="%22Kötter+I%22">Kötter I</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.; Clinic for Rheumatology and Clinical Immunology, Auenlandklinik Bad Bramstedt, Bad Bramstedt, Germany.<br /><searchLink fieldCode="AU" term="%22Haase+I%22">Haase I</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.<br /><searchLink fieldCode="AU" term="%22Krusche+M%22">Krusche M</searchLink>; III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. m.krusche@uke.de.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%228206885%22">Rheumatology international</searchLink> [Rheumatol Int] 2026 Jul 14; Vol. 46 (8). <i>Date of Electronic Publication: </i>2026 Jul 14.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article; Observational Study; Comparative Study
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22Springer+International%22">Springer International </searchLink><i>Country of Publication: </i>Germany <i>NLM ID: </i>8206885 <i>Publication Model: </i>Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>1437-160X (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%2201728172%22">01728172 </searchLink><i>NLM ISO Abbreviation: </i>Rheumatol Int <i>Subsets: </i>MEDLINE
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=mdl&AN=42443611
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s00296-026-06178-1
    Languages:
      – Code: eng
        Text: English
    Titles:
      – TitleFull: A patient-derived benchmark for evaluating large language models in connective tissue diseases: blinded multi-stakeholder assessment and guideline comparison.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kremer P
      – PersonEntity:
          Name:
            NameFull: Knitza J
      – PersonEntity:
          Name:
            NameFull: Reichard A
      – PersonEntity:
          Name:
            NameFull: Holzer MT
      – PersonEntity:
          Name:
            NameFull: Xiong T
      – PersonEntity:
          Name:
            NameFull: Schnoor U
      – PersonEntity:
          Name:
            NameFull: Melderis S
      – PersonEntity:
          Name:
            NameFull: Kötter I
      – PersonEntity:
          Name:
            NameFull: Haase I
      – PersonEntity:
          Name:
            NameFull: Krusche M
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 14
              M: 07
              Text: 2026 Jul 14
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-electronic
              Value: 1437-160X
          Numbering:
            – Type: volume
              Value: 46
            – Type: issue
              Value: 8
          Titles:
            – TitleFull: Rheumatology international
              Type: main
ResultId 1