View in EDS

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research: A novel question-and-answer benchmark designed to assess Large Language Models' comprehension of biomedical research, piloted on Neurodegenerative Diseases.

Saved in:
Bibliographic Details
Title: CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research: A novel question-and-answer benchmark designed to assess Large Language Models' comprehension of biomedical research, piloted on Neurodegenerative Diseases.
Authors: Bianchi O; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Willey M; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Alvarado CX; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Danek B; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Khani M; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Kuznetsov N; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Dadu A; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Shah S; DataTecnica, Washington, DC, 20812, USA., Koretsky MJ; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Makarious MB; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Weller C; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Levine KS; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Kim S; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Department of Computer Science, Johns Hopkins University, Baltimore, MD, 21218, USA., Jarreau P; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Vitale D; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Marsan E; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Iwaki H; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Leonard H; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Bandres-Ciga S; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Singleton AB; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Nalls MA; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Mokhtari S; DataTecnica, Washington, DC, 20812, USA., Khashabi D; DataTecnica, Washington, DC, 20812, USA.; Department of Computer Science, Johns Hopkins University, Baltimore, MD, 21218, USA., Faghri F; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.
Source: BioRxiv : the preprint server for biology [bioRxiv] 2025 Jan 21. Date of Electronic Publication: 2025 Jan 21.
Publication Type: Journal Article; Preprint
Journal Info: Country of Publication: United States NLM ID: 101680187 Publication Model: Electronic Cited Medium: Internet ISSN: 2692-8205 (Electronic) Linking ISSN: 26928205 NLM ISO Abbreviation: bioRxiv Subsets: PubMed not MEDLINE
Database: MEDLINE Ultimate
FullText Text:
  Availability: 0
Header DbId: mdl
DbLabel: MEDLINE Ultimate
An: 39868292
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research: A novel question-and-answer benchmark designed to assess Large Language Models' comprehension of biomedical research, piloted on Neurodegenerative Diseases.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Bianchi+O%22">Bianchi O</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Willey+M%22">Willey M</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Alvarado+CX%22">Alvarado CX</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Danek+B%22">Danek B</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Khani+M%22">Khani M</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.<br /><searchLink fieldCode="AU" term="%22Kuznetsov+N%22">Kuznetsov N</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Dadu+A%22">Dadu A</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Shah+S%22">Shah S</searchLink>; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Koretsky+MJ%22">Koretsky MJ</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Makarious+MB%22">Makarious MB</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Weller+C%22">Weller C</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Levine+KS%22">Levine KS</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Kim+S%22">Kim S</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Department of Computer Science, Johns Hopkins University, Baltimore, MD, 21218, USA.<br /><searchLink fieldCode="AU" term="%22Jarreau+P%22">Jarreau P</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.<br /><searchLink fieldCode="AU" term="%22Vitale+D%22">Vitale D</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Marsan+E%22">Marsan E</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.<br /><searchLink fieldCode="AU" term="%22Iwaki+H%22">Iwaki H</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Leonard+H%22">Leonard H</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Bandres-Ciga+S%22">Bandres-Ciga S</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.<br /><searchLink fieldCode="AU" term="%22Singleton+AB%22">Singleton AB</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.<br /><searchLink fieldCode="AU" term="%22Nalls+MA%22">Nalls MA</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.<br /><searchLink fieldCode="AU" term="%22Mokhtari+S%22">Mokhtari S</searchLink>; DataTecnica, Washington, DC, 20812, USA.<br /><searchLink fieldCode="AU" term="%22Khashabi+D%22">Khashabi D</searchLink>; DataTecnica, Washington, DC, 20812, USA.; Department of Computer Science, Johns Hopkins University, Baltimore, MD, 21218, USA.<br /><searchLink fieldCode="AU" term="%22Faghri+F%22">Faghri F</searchLink>; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22101680187%22">BioRxiv : the preprint server for biology</searchLink> [bioRxiv] 2025 Jan 21. <i>Date of Electronic Publication: </i>2025 Jan 21.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article; Preprint
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Country of Publication: </i>United States <i>NLM ID: </i>101680187 <i>Publication Model: </i>Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>2692-8205 (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%2226928205%22">26928205 </searchLink><i>NLM ISO Abbreviation: </i>bioRxiv <i>Subsets: </i>PubMed not MEDLINE
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=mdl&AN=39868292
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1101/2025.01.15.633272
    Languages:
      – Code: eng
        Text: English
    Titles:
      – TitleFull: CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research: A novel question-and-answer benchmark designed to assess Large Language Models' comprehension of biomedical research, piloted on Neurodegenerative Diseases.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Bianchi O
      – PersonEntity:
          Name:
            NameFull: Willey M
      – PersonEntity:
          Name:
            NameFull: Alvarado CX
      – PersonEntity:
          Name:
            NameFull: Danek B
      – PersonEntity:
          Name:
            NameFull: Khani M
      – PersonEntity:
          Name:
            NameFull: Kuznetsov N
      – PersonEntity:
          Name:
            NameFull: Dadu A
      – PersonEntity:
          Name:
            NameFull: Shah S
      – PersonEntity:
          Name:
            NameFull: Koretsky MJ
      – PersonEntity:
          Name:
            NameFull: Makarious MB
      – PersonEntity:
          Name:
            NameFull: Weller C
      – PersonEntity:
          Name:
            NameFull: Levine KS
      – PersonEntity:
          Name:
            NameFull: Kim S
      – PersonEntity:
          Name:
            NameFull: Jarreau P
      – PersonEntity:
          Name:
            NameFull: Vitale D
      – PersonEntity:
          Name:
            NameFull: Marsan E
      – PersonEntity:
          Name:
            NameFull: Iwaki H
      – PersonEntity:
          Name:
            NameFull: Leonard H
      – PersonEntity:
          Name:
            NameFull: Bandres-Ciga S
      – PersonEntity:
          Name:
            NameFull: Singleton AB
      – PersonEntity:
          Name:
            NameFull: Nalls MA
      – PersonEntity:
          Name:
            NameFull: Mokhtari S
      – PersonEntity:
          Name:
            NameFull: Khashabi D
      – PersonEntity:
          Name:
            NameFull: Faghri F
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 21
              M: 01
              Text: 2025 Jan 21
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2692-8205
          Titles:
            – TitleFull: BioRxiv : the preprint server for biology
              Type: main
ResultId 1