CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research: A novel question-and-answer benchmark designed to assess Large Language Models' comprehension of biomedical research, piloted on Neurodegenerative Diseases.

Saved in:
Bibliographic Details
Title: CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research: A novel question-and-answer benchmark designed to assess Large Language Models' comprehension of biomedical research, piloted on Neurodegenerative Diseases.
Authors: Bianchi O; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Willey M; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Alvarado CX; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Danek B; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Khani M; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Kuznetsov N; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Dadu A; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Shah S; DataTecnica, Washington, DC, 20812, USA., Koretsky MJ; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Makarious MB; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Weller C; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Levine KS; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Kim S; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Department of Computer Science, Johns Hopkins University, Baltimore, MD, 21218, USA., Jarreau P; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Vitale D; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Marsan E; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Iwaki H; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Leonard H; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA., Bandres-Ciga S; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Singleton AB; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Nalls MA; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA., Mokhtari S; DataTecnica, Washington, DC, 20812, USA., Khashabi D; DataTecnica, Washington, DC, 20812, USA.; Department of Computer Science, Johns Hopkins University, Baltimore, MD, 21218, USA., Faghri F; Center for Alzheimer's and Related Dementias, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.; DataTecnica, Washington, DC, 20812, USA.; Laboratory of Neurogenetics, National Institute on Aging, National Institutes of Health, Bethesda, MD, 20892, USA.
Source: BioRxiv : the preprint server for biology [bioRxiv] 2025 Jan 21. Date of Electronic Publication: 2025 Jan 21.
Publication Type: Journal Article; Preprint
Journal Info: Country of Publication: United States NLM ID: 101680187 Publication Model: Electronic Cited Medium: Internet ISSN: 2692-8205 (Electronic) Linking ISSN: 26928205 NLM ISO Abbreviation: bioRxiv Subsets: PubMed not MEDLINE
Database: MEDLINE Ultimate
Be the first to leave a comment!
You must be logged in first