View in EDS

RAG-Enhanced Open SLMs for Hypertension Management Chatbots.

Saved in:
Bibliographic Details
Title: RAG-Enhanced Open SLMs for Hypertension Management Chatbots.
Authors: Aguzzi, Gianluca1 (AUTHOR) gianluca.aguzzi@unibo.it, Magnini, Matteo1 (AUTHOR) matteo.magnini@unibo.it, Farahmand, Aqila2 (AUTHOR) aqila.farahmand@uniurb.it, Ferretti, Stefano1 (AUTHOR) s.ferretti@unibo.it, Pengo, Martino Francesco3,4 (AUTHOR) martino.pengo@unimib.it, Montagna, Sara2 (AUTHOR) sara.montagna@uniurb.it
Source: Journal of Medical Systems. 11/13/2025, Vol. 49 Issue 1, p1-15. 15p.
Subjects: Effect sizes (Statistics), Self-management (Psychology), Research funding, Hypertension, Natural language processing, Data analytics, Descriptive statistics, Chi-squared test, Chronic diseases, Experimental design, Information retrieval, Software architecture, Chatbots, Algorithms
Abstract: Chronic disease management requires continuous monitoring, lifestyle modification and therapy adherence, thus requiring constant support from healthcare professionals. Chatbots have proven to be a promising approach for engaging patients in managing their health condition at home and for offering continuous assistance by being readily available to answer questions. While large language models offer an impressive solution for chatbot implementation, third-party systems raise privacy concerns, and computational requirements limit small-scale deployment. We address these challenges by developing a chatbot for hypertensive patients based on open-source small language models (SLMs), specifically designed for running on personal resource-constrained devices and for providing assistance in QA tasks. In order to guarantee comparable conversational performances with respect to larger language models, we exploited retrieval-augmented generation (RAG) with a local knowledge base. This ensures data privacy by deploying models locally while achieving competitive accuracy and maintaining low computational costs suitable for end-user devices. We experimented with eight SLMs, two prompt configurations, and different RAG strategies – both in the embedding and retrieval components – to identify the most effective solution. The evaluation of our solution grounds on both reference metrics and expert evaluation. Our findings suggest that RAG-enhanced SLMs can improve response clarity and content accuracy. However, our results also indicate that newer SLMs like Qwen3 demonstrate strong performance even without RAG, suggesting a potential shift in the necessity for complex retrieval mechanisms with rapidly evolving model architectures. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Medical Systems is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Chronic disease management requires continuous monitoring, lifestyle modification and therapy adherence, thus requiring constant support from healthcare professionals. Chatbots have proven to be a promising approach for engaging patients in managing their health condition at home and for offering continuous assistance by being readily available to answer questions. While large language models offer an impressive solution for chatbot implementation, third-party systems raise privacy concerns, and computational requirements limit small-scale deployment. We address these challenges by developing a chatbot for hypertensive patients based on open-source small language models (SLMs), specifically designed for running on personal resource-constrained devices and for providing assistance in QA tasks. In order to guarantee comparable conversational performances with respect to larger language models, we exploited retrieval-augmented generation (RAG) with a local knowledge base. This ensures data privacy by deploying models locally while achieving competitive accuracy and maintaining low computational costs suitable for end-user devices. We experimented with eight SLMs, two prompt configurations, and different RAG strategies – both in the embedding and retrieval components – to identify the most effective solution. The evaluation of our solution grounds on both reference metrics and expert evaluation. Our findings suggest that RAG-enhanced SLMs can improve response clarity and content accuracy. However, our results also indicate that newer SLMs like Qwen3 demonstrate strong performance even without RAG, suggesting a potential shift in the necessity for complex retrieval mechanisms with rapidly evolving model architectures. [ABSTRACT FROM AUTHOR]
ISSN:01485598
DOI:10.1007/s10916-025-02297-7