From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis.
Saved in:
| Title: | From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis. |
|---|---|
| Authors: | Wen, Qifu (AUTHOR), Kochhar, Prishita (AUTHOR), Zeyada, Sherif (AUTHOR), Javaheri, Tahereh (AUTHOR), Rawassizadeh, Reza (AUTHOR) |
| Source: | International Journal of Human-Computer Interaction. Jun2026, Vol. 42 Issue 11, p7832-7849. 18p. |
| Subjects: | Statistics, Statistical accuracy, User experience, Data science, Graphical user interfaces, Task performance, Satisfaction, Chatbots |
| Abstract: | The rapid evolution of data science forced individuals with different backgrounds to adapt to statistical analysis. We hypothesize that conversational agents are better suited for statistical analysis than traditional graphical user interfaces (GUI). In this work, we propose a novel conversational agent, StatZ, for statistical analysis. We evaluate StatZ relative to statistical software—SPSS, SAS, Stata, and JMP—in terms of accuracy, task completion time, user experience, and user satisfaction. We experimented with 51 participants from diverse backgrounds with proposed analysis question.Our design assessed each participant's ability to perform statistical tasks using GUI-based tools and our conversational agent. Results indicate that conversational agents significantly outperform GUI statistical software in all assessed metrics, including quantitative (task completion time, accuracy, and user experience), and qualitative (user satisfaction). Our findings underscore the potential of conversational agents to enhance statistical analysis, reducing cognitive load and learning curves enabling data analysis capabilities. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: pbh DbLabel: Psychology and Behavioral Sciences Collection An: 194221775 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Wen%2C+Qifu%22">Wen, Qifu</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kochhar%2C+Prishita%22">Kochhar, Prishita</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Zeyada%2C+Sherif%22">Zeyada, Sherif</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Javaheri%2C+Tahereh%22">Javaheri, Tahereh</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rawassizadeh%2C+Reza%22">Rawassizadeh, Reza</searchLink> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Human-Computer+Interaction%22">International Journal of Human-Computer Interaction</searchLink>. Jun2026, Vol. 42 Issue 11, p7832-7849. 18p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+accuracy%22">Statistical accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22User+experience%22">User experience</searchLink><br /><searchLink fieldCode="DE" term="%22Data+science%22">Data science</searchLink><br /><searchLink fieldCode="DE" term="%22Graphical+user+interfaces%22">Graphical user interfaces</searchLink><br /><searchLink fieldCode="DE" term="%22Task+performance%22">Task performance</searchLink><br /><searchLink fieldCode="DE" term="%22Satisfaction%22">Satisfaction</searchLink><br /><searchLink fieldCode="DE" term="%22Chatbots%22">Chatbots</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The rapid evolution of data science forced individuals with different backgrounds to adapt to statistical analysis. We hypothesize that conversational agents are better suited for statistical analysis than traditional graphical user interfaces (GUI). In this work, we propose a novel conversational agent, StatZ, for statistical analysis. We evaluate StatZ relative to statistical software—SPSS, SAS, Stata, and JMP—in terms of accuracy, task completion time, user experience, and user satisfaction. We experimented with 51 participants from diverse backgrounds with proposed analysis question.Our design assessed each participant's ability to perform statistical tasks using GUI-based tools and our conversational agent. Results indicate that conversational agents significantly outperform GUI statistical software in all assessed metrics, including quantitative (task completion time, accuracy, and user experience), and qualitative (user satisfaction). Our findings underscore the potential of conversational agents to enhance statistical analysis, reducing cognitive load and learning curves enabling data analysis capabilities. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=194221775 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/10447318.2025.2561760 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 18 StartPage: 7832 Subjects: – SubjectFull: Statistics Type: general – SubjectFull: Statistical accuracy Type: general – SubjectFull: User experience Type: general – SubjectFull: Data science Type: general – SubjectFull: Graphical user interfaces Type: general – SubjectFull: Task performance Type: general – SubjectFull: Satisfaction Type: general – SubjectFull: Chatbots Type: general Titles: – TitleFull: From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Wen, Qifu – PersonEntity: Name: NameFull: Kochhar, Prishita – PersonEntity: Name: NameFull: Zeyada, Sherif – PersonEntity: Name: NameFull: Javaheri, Tahereh – PersonEntity: Name: NameFull: Rawassizadeh, Reza IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 10447318 Numbering: – Type: volume Value: 42 – Type: issue Value: 11 Titles: – TitleFull: International Journal of Human-Computer Interaction Type: main |
| ResultId | 1 |