From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis.

Saved in:
Bibliographic Details
Title: From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis.
Authors: Wen, Qifu (AUTHOR), Kochhar, Prishita (AUTHOR), Zeyada, Sherif (AUTHOR), Javaheri, Tahereh (AUTHOR), Rawassizadeh, Reza (AUTHOR)
Source: International Journal of Human-Computer Interaction. Jun2026, Vol. 42 Issue 11, p7832-7849. 18p.
Subjects: Statistics, Statistical accuracy, User experience, Data science, Graphical user interfaces, Task performance, Satisfaction, Chatbots
Abstract: The rapid evolution of data science forced individuals with different backgrounds to adapt to statistical analysis. We hypothesize that conversational agents are better suited for statistical analysis than traditional graphical user interfaces (GUI). In this work, we propose a novel conversational agent, StatZ, for statistical analysis. We evaluate StatZ relative to statistical software—SPSS, SAS, Stata, and JMP—in terms of accuracy, task completion time, user experience, and user satisfaction. We experimented with 51 participants from diverse backgrounds with proposed analysis question.Our design assessed each participant's ability to perform statistical tasks using GUI-based tools and our conversational agent. Results indicate that conversational agents significantly outperform GUI statistical software in all assessed metrics, including quantitative (task completion time, accuracy, and user experience), and qualitative (user satisfaction). Our findings underscore the potential of conversational agents to enhance statistical analysis, reducing cognitive load and learning curves enabling data analysis capabilities. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 194221775
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wen%2C+Qifu%22">Wen, Qifu</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kochhar%2C+Prishita%22">Kochhar, Prishita</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Zeyada%2C+Sherif%22">Zeyada, Sherif</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Javaheri%2C+Tahereh%22">Javaheri, Tahereh</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rawassizadeh%2C+Reza%22">Rawassizadeh, Reza</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Human-Computer+Interaction%22">International Journal of Human-Computer Interaction</searchLink>. Jun2026, Vol. 42 Issue 11, p7832-7849. 18p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+accuracy%22">Statistical accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22User+experience%22">User experience</searchLink><br /><searchLink fieldCode="DE" term="%22Data+science%22">Data science</searchLink><br /><searchLink fieldCode="DE" term="%22Graphical+user+interfaces%22">Graphical user interfaces</searchLink><br /><searchLink fieldCode="DE" term="%22Task+performance%22">Task performance</searchLink><br /><searchLink fieldCode="DE" term="%22Satisfaction%22">Satisfaction</searchLink><br /><searchLink fieldCode="DE" term="%22Chatbots%22">Chatbots</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The rapid evolution of data science forced individuals with different backgrounds to adapt to statistical analysis. We hypothesize that conversational agents are better suited for statistical analysis than traditional graphical user interfaces (GUI). In this work, we propose a novel conversational agent, StatZ, for statistical analysis. We evaluate StatZ relative to statistical software—SPSS, SAS, Stata, and JMP—in terms of accuracy, task completion time, user experience, and user satisfaction. We experimented with 51 participants from diverse backgrounds with proposed analysis question.Our design assessed each participant's ability to perform statistical tasks using GUI-based tools and our conversational agent. Results indicate that conversational agents significantly outperform GUI statistical software in all assessed metrics, including quantitative (task completion time, accuracy, and user experience), and qualitative (user satisfaction). Our findings underscore the potential of conversational agents to enhance statistical analysis, reducing cognitive load and learning curves enabling data analysis capabilities. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=194221775
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10447318.2025.2561760
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 7832
    Subjects:
      – SubjectFull: Statistics
        Type: general
      – SubjectFull: Statistical accuracy
        Type: general
      – SubjectFull: User experience
        Type: general
      – SubjectFull: Data science
        Type: general
      – SubjectFull: Graphical user interfaces
        Type: general
      – SubjectFull: Task performance
        Type: general
      – SubjectFull: Satisfaction
        Type: general
      – SubjectFull: Chatbots
        Type: general
    Titles:
      – TitleFull: From Clicks to Conversations: Evaluating the Effectiveness of Conversational Agents in Statistical Analysis.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Wen, Qifu
      – PersonEntity:
          Name:
            NameFull: Kochhar, Prishita
      – PersonEntity:
          Name:
            NameFull: Zeyada, Sherif
      – PersonEntity:
          Name:
            NameFull: Javaheri, Tahereh
      – PersonEntity:
          Name:
            NameFull: Rawassizadeh, Reza
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Text: Jun2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 10447318
          Numbering:
            – Type: volume
              Value: 42
            – Type: issue
              Value: 11
          Titles:
            – TitleFull: International Journal of Human-Computer Interaction
              Type: main
ResultId 1