View in EDS HTML Full Text PDF Full Text

MutaBot: A Mutation Testing Approach for Chatbots.

Saved in:
Bibliographic Details
Title: MutaBot: A Mutation Testing Approach for Chatbots.
Authors: Urrico, Michael Ferdinando1 m.urrico@campus.unimib.it, Clerissi, Diego1 diego.clerissi@unimib.it, Mariani, Leonardo1 leonardo.mariani@unimib.it
Source: ICSE: International Conference on Software Engineering. 2024, p79-83. 5p.
Subjects: Chatbots, Mutation testing of computer software, Computer software developers, Software engineering, Programming languages
Abstract: Mutation testing is a technique aimed at assessing the effectiveness of test suites by seeding artificial faults into programs. Although available for many platforms and languages, no mutation testing tool is currently available for conversational chatbots, which represent an increasingly popular solution to design systems that can interact with users through a natural language interface. Note that since conversations must be explicitly engineered by the developers of conversational chatbots, these systems are exposed to specific types of faults not supported by existing mutation testing tools. In this paper, we present MutaBot, a mutation testing tool for conversational chatbots. MutaBot addresses mutations at multiple levels, including conversational flows, intents, and contexts. We designed the tool to potentially target multiple platforms, while we implemented initial support for Google Dialogflow chatbots. We assessed the tool with three Dialogflow chatbots and test cases generated with Botium, revealing weaknesses in the test suites. [ABSTRACT FROM AUTHOR]
Copyright of ICSE: International Conference on Software Engineering is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 185196569
AccessLevel: 6
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: MutaBot: A Mutation Testing Approach for Chatbots.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Urrico%2C+Michael+Ferdinando%22">Urrico, Michael Ferdinando</searchLink><relatesTo>1</relatesTo><i> m.urrico@campus.unimib.it</i><br /><searchLink fieldCode="AR" term="%22Clerissi%2C+Diego%22">Clerissi, Diego</searchLink><relatesTo>1</relatesTo><i> diego.clerissi@unimib.it</i><br /><searchLink fieldCode="AR" term="%22Mariani%2C+Leonardo%22">Mariani, Leonardo</searchLink><relatesTo>1</relatesTo><i> leonardo.mariani@unimib.it</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22ICSE%3A+International+Conference+on+Software+Engineering%22">ICSE: International Conference on Software Engineering</searchLink>. 2024, p79-83. 5p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Chatbots%22">Chatbots</searchLink><br /><searchLink fieldCode="DE" term="%22Mutation+testing+of+computer+software%22">Mutation testing of computer software</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+software+developers%22">Computer software developers</searchLink><br /><searchLink fieldCode="DE" term="%22Software+engineering%22">Software engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Programming+languages%22">Programming languages</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Mutation testing is a technique aimed at assessing the effectiveness of test suites by seeding artificial faults into programs. Although available for many platforms and languages, no mutation testing tool is currently available for conversational chatbots, which represent an increasingly popular solution to design systems that can interact with users through a natural language interface. Note that since conversations must be explicitly engineered by the developers of conversational chatbots, these systems are exposed to specific types of faults not supported by existing mutation testing tools. In this paper, we present MutaBot, a mutation testing tool for conversational chatbots. MutaBot addresses mutations at multiple levels, including conversational flows, intents, and contexts. We designed the tool to potentially target multiple platforms, while we implemented initial support for Google Dialogflow chatbots. We assessed the tool with three Dialogflow chatbots and test cases generated with Botium, revealing weaknesses in the test suites. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of ICSE: International Conference on Software Engineering is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=185196569
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1145/3639478.3640032
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 5
        StartPage: 79
    Subjects:
      – SubjectFull: Chatbots
        Type: general
      – SubjectFull: Mutation testing of computer software
        Type: general
      – SubjectFull: Computer software developers
        Type: general
      – SubjectFull: Software engineering
        Type: general
      – SubjectFull: Programming languages
        Type: general
    Titles:
      – TitleFull: MutaBot: A Mutation Testing Approach for Chatbots.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Urrico, Michael Ferdinando
      – PersonEntity:
          Name:
            NameFull: Clerissi, Diego
      – PersonEntity:
          Name:
            NameFull: Mariani, Leonardo
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: 2024
              Type: published
              Y: 2024
          Titles:
            – TitleFull: ICSE: International Conference on Software Engineering
              Type: main
ResultId 1