Automated test generation using model checking: an industrial evaluation.
Saved in:
| Title: | Automated test generation using model checking: an industrial evaluation. |
|---|---|
| Authors: | Enoiu, Eduard1 eduard.paul.enoiu@mdh.se, Čaušević, Adnan1, Ostrand, Thomas2, Weyuker, Elaine1, Sundmark, Daniel, Pettersson, Paul1 |
| Source: | International Journal on Software Tools for Technology Transfer. Jun2016, Vol. 18 Issue 3, p335-353. 19p. |
| Subjects: | Automation, Test generators, Computer software development, Programmable controllers, Computer software testing |
| Abstract: | In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve different types of logic coverage, various program artifacts such as decisions and conditions are required to be exercised during testing. Use of model checking for structural test generation has been proposed by several researchers. The limited application to models used in practice and the state space explosion can, however, impact model checking and hence the process of deriving tests for logic coverage. Thus, there is a need to validate these approaches against relevant industrial systems such that more knowledge is built on how to efficiently use them in practice. In this paper, we present a tool-supported approach to handle software written in the Function Block Diagram language such that logic coverage criteria can be formalized and used by a model checker to automatically generate tests. To this end, we conducted a study based on industrial use-case scenarios from Bombardier Transportation AB, showing how our toolbox CompleteTest can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, we applied the toolbox to 157 programs and found that it is efficient in terms of time required to generate tests that satisfy logic coverage and scales well for most of the programs. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal on Software Tools for Technology Transfer is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 117357688 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Automated test generation using model checking: an industrial evaluation. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Enoiu%2C+Eduard%22">Enoiu, Eduard</searchLink><relatesTo>1</relatesTo><i> eduard.paul.enoiu@mdh.se</i><br /><searchLink fieldCode="AR" term="%22Čaušević%2C+Adnan%22">Čaušević, Adnan</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Ostrand%2C+Thomas%22">Ostrand, Thomas</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Weyuker%2C+Elaine%22">Weyuker, Elaine</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Sundmark%2C+Daniel%22">Sundmark, Daniel</searchLink><br /><searchLink fieldCode="AR" term="%22Pettersson%2C+Paul%22">Pettersson, Paul</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+on+Software+Tools+for+Technology+Transfer%22">International Journal on Software Tools for Technology Transfer</searchLink>. Jun2016, Vol. 18 Issue 3, p335-353. 19p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br /><searchLink fieldCode="DE" term="%22Test+generators%22">Test generators</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+software+development%22">Computer software development</searchLink><br /><searchLink fieldCode="DE" term="%22Programmable+controllers%22">Programmable controllers</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+software+testing%22">Computer software testing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve different types of logic coverage, various program artifacts such as decisions and conditions are required to be exercised during testing. Use of model checking for structural test generation has been proposed by several researchers. The limited application to models used in practice and the state space explosion can, however, impact model checking and hence the process of deriving tests for logic coverage. Thus, there is a need to validate these approaches against relevant industrial systems such that more knowledge is built on how to efficiently use them in practice. In this paper, we present a tool-supported approach to handle software written in the Function Block Diagram language such that logic coverage criteria can be formalized and used by a model checker to automatically generate tests. To this end, we conducted a study based on industrial use-case scenarios from Bombardier Transportation AB, showing how our toolbox CompleteTest can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, we applied the toolbox to 157 programs and found that it is efficient in terms of time required to generate tests that satisfy logic coverage and scales well for most of the programs. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal on Software Tools for Technology Transfer is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=117357688 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s10009-014-0355-9 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 19 StartPage: 335 Subjects: – SubjectFull: Automation Type: general – SubjectFull: Test generators Type: general – SubjectFull: Computer software development Type: general – SubjectFull: Programmable controllers Type: general – SubjectFull: Computer software testing Type: general Titles: – TitleFull: Automated test generation using model checking: an industrial evaluation. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Enoiu, Eduard – PersonEntity: Name: NameFull: Čaušević, Adnan – PersonEntity: Name: NameFull: Ostrand, Thomas – PersonEntity: Name: NameFull: Weyuker, Elaine – PersonEntity: Name: NameFull: Sundmark, Daniel – PersonEntity: Name: NameFull: Pettersson, Paul IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2016 Type: published Y: 2016 Identifiers: – Type: issn-print Value: 14332779 Numbering: – Type: volume Value: 18 – Type: issue Value: 3 Titles: – TitleFull: International Journal on Software Tools for Technology Transfer Type: main |
| ResultId | 1 |
