Using acceptance tests to predict files changed by programming tasks.
Saved in:
| Title: | Using acceptance tests to predict files changed by programming tasks. |
|---|---|
| Authors: | Rocha, Thaís1 tabr@cin.ufpe.br, Borba, Paulo1 phmb@cin.ufpe.br, Santos, João Pedro1 jpms2@cin.ufpe.br |
| Source: | Journal of Systems & Software. Aug2019, Vol. 154, p176-195. 20p. |
| Subjects: | User interfaces, Computer interfaces software, Computer programming, Automatic test equipment, Task performance |
| Abstract: | • Definition of task interfaces based on automated acceptance tests. • A tool for computing test-based task interfaces. • Assessment of the predictive power of task interfaces. In a collaborative development context, conflicting code changes might compromise software quality and developers productivity. To reduce conflicts, one could avoid the parallel execution of potentially conflicting tasks. Although hopeful, this strategy is challenging because it relies on the prediction of the required file changes to complete a task. As predicting such file changes is hard, we investigate its feasibility for BDD (Behaviour-Driven Development) projects, which write automated acceptance tests before implementing features. We develop a tool that, for a given task, statically analyzes Cucumber tests and infers test-based interfaces (files that could be executed by the tests), approximating files that would be changed by the task. To assess the accuracy of this approximation, we measure precision and recall of test-based interfaces of 513 tasks from 18 Rails projects on GitHub. We also compare such interfaces with randomly defined interfaces, interfaces obtained by textual similarity of test specifications with past tasks, and interfaces computed by executing tests. Our results give evidence that, in the specific context of BDD, Cucumber tests might help to predict files changed by tasks. We find that the better the test coverage, the better the predictive power. A hybrid approach for computing test-based interfaces is promising. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Systems & Software is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
Be the first to leave a comment!
