A Comparative Study of Heuristic Evaluation and Cognitive Walkthrough: An E-Government Usability Assessment Case Study.
Saved in:
| Title: | A Comparative Study of Heuristic Evaluation and Cognitive Walkthrough: An E-Government Usability Assessment Case Study. |
|---|---|
| Authors: | Alshabib, Asra1,2 (AUTHOR) g202114090@kfupm.edu.sa, Alakkas, Noor1,2 (AUTHOR) g202114210@kfupm.edu.sa, Hassine, Jameleddine1,3 (AUTHOR) jhassine@kfupm.edu.sa |
| Source: | Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ). May2025, Vol. 50 Issue 10, p7801-7830. 30p. |
| Subjects: | Systems software, Mobile apps, Evaluation methodology, Test methods, Internet in public administration |
| Abstract: | Ensuring usability is essential in software systems, and various testing methods are employed for this purpose. Expert-based inspection methods, like Cognitive Walkthrough (CW) and Heuristic Evaluation (HE), are widely used to identify usability issues. However, these methods can be time-consuming, highlighting the need to assess their effectiveness in usability evaluation. The objective of this study is to conduct a comparative analysis of two expert-based usability evaluation methods, CW and HE, as applied to Absher's website and mobile application, the most widely used governmental system in Saudi Arabia. Five independent evaluators applied these methods, and an in-depth comparison was made on the identified usability issues, their severity, and the corresponding usability attributes. HE identified a total of 83 issues, while CW identified 58, with HE being more effective at detecting major usability problems and CW excelling in identifying catastrophic issues. In terms of usability attributes, HE identified more issues related to effectiveness, efficiency, and errors, while CW detected a higher number of learnability problems. Both methods performed similarly in identifying memorability issues. This study offers insights into the strengths and limitations of both CW and HE, contributing valuable guidance on selecting the appropriate usability evaluation method based on the system's context. [ABSTRACT FROM AUTHOR] |
| Copyright of Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ) is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Ensuring usability is essential in software systems, and various testing methods are employed for this purpose. Expert-based inspection methods, like Cognitive Walkthrough (CW) and Heuristic Evaluation (HE), are widely used to identify usability issues. However, these methods can be time-consuming, highlighting the need to assess their effectiveness in usability evaluation. The objective of this study is to conduct a comparative analysis of two expert-based usability evaluation methods, CW and HE, as applied to Absher's website and mobile application, the most widely used governmental system in Saudi Arabia. Five independent evaluators applied these methods, and an in-depth comparison was made on the identified usability issues, their severity, and the corresponding usability attributes. HE identified a total of 83 issues, while CW identified 58, with HE being more effective at detecting major usability problems and CW excelling in identifying catastrophic issues. In terms of usability attributes, HE identified more issues related to effectiveness, efficiency, and errors, while CW detected a higher number of learnability problems. Both methods performed similarly in identifying memorability issues. This study offers insights into the strengths and limitations of both CW and HE, contributing valuable guidance on selecting the appropriate usability evaluation method based on the system's context. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 2193567X |
| DOI: | 10.1007/s13369-025-09980-4 |
