A Comparative Study of Heuristic Evaluation and Cognitive Walkthrough: An E-Government Usability Assessment Case Study.

Saved in:
Bibliographic Details
Title: A Comparative Study of Heuristic Evaluation and Cognitive Walkthrough: An E-Government Usability Assessment Case Study.
Authors: Alshabib, Asra1,2 (AUTHOR) g202114090@kfupm.edu.sa, Alakkas, Noor1,2 (AUTHOR) g202114210@kfupm.edu.sa, Hassine, Jameleddine1,3 (AUTHOR) jhassine@kfupm.edu.sa
Source: Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ). May2025, Vol. 50 Issue 10, p7801-7830. 30p.
Subjects: Systems software, Mobile apps, Evaluation methodology, Test methods, Internet in public administration
Abstract: Ensuring usability is essential in software systems, and various testing methods are employed for this purpose. Expert-based inspection methods, like Cognitive Walkthrough (CW) and Heuristic Evaluation (HE), are widely used to identify usability issues. However, these methods can be time-consuming, highlighting the need to assess their effectiveness in usability evaluation. The objective of this study is to conduct a comparative analysis of two expert-based usability evaluation methods, CW and HE, as applied to Absher's website and mobile application, the most widely used governmental system in Saudi Arabia. Five independent evaluators applied these methods, and an in-depth comparison was made on the identified usability issues, their severity, and the corresponding usability attributes. HE identified a total of 83 issues, while CW identified 58, with HE being more effective at detecting major usability problems and CW excelling in identifying catastrophic issues. In terms of usability attributes, HE identified more issues related to effectiveness, efficiency, and errors, while CW detected a higher number of learnability problems. Both methods performed similarly in identifying memorability issues. This study offers insights into the strengths and limitations of both CW and HE, contributing valuable guidance on selecting the appropriate usability evaluation method based on the system's context. [ABSTRACT FROM AUTHOR]
Copyright of Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ) is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 185240411
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Comparative Study of Heuristic Evaluation and Cognitive Walkthrough: An E-Government Usability Assessment Case Study.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Alshabib%2C+Asra%22">Alshabib, Asra</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> g202114090@kfupm.edu.sa</i><br /><searchLink fieldCode="AR" term="%22Alakkas%2C+Noor%22">Alakkas, Noor</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> g202114210@kfupm.edu.sa</i><br /><searchLink fieldCode="AR" term="%22Hassine%2C+Jameleddine%22">Hassine, Jameleddine</searchLink><relatesTo>1,3</relatesTo> (AUTHOR)<i> jhassine@kfupm.edu.sa</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Arabian+Journal+for+Science+%26+Engineering+%28Springer+Science+%26+Business+Media+B%2EV%2E+%29%22">Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. )</searchLink>. May2025, Vol. 50 Issue 10, p7801-7830. 30p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Systems+software%22">Systems software</searchLink><br /><searchLink fieldCode="DE" term="%22Mobile+apps%22">Mobile apps</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+methodology%22">Evaluation methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Test+methods%22">Test methods</searchLink><br /><searchLink fieldCode="DE" term="%22Internet+in+public+administration%22">Internet in public administration</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Ensuring usability is essential in software systems, and various testing methods are employed for this purpose. Expert-based inspection methods, like Cognitive Walkthrough (CW) and Heuristic Evaluation (HE), are widely used to identify usability issues. However, these methods can be time-consuming, highlighting the need to assess their effectiveness in usability evaluation. The objective of this study is to conduct a comparative analysis of two expert-based usability evaluation methods, CW and HE, as applied to Absher's website and mobile application, the most widely used governmental system in Saudi Arabia. Five independent evaluators applied these methods, and an in-depth comparison was made on the identified usability issues, their severity, and the corresponding usability attributes. HE identified a total of 83 issues, while CW identified 58, with HE being more effective at detecting major usability problems and CW excelling in identifying catastrophic issues. In terms of usability attributes, HE identified more issues related to effectiveness, efficiency, and errors, while CW detected a higher number of learnability problems. Both methods performed similarly in identifying memorability issues. This study offers insights into the strengths and limitations of both CW and HE, contributing valuable guidance on selecting the appropriate usability evaluation method based on the system's context. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ) is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=185240411
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s13369-025-09980-4
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 30
        StartPage: 7801
    Subjects:
      – SubjectFull: Systems software
        Type: general
      – SubjectFull: Mobile apps
        Type: general
      – SubjectFull: Evaluation methodology
        Type: general
      – SubjectFull: Test methods
        Type: general
      – SubjectFull: Internet in public administration
        Type: general
    Titles:
      – TitleFull: A Comparative Study of Heuristic Evaluation and Cognitive Walkthrough: An E-Government Usability Assessment Case Study.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Alshabib, Asra
      – PersonEntity:
          Name:
            NameFull: Alakkas, Noor
      – PersonEntity:
          Name:
            NameFull: Hassine, Jameleddine
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 15
              M: 05
              Text: May2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 2193567X
          Numbering:
            – Type: volume
              Value: 50
            – Type: issue
              Value: 10
          Titles:
            – TitleFull: Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. )
              Type: main
ResultId 1