Perceived usability evaluation of learning management systems via axiomatic design with a real life application.

Saved in:
Bibliographic Details
Title: Perceived usability evaluation of learning management systems via axiomatic design with a real life application.
Authors: Baykasoglu, Adil1 (AUTHOR) adil.baykasoglu@deu.edu.tr, Felekoglu, Burcu1 (AUTHOR) burcu.felekoglu@deu.edu.tr, Ünal, Ceylin1 (AUTHOR) ceylin.unal@ogr.deu.edu.tr
Source: Kybernetes. 2024, Vol. 53 Issue 1, p83-101. 19p.
Subjects: Axiomatic design, Learning management system, Multiple criteria decision making, Mathematical logic, Academic departments
Abstract: Purpose: Usage of learning management systems (LMSs) has become widespread with the disruption of face-to-face educations after the COVID-19 pandemic. There are several software products, usually named as LMS to enable and support distance education. However, selection of a suitable LMS is a complex multiple criteria decision making (MCDM) problem that requires consideration of many criteria and inputs from different parties like students, academicians, education managers, etc. Usability evaluation of LMS is one of the critical steps in deciding which LMS system to be adapted. There are several studies related to usability evaluation of LMS in the literature, but utilization of MCDM methods and real life case studies are very rare. Based on this motivation, perceived usability evaluation of SAKAI-LMS that is in use at an academic department is performed by employing axiomatic design procedure (ADP). This paper aims to discuss the aforementioned issues. Design/methodology/approach: ADP is considered as a suitable MCDM method for perceived usability evaluation as it allows an easy approach to data fusion and setting performance targets for decision makers. A questionnaire is developed to collect data from three types of system users about predetermined usability criteria and their importance. After detailed statistical analyses and weighting criteria via analytical hierarch process (AHP), ADP is carried out to evaluate usability of the LMS. Findings: It is found that the proposed ADP based approach is easy to apply in practical circumstances and able to quantify perceived usability of the LMSs. Research limitations/implications: The proposed approach provides an easy and practical evaluation of perceived usability of the LMSs for decision makers who are responsible for the implementation of LMSs. The developed novel and practical MCDM-based perceived usability approach for LMS in this study has been verified through a real life case study at an academic department. Perceived usability results, therefore, reflects only the views of this focus group and are not generalizable. Originality/value: First time in the literature, a comprehensive ADP based MCDM approach is proposed based on the analyses of the related literature and information gathered from the system users. [ABSTRACT FROM AUTHOR]
Copyright of Kybernetes is the property of Emerald Publishing Limited and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 174379734
AccessLevel: 6
PubType: Periodical
PubTypeId: serialPeriodical
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Perceived usability evaluation of learning management systems via axiomatic design with a real life application.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Baykasoglu%2C+Adil%22">Baykasoglu, Adil</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> adil.baykasoglu@deu.edu.tr</i><br /><searchLink fieldCode="AR" term="%22Felekoglu%2C+Burcu%22">Felekoglu, Burcu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> burcu.felekoglu@deu.edu.tr</i><br /><searchLink fieldCode="AR" term="%22Ünal%2C+Ceylin%22">Ünal, Ceylin</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> ceylin.unal@ogr.deu.edu.tr</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Kybernetes%22">Kybernetes</searchLink>. 2024, Vol. 53 Issue 1, p83-101. 19p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Axiomatic+design%22">Axiomatic design</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+management+system%22">Learning management system</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+criteria+decision+making%22">Multiple criteria decision making</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+logic%22">Mathematical logic</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+departments%22">Academic departments</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Usage of learning management systems (LMSs) has become widespread with the disruption of face-to-face educations after the COVID-19 pandemic. There are several software products, usually named as LMS to enable and support distance education. However, selection of a suitable LMS is a complex multiple criteria decision making (MCDM) problem that requires consideration of many criteria and inputs from different parties like students, academicians, education managers, etc. Usability evaluation of LMS is one of the critical steps in deciding which LMS system to be adapted. There are several studies related to usability evaluation of LMS in the literature, but utilization of MCDM methods and real life case studies are very rare. Based on this motivation, perceived usability evaluation of SAKAI-LMS that is in use at an academic department is performed by employing axiomatic design procedure (ADP). This paper aims to discuss the aforementioned issues. Design/methodology/approach: ADP is considered as a suitable MCDM method for perceived usability evaluation as it allows an easy approach to data fusion and setting performance targets for decision makers. A questionnaire is developed to collect data from three types of system users about predetermined usability criteria and their importance. After detailed statistical analyses and weighting criteria via analytical hierarch process (AHP), ADP is carried out to evaluate usability of the LMS. Findings: It is found that the proposed ADP based approach is easy to apply in practical circumstances and able to quantify perceived usability of the LMSs. Research limitations/implications: The proposed approach provides an easy and practical evaluation of perceived usability of the LMSs for decision makers who are responsible for the implementation of LMSs. The developed novel and practical MCDM-based perceived usability approach for LMS in this study has been verified through a real life case study at an academic department. Perceived usability results, therefore, reflects only the views of this focus group and are not generalizable. Originality/value: First time in the literature, a comprehensive ADP based MCDM approach is proposed based on the analyses of the related literature and information gathered from the system users. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Kybernetes is the property of Emerald Publishing Limited and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=174379734
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1108/K-07-2022-1024
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 83
    Subjects:
      – SubjectFull: Axiomatic design
        Type: general
      – SubjectFull: Learning management system
        Type: general
      – SubjectFull: Multiple criteria decision making
        Type: general
      – SubjectFull: Mathematical logic
        Type: general
      – SubjectFull: Academic departments
        Type: general
    Titles:
      – TitleFull: Perceived usability evaluation of learning management systems via axiomatic design with a real life application.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Baykasoglu, Adil
      – PersonEntity:
          Name:
            NameFull: Felekoglu, Burcu
      – PersonEntity:
          Name:
            NameFull: Ünal, Ceylin
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: 2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 0368492X
          Numbering:
            – Type: volume
              Value: 53
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Kybernetes
              Type: main
ResultId 1