View in EDS HTML Full Text PDF Full Text

Evaluating instructional designs with mental workload assessments in university classrooms.

Saved in:
Bibliographic Details
Title: Evaluating instructional designs with mental workload assessments in university classrooms.
Authors: Longo, Luca, Orrú, Giuliano
Source: Behaviour & Information Technology. May2022, Vol. 41 Issue 6, p1199-1229. 31p. 10 Color Photographs, 5 Diagrams, 11 Charts, 14 Graphs.
Subjects: School environment, Reliability (Personality trait), College students, Experimental design, Statistics, Multimedia systems, Research evaluation, Psychology, Ergonomics, Cronbach's alpha, Pearson correlation (Statistics), T-test (Statistics), Philosophy of education, Employees' workload, Universities & colleges, Theory, Hypothesis, Questionnaires, Descriptive statistics, Sensitivity & specificity (Statistics), Logistic regression analysis, Data analysis, Psychological distress
Geographic Terms: Ireland
Abstract: Cognitive cognitive load theory (CLT) has been conceived for improving instructional design practices. Although researched for many years, one open problem is a clear definition of its cognitive load types and their aggregation towards an index of overall cognitive load. In Ergonomics, the situation is different with plenty of research devoted to the development of robust constructs of mental workload (MWL). By drawing a parallel between CLT and MWL, as well as by integrating relevant theories and measurement techniques from these two fields, this paper is aimed at investigating the reliability, validity and sensitivity of three existing self-reporting mental workload measures when applied to long learning sessions, namely, the NASA Task Load index, the Workload Profile and the Rating Scale Mental Effort, in a typical university classroom. These measures were aimed at serving for the evaluation of two instructional conditions. Evidence suggests these selected measures are reliable and their moderate validity is in line with results obtained within Ergonomics. Additionally, an analysis of their sensitivity by employing the descriptive Harrell-Davis estimator suggests that the Workload Profile is more sensitive than the Nasa Task Load Index and the Rating Scale Mental Effort for long learning sessions. [ABSTRACT FROM AUTHOR]
Copyright of Behaviour & Information Technology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 156785243
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating instructional designs with mental workload assessments in university classrooms.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Longo%2C+Luca%22">Longo, Luca</searchLink><br /><searchLink fieldCode="AR" term="%22Orrú%2C+Giuliano%22">Orrú, Giuliano</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Behaviour+%26+Information+Technology%22">Behaviour & Information Technology</searchLink>. May2022, Vol. 41 Issue 6, p1199-1229. 31p. 10 Color Photographs, 5 Diagrams, 11 Charts, 14 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22School+environment%22">School environment</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability+%28Personality+trait%29%22">Reliability (Personality trait)</searchLink><br /><searchLink fieldCode="DE" term="%22College+students%22">College students</searchLink><br /><searchLink fieldCode="DE" term="%22Experimental+design%22">Experimental design</searchLink><br /><searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Multimedia+systems%22">Multimedia systems</searchLink><br /><searchLink fieldCode="DE" term="%22Research+evaluation%22">Research evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Psychology%22">Psychology</searchLink><br /><searchLink fieldCode="DE" term="%22Ergonomics%22">Ergonomics</searchLink><br /><searchLink fieldCode="DE" term="%22Cronbach's+alpha%22">Cronbach's alpha</searchLink><br /><searchLink fieldCode="DE" term="%22Pearson+correlation+%28Statistics%29%22">Pearson correlation (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22T-test+%28Statistics%29%22">T-test (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Philosophy+of+education%22">Philosophy of education</searchLink><br /><searchLink fieldCode="DE" term="%22Employees'+workload%22">Employees' workload</searchLink><br /><searchLink fieldCode="DE" term="%22Universities+%26+colleges%22">Universities & colleges</searchLink><br /><searchLink fieldCode="DE" term="%22Theory%22">Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Hypothesis%22">Hypothesis</searchLink><br /><searchLink fieldCode="DE" term="%22Questionnaires%22">Questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Sensitivity+%26+specificity+%28Statistics%29%22">Sensitivity & specificity (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Logistic+regression+analysis%22">Logistic regression analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis%22">Data analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+distress%22">Psychological distress</searchLink>
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Ireland%22">Ireland</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Cognitive cognitive load theory (CLT) has been conceived for improving instructional design practices. Although researched for many years, one open problem is a clear definition of its cognitive load types and their aggregation towards an index of overall cognitive load. In Ergonomics, the situation is different with plenty of research devoted to the development of robust constructs of mental workload (MWL). By drawing a parallel between CLT and MWL, as well as by integrating relevant theories and measurement techniques from these two fields, this paper is aimed at investigating the reliability, validity and sensitivity of three existing self-reporting mental workload measures when applied to long learning sessions, namely, the NASA Task Load index, the Workload Profile and the Rating Scale Mental Effort, in a typical university classroom. These measures were aimed at serving for the evaluation of two instructional conditions. Evidence suggests these selected measures are reliable and their moderate validity is in line with results obtained within Ergonomics. Additionally, an analysis of their sensitivity by employing the descriptive Harrell-Davis estimator suggests that the Workload Profile is more sensitive than the Nasa Task Load Index and the Rating Scale Mental Effort for long learning sessions. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Behaviour & Information Technology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=156785243
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/0144929X.2020.1864019
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 31
        StartPage: 1199
    Subjects:
      – SubjectFull: School environment
        Type: general
      – SubjectFull: Reliability (Personality trait)
        Type: general
      – SubjectFull: College students
        Type: general
      – SubjectFull: Experimental design
        Type: general
      – SubjectFull: Statistics
        Type: general
      – SubjectFull: Multimedia systems
        Type: general
      – SubjectFull: Research evaluation
        Type: general
      – SubjectFull: Psychology
        Type: general
      – SubjectFull: Ergonomics
        Type: general
      – SubjectFull: Cronbach's alpha
        Type: general
      – SubjectFull: Pearson correlation (Statistics)
        Type: general
      – SubjectFull: T-test (Statistics)
        Type: general
      – SubjectFull: Philosophy of education
        Type: general
      – SubjectFull: Employees' workload
        Type: general
      – SubjectFull: Universities & colleges
        Type: general
      – SubjectFull: Theory
        Type: general
      – SubjectFull: Hypothesis
        Type: general
      – SubjectFull: Questionnaires
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Sensitivity & specificity (Statistics)
        Type: general
      – SubjectFull: Logistic regression analysis
        Type: general
      – SubjectFull: Data analysis
        Type: general
      – SubjectFull: Psychological distress
        Type: general
      – SubjectFull: Ireland
        Type: general
    Titles:
      – TitleFull: Evaluating instructional designs with mental workload assessments in university classrooms.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Longo, Luca
      – PersonEntity:
          Name:
            NameFull: Orrú, Giuliano
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2022
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 0144929X
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Behaviour & Information Technology
              Type: main
ResultId 1