Evaluating instructional designs with mental workload assessments in university classrooms.
Saved in:
| Title: | Evaluating instructional designs with mental workload assessments in university classrooms. |
|---|---|
| Authors: | Longo, Luca, Orrú, Giuliano |
| Source: | Behaviour & Information Technology. May2022, Vol. 41 Issue 6, p1199-1229. 31p. 10 Color Photographs, 5 Diagrams, 11 Charts, 14 Graphs. |
| Subjects: | School environment, Reliability (Personality trait), College students, Experimental design, Statistics, Multimedia systems, Research evaluation, Psychology, Ergonomics, Cronbach's alpha, Pearson correlation (Statistics), T-test (Statistics), Philosophy of education, Employees' workload, Universities & colleges, Theory, Hypothesis, Questionnaires, Descriptive statistics, Sensitivity & specificity (Statistics), Logistic regression analysis, Data analysis, Psychological distress |
| Geographic Terms: | Ireland |
| Abstract: | Cognitive cognitive load theory (CLT) has been conceived for improving instructional design practices. Although researched for many years, one open problem is a clear definition of its cognitive load types and their aggregation towards an index of overall cognitive load. In Ergonomics, the situation is different with plenty of research devoted to the development of robust constructs of mental workload (MWL). By drawing a parallel between CLT and MWL, as well as by integrating relevant theories and measurement techniques from these two fields, this paper is aimed at investigating the reliability, validity and sensitivity of three existing self-reporting mental workload measures when applied to long learning sessions, namely, the NASA Task Load index, the Workload Profile and the Rating Scale Mental Effort, in a typical university classroom. These measures were aimed at serving for the evaluation of two instructional conditions. Evidence suggests these selected measures are reliable and their moderate validity is in line with results obtained within Ergonomics. Additionally, an analysis of their sensitivity by employing the descriptive Harrell-Davis estimator suggests that the Workload Profile is more sensitive than the Nasa Task Load Index and the Rating Scale Mental Effort for long learning sessions. [ABSTRACT FROM AUTHOR] |
| Copyright of Behaviour & Information Technology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Cognitive cognitive load theory (CLT) has been conceived for improving instructional design practices. Although researched for many years, one open problem is a clear definition of its cognitive load types and their aggregation towards an index of overall cognitive load. In Ergonomics, the situation is different with plenty of research devoted to the development of robust constructs of mental workload (MWL). By drawing a parallel between CLT and MWL, as well as by integrating relevant theories and measurement techniques from these two fields, this paper is aimed at investigating the reliability, validity and sensitivity of three existing self-reporting mental workload measures when applied to long learning sessions, namely, the NASA Task Load index, the Workload Profile and the Rating Scale Mental Effort, in a typical university classroom. These measures were aimed at serving for the evaluation of two instructional conditions. Evidence suggests these selected measures are reliable and their moderate validity is in line with results obtained within Ergonomics. Additionally, an analysis of their sensitivity by employing the descriptive Harrell-Davis estimator suggests that the Workload Profile is more sensitive than the Nasa Task Load Index and the Rating Scale Mental Effort for long learning sessions. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 0144929X |
| DOI: | 10.1080/0144929X.2020.1864019 |
