Measuring cognitive load: performance, mental effort and simulation task complexity.

Saved in:
Bibliographic Details
Title: Measuring cognitive load: performance, mental effort and simulation task complexity.
Authors: Haji, Faizal A, Rojas, David, Childs, Ruth, Ribaupierre, Sandrine, Dubrowski, Adam
Source: Medical Education. Aug2015, Vol. 49 Issue 8, p815-827. 13p. 1 Black and White Photograph, 1 Diagram, 1 Chart, 2 Graphs.
Subjects: Adults, Higher education, Professional education, Analysis of variance, Computer simulation, Fisher exact test, Medical students, Study & teaching of medicine, Statistics, T-test (Statistics), Data analysis, Effect sizes (Statistics), Data analysis software, Descriptive statistics
Abstract: Context Interest in applying cognitive load theory in health care simulation is growing. This line of inquiry requires measures that are sensitive to changes in cognitive load arising from different instructional designs. Recently, mental effort ratings and secondary task performance have shown promise as measures of cognitive load in health care simulation. Objectives We investigate the sensitivity of these measures to predicted differences in intrinsic load arising from variations in task complexity and learner expertise during simulation-based surgical skills training. Methods We randomly assigned 28 novice medical students to simulation training on a simple or complex surgical knot-tying task. Participants completed 13 practice trials, interspersed with computer-based video instruction. On trials 1, 5, 9 and 13, knot-tying performance was assessed using time and movement efficiency measures, and cognitive load was assessed using subjective rating of mental effort ( SRME) and simple reaction time ( SRT) on a vibrotactile stimulus-monitoring secondary task. Results Significant improvements in knot-tying performance ( F(1.04,24.95) = 41.1, p < 0.001 for movements; F(1.04,25.90) = 49.9, p < 0.001 for time) and reduced cognitive load ( F(2.3,58.5) = 57.7, p < 0.001 for SRME; F(1.8,47.3) = 10.5, p < 0.001 for SRT) were observed in both groups during training. The simple-task group demonstrated superior knot tying ( F(1,24) = 5.2, p = 0.031 for movements; F(1,24) = 6.5, p = 0.017 for time) and a faster decline in SRME over the first five trials ( F(1,26) = 6.45, p = 0.017) compared with their peers. Although SRT followed a similar pattern, group differences were not statistically significant. Conclusions Both secondary task performance and mental effort ratings are sensitive to changes in intrinsic load among novices engaged in simulation-based learning. These measures can be used to track cognitive load during skills training. Mental effort ratings are also sensitive to small differences in intrinsic load arising from variations in the physical complexity of a simulation task. The complementary nature of these subjective and objective measures suggests their combined use is advantageous in simulation instructional design research. [ABSTRACT FROM AUTHOR]
Copyright of Medical Education is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 103668919
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Measuring cognitive load: performance, mental effort and simulation task complexity.
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Haji%2C+Faizal+A%22&quot;&gt;Haji, Faizal A&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Rojas%2C+David%22&quot;&gt;Rojas, David&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Childs%2C+Ruth%22&quot;&gt;Childs, Ruth&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Ribaupierre%2C+Sandrine%22&quot;&gt;Ribaupierre, Sandrine&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Dubrowski%2C+Adam%22&quot;&gt;Dubrowski, Adam&lt;/searchLink&gt;
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;JN&quot; term=&quot;%22Medical+Education%22&quot;&gt;Medical Education&lt;/searchLink&gt;. Aug2015, Vol. 49 Issue 8, p815-827. 13p. 1 Black and White Photograph, 1 Diagram, 1 Chart, 2 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Adults%22&quot;&gt;Adults&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Higher+education%22&quot;&gt;Higher education&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Professional+education%22&quot;&gt;Professional education&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Analysis+of+variance%22&quot;&gt;Analysis of variance&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Computer+simulation%22&quot;&gt;Computer simulation&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Fisher+exact+test%22&quot;&gt;Fisher exact test&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Medical+students%22&quot;&gt;Medical students&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Study+%26+teaching+of+medicine%22&quot;&gt;Study &amp; teaching of medicine&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Statistics%22&quot;&gt;Statistics&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22T-test+%28Statistics%29%22&quot;&gt;T-test (Statistics)&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Data+analysis%22&quot;&gt;Data analysis&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Effect+sizes+%28Statistics%29%22&quot;&gt;Effect sizes (Statistics)&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Data+analysis+software%22&quot;&gt;Data analysis software&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Descriptive+statistics%22&quot;&gt;Descriptive statistics&lt;/searchLink&gt;
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Context Interest in applying cognitive load theory in health care simulation is growing. This line of inquiry requires measures that are sensitive to changes in cognitive load arising from different instructional designs. Recently, mental effort ratings and secondary task performance have shown promise as measures of cognitive load in health care simulation. Objectives We investigate the sensitivity of these measures to predicted differences in intrinsic load arising from variations in task complexity and learner expertise during simulation-based surgical skills training. Methods We randomly assigned 28 novice medical students to simulation training on a simple or complex surgical knot-tying task. Participants completed 13 practice trials, interspersed with computer-based video instruction. On trials 1, 5, 9 and 13, knot-tying performance was assessed using time and movement efficiency measures, and cognitive load was assessed using subjective rating of mental effort ( SRME) and simple reaction time ( SRT) on a vibrotactile stimulus-monitoring secondary task. Results Significant improvements in knot-tying performance ( F(1.04,24.95) = 41.1, p &lt; 0.001 for movements; F(1.04,25.90) = 49.9, p &lt; 0.001 for time) and reduced cognitive load ( F(2.3,58.5) = 57.7, p &lt; 0.001 for SRME; F(1.8,47.3) = 10.5, p &lt; 0.001 for SRT) were observed in both groups during training. The simple-task group demonstrated superior knot tying ( F(1,24) = 5.2, p = 0.031 for movements; F(1,24) = 6.5, p = 0.017 for time) and a faster decline in SRME over the first five trials ( F(1,26) = 6.45, p = 0.017) compared with their peers. Although SRT followed a similar pattern, group differences were not statistically significant. Conclusions Both secondary task performance and mental effort ratings are sensitive to changes in intrinsic load among novices engaged in simulation-based learning. These measures can be used to track cognitive load during skills training. Mental effort ratings are also sensitive to small differences in intrinsic load arising from variations in the physical complexity of a simulation task. The complementary nature of these subjective and objective measures suggests their combined use is advantageous in simulation instructional design research. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: &lt;i&gt;Copyright of Medical Education is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder&#39;s express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.&lt;/i&gt; (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=103668919
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/medu.12773
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 815
    Subjects:
      – SubjectFull: Adults
        Type: general
      – SubjectFull: Higher education
        Type: general
      – SubjectFull: Professional education
        Type: general
      – SubjectFull: Analysis of variance
        Type: general
      – SubjectFull: Computer simulation
        Type: general
      – SubjectFull: Fisher exact test
        Type: general
      – SubjectFull: Medical students
        Type: general
      – SubjectFull: Study & teaching of medicine
        Type: general
      – SubjectFull: Statistics
        Type: general
      – SubjectFull: T-test (Statistics)
        Type: general
      – SubjectFull: Data analysis
        Type: general
      – SubjectFull: Effect sizes (Statistics)
        Type: general
      – SubjectFull: Data analysis software
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
    Titles:
      – TitleFull: Measuring cognitive load: performance, mental effort and simulation task complexity.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Haji, Faizal A
      – PersonEntity:
          Name:
            NameFull: Rojas, David
      – PersonEntity:
          Name:
            NameFull: Childs, Ruth
      – PersonEntity:
          Name:
            NameFull: Ribaupierre, Sandrine
      – PersonEntity:
          Name:
            NameFull: Dubrowski, Adam
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Text: Aug2015
              Type: published
              Y: 2015
          Identifiers:
            – Type: issn-print
              Value: 03080110
          Numbering:
            – Type: volume
              Value: 49
            – Type: issue
              Value: 8
          Titles:
            – TitleFull: Medical Education
              Type: main
ResultId 1