An Evaluation of an Adaptive Learning System Based on Multimodal Affect Recognition for Learners with Intellectual Disabilities

Saved in:
Bibliographic Details
Title: An Evaluation of an Adaptive Learning System Based on Multimodal Affect Recognition for Learners with Intellectual Disabilities
Language: English
Authors: Standen, Penelope J., Brown, David J., Taheri, Mohammad, Galvez Trigo, Maria J., Boulton, Helen, Burton, Andrew, Hallewell, Madeline J., Lathe, James G., Shopland, Nicholas, Blanco Gonzalez, Maria A., Kwiatkowska, Gosia M., Milli, Elena, Cobello, Stefano, Mazzucato, Annaleda, Traversi, Marco, Hortal, Enrique
Source: British Journal of Educational Technology. Sep 2020 51(5):1748-1765.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 18
Publication Date: 2020
Document Type: Journal Articles
Reports - Research
Descriptors: Artificial Intelligence, Technology Uses in Education, Educational Technology, Identification, Psychological Patterns, Intellectual Disability, Students with Disabilities, Learner Engagement, Academic Achievement, Intelligent Tutoring Systems, Special Education, Student Needs
DOI: 10.1111/bjet.13010
ISSN: 0007-1013
Abstract: Artificial intelligence tools for education (AIEd) have been used to automate the provision of learning support to mainstream learners. One of the most innovative approaches in this field is the use of data and machine learning for the detection of a student's affective state, to move them out of negative states that inhibit learning, into positive states such as engagement. In spite of their obvious potential to provide the personalisation that would give extra support for learners with intellectual disabilities, little work on AIEd systems that utilise affect recognition currently addresses this group. Our system used multimodal sensor data and machine learning to first identify three affective states linked to learning (engagement, frustration, boredom) and second determine the presentation of learning content so that the learner is maintained in an optimal affective state and rate of learning is maximised. To evaluate this adaptive learning system, 67 participants aged between 6 and 18 years acting as their own control took part in a series of sessions using the system. Sessions alternated between using the system with both affect detection and learning achievement to drive the selection of learning content (intervention) and using learning achievement alone (control) to drive the selection of learning content. Lack of boredom was the state with the strongest link to achievement, with both frustration and engagement positively related to achievement. There was significantly more engagement and less boredom in intervention than control sessions, but no significant difference in achievement. These results suggest that engagement does increase when activities are tailored to the personal needs and emotional state of the learner and that the system was promoting affective states that in turn promote learning. However, longer exposure is necessary to determine the effect on learning.
Abstractor: As Provided
Entry Date: 2020
Accession Number: EJ1265373
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:Artificial intelligence tools for education (AIEd) have been used to automate the provision of learning support to mainstream learners. One of the most innovative approaches in this field is the use of data and machine learning for the detection of a student's affective state, to move them out of negative states that inhibit learning, into positive states such as engagement. In spite of their obvious potential to provide the personalisation that would give extra support for learners with intellectual disabilities, little work on AIEd systems that utilise affect recognition currently addresses this group. Our system used multimodal sensor data and machine learning to first identify three affective states linked to learning (engagement, frustration, boredom) and second determine the presentation of learning content so that the learner is maintained in an optimal affective state and rate of learning is maximised. To evaluate this adaptive learning system, 67 participants aged between 6 and 18 years acting as their own control took part in a series of sessions using the system. Sessions alternated between using the system with both affect detection and learning achievement to drive the selection of learning content (intervention) and using learning achievement alone (control) to drive the selection of learning content. Lack of boredom was the state with the strongest link to achievement, with both frustration and engagement positively related to achievement. There was significantly more engagement and less boredom in intervention than control sessions, but no significant difference in achievement. These results suggest that engagement does increase when activities are tailored to the personal needs and emotional state of the learner and that the system was promoting affective states that in turn promote learning. However, longer exposure is necessary to determine the effect on learning.
ISSN:0007-1013
DOI:10.1111/bjet.13010