Gaze and Hand Behaviors during Haptic Abilities Testing--An Update to Multimedia Learning Theory

Saved in:
Bibliographic Details
Title: Gaze and Hand Behaviors during Haptic Abilities Testing--An Update to Multimedia Learning Theory
Language: English
Authors: Michelle A. Sveistrup, Jean Langlois (ORCID 0000-0002-8312-4273), Timothy D. Wilson (ORCID 0000-0001-7102-2491)
Source: Anatomical Sciences Education. 2025 18(1):32-47.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 16
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Learning Theories, Multimedia Instruction, Sensory Integration, Experiential Learning, Spatial Ability, Task Analysis, Comparative Analysis, Memory, Anatomy, Video Technology, Classification, Motor Reactions
DOI: 10.1002/ase.2526
ISSN: 1935-9772
1935-9780
Abstract: The Cognitive Theory of Multimedia Learning (CTML) suggests humans learn through visual and auditory sensory channels. Haptics represent a third channel within CTML and a missing component for experiential learning. The objective was to measure visual and haptic behaviors during spatial tasks. The haptic abilities test (HAT) quantifies results in several realms, accuracy, time, and strategy. The HAT was completed under three sensory conditions using sight (S), haptics (H), and sight with haptics (SH). Subjects (n = 22, 13 females (F), 20-28 years) completed the MRT (10.6 ± 5.0, mean ± SD) and were classified as high or low spatial abilities scores with respect to mean MRT: high spatial abilities (HSA) (n = 12, 6F, MRT = 13.7 ± 3.0), and low spatial ability (LSA) groups (n = 10, 7F, MRT = 5.6 ± 2.0). Video recordings gaze and hand behaviors were compared between HSA and LSA groups across HAT conditions. The HSA group spent less time fixating on mirrored objects, an erroneous answer option, of HAT compared to the LSA group (11.0 ± 4.7 vs. 17.8 ± 7.3 s, p = 0.020) in S conditions. In haptic conditions, HSA utilized a hand--object interaction strategy characterized as palpation, significantly less than the LSA group (23.2 ± 16.0 vs. 43.1 ± 21.5 percent, p = 0.022). Before this study, it was unclear whether haptic sensory inputs appended to the mental schema models of the CTML. These data suggest that if spatial abilities are challenged, LSA persons both benefit and utilize strategies beyond the classic CTML framework by using their hands as a third input channel. This data suggest haptic behaviors offer a third type of sensory memory resulting in improved cognitive performance.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1454929
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:The Cognitive Theory of Multimedia Learning (CTML) suggests humans learn through visual and auditory sensory channels. Haptics represent a third channel within CTML and a missing component for experiential learning. The objective was to measure visual and haptic behaviors during spatial tasks. The haptic abilities test (HAT) quantifies results in several realms, accuracy, time, and strategy. The HAT was completed under three sensory conditions using sight (S), haptics (H), and sight with haptics (SH). Subjects (n = 22, 13 females (F), 20-28 years) completed the MRT (10.6 ± 5.0, mean ± SD) and were classified as high or low spatial abilities scores with respect to mean MRT: high spatial abilities (HSA) (n = 12, 6F, MRT = 13.7 ± 3.0), and low spatial ability (LSA) groups (n = 10, 7F, MRT = 5.6 ± 2.0). Video recordings gaze and hand behaviors were compared between HSA and LSA groups across HAT conditions. The HSA group spent less time fixating on mirrored objects, an erroneous answer option, of HAT compared to the LSA group (11.0 ± 4.7 vs. 17.8 ± 7.3 s, p = 0.020) in S conditions. In haptic conditions, HSA utilized a hand--object interaction strategy characterized as palpation, significantly less than the LSA group (23.2 ± 16.0 vs. 43.1 ± 21.5 percent, p = 0.022). Before this study, it was unclear whether haptic sensory inputs appended to the mental schema models of the CTML. These data suggest that if spatial abilities are challenged, LSA persons both benefit and utilize strategies beyond the classic CTML framework by using their hands as a third input channel. This data suggest haptic behaviors offer a third type of sensory memory resulting in improved cognitive performance.
ISSN:1935-9772
1935-9780
DOI:10.1002/ase.2526