Unraveling Temporally Entangled Multimodal Interactions: Investigating Verbal and Nonverbal Contributions to Collaborative Construction of Embodied Math Knowledge

Saved in:
Bibliographic Details
Title: Unraveling Temporally Entangled Multimodal Interactions: Investigating Verbal and Nonverbal Contributions to Collaborative Construction of Embodied Math Knowledge
Language: English
Authors: Hanall Sung (ORCID 0000-0001-9076-3762), Mitchell J. Nathan
Source: International Journal of Educational Technology in Higher Education. 2025 22.
Availability: BioMed Central, Ltd. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://www.springer.com/gp/biomedical-sciences
Peer Reviewed: Y
Page Count: 28
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Technology Uses in Education, Epistemology, Research and Development, Nonverbal Learning, Verbal Learning, Learning Modalities, Undergraduate Students, Mathematics Education, Education Majors, Universities, Cooperative Learning, Intermode Differences, Learning Analytics, Constructivism (Learning)
DOI: 10.1186/s41239-025-00504-6
ISSN: 2365-9440
Abstract: In various technology-enhanced learning (TEL) environments, knowledge co-creation progresses through multimodal interactions that integrate verbal and nonverbal modalities, such as speech and gestures. This study investigated two distinct analytical approaches for analyzing multimodal interactions--triangulating and interleaving--by applying them to collaborative learning processes during an online embodied mathematics intervention. The findings demonstrate that the interleaving approach captures the temporal dynamics and nuanced interplay between multimodal events, providing deeper insights into how shared meaning-making evolves over time. In contrast, the triangulating approach effectively identifies cumulative interaction patterns but does not account for their temporal structure. Specifically, the interleaving approach, employing epistemic network analysis, revealed statistically significant differences in discourse patterns between learners with larger and smaller variances in upper body movements during the co-design activity. These findings underscore the complementary value of the interleaving approach in analyzing multimodal interactions and offer practical implications for advancing understanding of collaborative learning processes in TEL environments.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1461019
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:In various technology-enhanced learning (TEL) environments, knowledge co-creation progresses through multimodal interactions that integrate verbal and nonverbal modalities, such as speech and gestures. This study investigated two distinct analytical approaches for analyzing multimodal interactions--triangulating and interleaving--by applying them to collaborative learning processes during an online embodied mathematics intervention. The findings demonstrate that the interleaving approach captures the temporal dynamics and nuanced interplay between multimodal events, providing deeper insights into how shared meaning-making evolves over time. In contrast, the triangulating approach effectively identifies cumulative interaction patterns but does not account for their temporal structure. Specifically, the interleaving approach, employing epistemic network analysis, revealed statistically significant differences in discourse patterns between learners with larger and smaller variances in upper body movements during the co-design activity. These findings underscore the complementary value of the interleaving approach in analyzing multimodal interactions and offer practical implications for advancing understanding of collaborative learning processes in TEL environments.
ISSN:2365-9440
DOI:10.1186/s41239-025-00504-6