A Multimodal Interaction Mechanism for Mobile English Learning in Higher Education.

Saved in:

Bibliographic Details
Title:	A Multimodal Interaction Mechanism for Mobile English Learning in Higher Education.
Authors:	Zhao, Ran¹ zhaoran118@163.com, Dong, Ning¹ dongning000521@126.com
Source:	International Journal of Interactive Mobile Technologies. 2026, Vol. 20 Issue 16, p134-148. 15p.
Subjects:	Mobile learning, Multisensor data fusion, Synchronization, Artificial neural networks, Higher education, Machine learning, Multimodal user interfaces
Abstract:	Sensor-enabled mobile devices have provided new opportunities for interaction analysis and cognitive assessment in mobile English learning within higher education. However, existing approaches are constrained by insufficient data synchronization accuracy, limited flexibility in multimodal feature fusion, high computational costs associated with sequence modeling, and the lack of effective intervention mechanisms. To address these limitations, an edgeside multimodal interaction analysis and adaptive intervention framework was developed. Temporal alignment of heterogeneous sensor data was achieved, while lightweight crossmodal feature fusion was implemented using channel-attention-based representations. A bidirectional Mamba architecture was introduced for processing long-sequence data, and multitask learning was employed to simultaneously evaluate interaction quality and cognitive load. Behavioral evolution patterns were further explored through sequential pattern mining and cognitive network analysis. On this basis, a hierarchical feedback strategy was designed to enable intelligent intervention. The proposed framework provides both theoretical foundations and technical support for the development of intelligent mobile educational applications. [ABSTRACT FROM AUTHOR]
	Copyright of International Journal of Interactive Mobile Technologies is the property of International Journal of Interactive Mobile Technologies and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Engineering Source

Description
Abstract:	Sensor-enabled mobile devices have provided new opportunities for interaction analysis and cognitive assessment in mobile English learning within higher education. However, existing approaches are constrained by insufficient data synchronization accuracy, limited flexibility in multimodal feature fusion, high computational costs associated with sequence modeling, and the lack of effective intervention mechanisms. To address these limitations, an edgeside multimodal interaction analysis and adaptive intervention framework was developed. Temporal alignment of heterogeneous sensor data was achieved, while lightweight crossmodal feature fusion was implemented using channel-attention-based representations. A bidirectional Mamba architecture was introduced for processing long-sequence data, and multitask learning was employed to simultaneously evaluate interaction quality and cognitive load. Behavioral evolution patterns were further explored through sequential pattern mining and cognitive network analysis. On this basis, a hierarchical feedback strategy was designed to enable intelligent intervention. The proposed framework provides both theoretical foundations and technical support for the development of intelligent mobile educational applications. [ABSTRACT FROM AUTHOR]
ISSN:	18657923
DOI:	10.3991/ijim.v20i16.62751