A Multimodal Interaction Mechanism for Mobile English Learning in Higher Education.
Saved in:
| Title: | A Multimodal Interaction Mechanism for Mobile English Learning in Higher Education. |
|---|---|
| Authors: | Zhao, Ran1 zhaoran118@163.com, Dong, Ning1 dongning000521@126.com |
| Source: | International Journal of Interactive Mobile Technologies. 2026, Vol. 20 Issue 16, p134-148. 15p. |
| Subjects: | Mobile learning, Multisensor data fusion, Synchronization, Artificial neural networks, Higher education, Machine learning, Multimodal user interfaces |
| Abstract: | Sensor-enabled mobile devices have provided new opportunities for interaction analysis and cognitive assessment in mobile English learning within higher education. However, existing approaches are constrained by insufficient data synchronization accuracy, limited flexibility in multimodal feature fusion, high computational costs associated with sequence modeling, and the lack of effective intervention mechanisms. To address these limitations, an edgeside multimodal interaction analysis and adaptive intervention framework was developed. Temporal alignment of heterogeneous sensor data was achieved, while lightweight crossmodal feature fusion was implemented using channel-attention-based representations. A bidirectional Mamba architecture was introduced for processing long-sequence data, and multitask learning was employed to simultaneously evaluate interaction quality and cognitive load. Behavioral evolution patterns were further explored through sequential pattern mining and cognitive network analysis. On this basis, a hierarchical feedback strategy was designed to enable intelligent intervention. The proposed framework provides both theoretical foundations and technical support for the development of intelligent mobile educational applications. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Interactive Mobile Technologies is the property of International Journal of Interactive Mobile Technologies and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 196325384 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: A Multimodal Interaction Mechanism for Mobile English Learning in Higher Education. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zhao%2C+Ran%22">Zhao, Ran</searchLink><relatesTo>1</relatesTo><i> zhaoran118@163.com</i><br /><searchLink fieldCode="AR" term="%22Dong%2C+Ning%22">Dong, Ning</searchLink><relatesTo>1</relatesTo><i> dongning000521@126.com</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Interactive+Mobile+Technologies%22">International Journal of Interactive Mobile Technologies</searchLink>. 2026, Vol. 20 Issue 16, p134-148. 15p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Mobile+learning%22">Mobile learning</searchLink><br /><searchLink fieldCode="DE" term="%22Multisensor+data+fusion%22">Multisensor data fusion</searchLink><br /><searchLink fieldCode="DE" term="%22Synchronization%22">Synchronization</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+neural+networks%22">Artificial neural networks</searchLink><br /><searchLink fieldCode="DE" term="%22Higher+education%22">Higher education</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Multimodal+user+interfaces%22">Multimodal user interfaces</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Sensor-enabled mobile devices have provided new opportunities for interaction analysis and cognitive assessment in mobile English learning within higher education. However, existing approaches are constrained by insufficient data synchronization accuracy, limited flexibility in multimodal feature fusion, high computational costs associated with sequence modeling, and the lack of effective intervention mechanisms. To address these limitations, an edgeside multimodal interaction analysis and adaptive intervention framework was developed. Temporal alignment of heterogeneous sensor data was achieved, while lightweight crossmodal feature fusion was implemented using channel-attention-based representations. A bidirectional Mamba architecture was introduced for processing long-sequence data, and multitask learning was employed to simultaneously evaluate interaction quality and cognitive load. Behavioral evolution patterns were further explored through sequential pattern mining and cognitive network analysis. On this basis, a hierarchical feedback strategy was designed to enable intelligent intervention. The proposed framework provides both theoretical foundations and technical support for the development of intelligent mobile educational applications. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Interactive Mobile Technologies is the property of International Journal of Interactive Mobile Technologies and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=196325384 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3991/ijim.v20i16.62751 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 15 StartPage: 134 Subjects: – SubjectFull: Mobile learning Type: general – SubjectFull: Multisensor data fusion Type: general – SubjectFull: Synchronization Type: general – SubjectFull: Artificial neural networks Type: general – SubjectFull: Higher education Type: general – SubjectFull: Machine learning Type: general – SubjectFull: Multimodal user interfaces Type: general Titles: – TitleFull: A Multimodal Interaction Mechanism for Mobile English Learning in Higher Education. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zhao, Ran – PersonEntity: Name: NameFull: Dong, Ning IsPartOfRelationships: – BibEntity: Dates: – D: 15 M: 08 Text: 2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 18657923 Numbering: – Type: volume Value: 20 – Type: issue Value: 16 Titles: – TitleFull: International Journal of Interactive Mobile Technologies Type: main |
| ResultId | 1 |