Multimodal Perception-Driven Optimization of Mobile Interaction Interfaces and Supply Chain Efficiency.

Saved in:

Bibliographic Details
Title:	Multimodal Perception-Driven Optimization of Mobile Interaction Interfaces and Supply Chain Efficiency.
Authors:	Liu, Jia¹ 230069@zjtie.edu.cn, Gao, Tian² andygao413@outlook.com
Source:	International Journal of Interactive Mobile Technologies. 2026, Vol. 20 Issue 12, p140-153. 14p.
Subjects:	Cognitive load, Multimodal user interfaces, Sensory perception, Artificial neural networks, Deep reinforcement learning, Surrogate-based optimization, Distributed computing
Abstract:	In mobile supply chain operations, constraints imposed by mobile terminal resources, fluctuations in operator cognitive load, and inadequate interface adaptability severely limit operational efficiency and increase the risk of operational errors. To address these challenges, a mobile interaction interface optimization and efficiency enhancement model was proposed, grounded in cloud-edge collaborative multimodal perception. A lightweight temporal fusion network, integrating time-division cross-modal attention and knowledge distillation, was developed to enable efficient processing of multimodal data at the edge and accurate prediction of operator intent, thereby accommodating the resource constraints of mobile devices. A mechanism for estimating instantaneous cognitive load, driven by multimodal proxy indicators, was constructed. Combined with meta-reinforcement learning, a load-aware dynamic interface reconfiguration strategy was formulated, enabling real-time adaptation between the interface and operator state. A multimodal intent-driven Markov decision process-based workflow preloading model was established, and an online Bayesian optimization framework was incorporated to form a closed-loop optimization system, effectively improving supply chain efficiency. This study provides an innovative solution for the application of mobile interaction technologies in supply chain scenarios and promotes the deep integration of mobile multimodal interaction with industrial environments. [ABSTRACT FROM AUTHOR]
	Copyright of International Journal of Interactive Mobile Technologies is the property of International Journal of Interactive Mobile Technologies and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Engineering Source

Description
Abstract:	In mobile supply chain operations, constraints imposed by mobile terminal resources, fluctuations in operator cognitive load, and inadequate interface adaptability severely limit operational efficiency and increase the risk of operational errors. To address these challenges, a mobile interaction interface optimization and efficiency enhancement model was proposed, grounded in cloud-edge collaborative multimodal perception. A lightweight temporal fusion network, integrating time-division cross-modal attention and knowledge distillation, was developed to enable efficient processing of multimodal data at the edge and accurate prediction of operator intent, thereby accommodating the resource constraints of mobile devices. A mechanism for estimating instantaneous cognitive load, driven by multimodal proxy indicators, was constructed. Combined with meta-reinforcement learning, a load-aware dynamic interface reconfiguration strategy was formulated, enabling real-time adaptation between the interface and operator state. A multimodal intent-driven Markov decision process-based workflow preloading model was established, and an online Bayesian optimization framework was incorporated to form a closed-loop optimization system, effectively improving supply chain efficiency. This study provides an innovative solution for the application of mobile interaction technologies in supply chain scenarios and promotes the deep integration of mobile multimodal interaction with industrial environments. [ABSTRACT FROM AUTHOR]
ISSN:	18657923
DOI:	10.3991/ijim.v20i12.62255