Hierarchical production control and distribution planning under retail uncertainty with reinforcement learning.

Saved in:
Bibliographic Details
Title: Hierarchical production control and distribution planning under retail uncertainty with reinforcement learning.
Authors: Deng, Yang1,2 (AUTHOR), Chow, Andy H. F.2 (AUTHOR), Yan, Yimo3 (AUTHOR), Su, Zicheng4 (AUTHOR) suzicheng@tongji.edu.cn, Zhou, Zhili1 (AUTHOR), Kuo, Yong-Hong3,5 (AUTHOR)
Source: International Journal of Production Research. Jun2025, Vol. 63 Issue 12, p4504-4522. 19p.
Subjects: Distribution planning, Supply chain management, Inventory control, Production control, Reinforcement learning
Abstract: Effective coordination between production control and distribution planning is critical in supply chain management. However, existing research mainly focuses on responding to stochastic demand, while the impact of uncertain retail capabilities is often overlooked. This study proposes a hierarchical framework that integrates and coordinates production control and distribution planning while explicitly addressing the uncertainty of retail capabilities. Specifically, we develop a reinforcement learning (RL) algorithm that learns stochastic retail capabilities under adaptive production control (upper level) and distribution planning (lower level). This retail information is then fed into the hierarchical control framework, which enhances the performance of both control layers to maximise system profit while considering opportunity costs and holding costs. Moreover, we incorporate a novel holding function based on the exponential penalty term into the reward function to effectively enforce the side constraint of inventory capacity. This approach enables the RL algorithm to derive feasible production policies and thereby enhance the training process. We evaluate the proposed hierarchical controller through a case study utilising real-world transaction data from the steel manufacturing industry. The results demonstrate that the accurate identification of retail capabilities can facilitate inventory management under stochastic market conditions. Furthermore, the hierarchical framework can improve overall profits by coordinating production control actions under different retail strategies. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Production Research is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
Description
Abstract:Effective coordination between production control and distribution planning is critical in supply chain management. However, existing research mainly focuses on responding to stochastic demand, while the impact of uncertain retail capabilities is often overlooked. This study proposes a hierarchical framework that integrates and coordinates production control and distribution planning while explicitly addressing the uncertainty of retail capabilities. Specifically, we develop a reinforcement learning (RL) algorithm that learns stochastic retail capabilities under adaptive production control (upper level) and distribution planning (lower level). This retail information is then fed into the hierarchical control framework, which enhances the performance of both control layers to maximise system profit while considering opportunity costs and holding costs. Moreover, we incorporate a novel holding function based on the exponential penalty term into the reward function to effectively enforce the side constraint of inventory capacity. This approach enables the RL algorithm to derive feasible production policies and thereby enhance the training process. We evaluate the proposed hierarchical controller through a case study utilising real-world transaction data from the steel manufacturing industry. The results demonstrate that the accurate identification of retail capabilities can facilitate inventory management under stochastic market conditions. Furthermore, the hierarchical framework can improve overall profits by coordinating production control actions under different retail strategies. [ABSTRACT FROM AUTHOR]
ISSN:00207543
DOI:10.1080/00207543.2025.2452386