Hierarchical production control and distribution planning under retail uncertainty with reinforcement learning.

Saved in:
Bibliographic Details
Title: Hierarchical production control and distribution planning under retail uncertainty with reinforcement learning.
Authors: Deng, Yang1,2 (AUTHOR), Chow, Andy H. F.2 (AUTHOR), Yan, Yimo3 (AUTHOR), Su, Zicheng4 (AUTHOR) suzicheng@tongji.edu.cn, Zhou, Zhili1 (AUTHOR), Kuo, Yong-Hong3,5 (AUTHOR)
Source: International Journal of Production Research. Jun2025, Vol. 63 Issue 12, p4504-4522. 19p.
Subjects: Distribution planning, Supply chain management, Inventory control, Production control, Reinforcement learning
Abstract: Effective coordination between production control and distribution planning is critical in supply chain management. However, existing research mainly focuses on responding to stochastic demand, while the impact of uncertain retail capabilities is often overlooked. This study proposes a hierarchical framework that integrates and coordinates production control and distribution planning while explicitly addressing the uncertainty of retail capabilities. Specifically, we develop a reinforcement learning (RL) algorithm that learns stochastic retail capabilities under adaptive production control (upper level) and distribution planning (lower level). This retail information is then fed into the hierarchical control framework, which enhances the performance of both control layers to maximise system profit while considering opportunity costs and holding costs. Moreover, we incorporate a novel holding function based on the exponential penalty term into the reward function to effectively enforce the side constraint of inventory capacity. This approach enables the RL algorithm to derive feasible production policies and thereby enhance the training process. We evaluate the proposed hierarchical controller through a case study utilising real-world transaction data from the steel manufacturing industry. The results demonstrate that the accurate identification of retail capabilities can facilitate inventory management under stochastic market conditions. Furthermore, the hierarchical framework can improve overall profits by coordinating production control actions under different retail strategies. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Production Research is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 185944312
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Hierarchical production control and distribution planning under retail uncertainty with reinforcement learning.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Deng%2C+Yang%22">Deng, Yang</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chow%2C+Andy+H%2E+F%2E%22">Chow, Andy H. F.</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yan%2C+Yimo%22">Yan, Yimo</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Su%2C+Zicheng%22">Su, Zicheng</searchLink><relatesTo>4</relatesTo> (AUTHOR)<i> suzicheng@tongji.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Zhou%2C+Zhili%22">Zhou, Zhili</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kuo%2C+Yong-Hong%22">Kuo, Yong-Hong</searchLink><relatesTo>3,5</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Production+Research%22">International Journal of Production Research</searchLink>. Jun2025, Vol. 63 Issue 12, p4504-4522. 19p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Distribution+planning%22">Distribution planning</searchLink><br /><searchLink fieldCode="DE" term="%22Supply+chain+management%22">Supply chain management</searchLink><br /><searchLink fieldCode="DE" term="%22Inventory+control%22">Inventory control</searchLink><br /><searchLink fieldCode="DE" term="%22Production+control%22">Production control</searchLink><br /><searchLink fieldCode="DE" term="%22Reinforcement+learning%22">Reinforcement learning</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Effective coordination between production control and distribution planning is critical in supply chain management. However, existing research mainly focuses on responding to stochastic demand, while the impact of uncertain retail capabilities is often overlooked. This study proposes a hierarchical framework that integrates and coordinates production control and distribution planning while explicitly addressing the uncertainty of retail capabilities. Specifically, we develop a reinforcement learning (RL) algorithm that learns stochastic retail capabilities under adaptive production control (upper level) and distribution planning (lower level). This retail information is then fed into the hierarchical control framework, which enhances the performance of both control layers to maximise system profit while considering opportunity costs and holding costs. Moreover, we incorporate a novel holding function based on the exponential penalty term into the reward function to effectively enforce the side constraint of inventory capacity. This approach enables the RL algorithm to derive feasible production policies and thereby enhance the training process. We evaluate the proposed hierarchical controller through a case study utilising real-world transaction data from the steel manufacturing industry. The results demonstrate that the accurate identification of retail capabilities can facilitate inventory management under stochastic market conditions. Furthermore, the hierarchical framework can improve overall profits by coordinating production control actions under different retail strategies. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of International Journal of Production Research is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=185944312
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/00207543.2025.2452386
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 4504
    Subjects:
      – SubjectFull: Distribution planning
        Type: general
      – SubjectFull: Supply chain management
        Type: general
      – SubjectFull: Inventory control
        Type: general
      – SubjectFull: Production control
        Type: general
      – SubjectFull: Reinforcement learning
        Type: general
    Titles:
      – TitleFull: Hierarchical production control and distribution planning under retail uncertainty with reinforcement learning.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Deng, Yang
      – PersonEntity:
          Name:
            NameFull: Chow, Andy H. F.
      – PersonEntity:
          Name:
            NameFull: Yan, Yimo
      – PersonEntity:
          Name:
            NameFull: Su, Zicheng
      – PersonEntity:
          Name:
            NameFull: Zhou, Zhili
      – PersonEntity:
          Name:
            NameFull: Kuo, Yong-Hong
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 15
              M: 06
              Text: Jun2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 00207543
          Numbering:
            – Type: volume
              Value: 63
            – Type: issue
              Value: 12
          Titles:
            – TitleFull: International Journal of Production Research
              Type: main
ResultId 1