Knowledge-guided deep reinforcement learning framework for feature machining step sequencing.

Saved in:
Bibliographic Details
Title: Knowledge-guided deep reinforcement learning framework for feature machining step sequencing.
Authors: Wang, Pengyu1 (AUTHOR), You, Youpeng2 (AUTHOR), Liu, Weichao3 (AUTHOR), Ding, Dawei1 (AUTHOR), Xu, Fengyu1 (AUTHOR) 13915964356@njupt.edu.cn
Source: International Journal of Advanced Manufacturing Technology. Oct2025, Vol. 140 Issue 9/10, p5617-5636. 20p.
Subjects: Computer-aided process planning, Machining, Feature selection, Expertise, Reinforcement learning, Economic efficiency
Abstract: Machining sequencing is a critical step in computer-aided process planning (CAPP) for numerical control (NC) machining, directly impacting efficiency and cost. Consequently, the machining sequencing method is crucial for practical manufacturing processes. However, existing sequencing methods face two main limitations: (1) they often treat machining features (MFs) as the smallest unit, neglecting that complex features require decomposition into sub-features and multiple feature machining steps (FMSs); (2) while exact methods are very time-consuming, prevailing approximate methods suffer from inconsistent performance, repeated iterative computations, and an inability to learn from experience. To address these challenges, this paper proposes a knowledge-guided deep reinforcement learning (DRL) framework for FMS-level sequencing. The method incorporates dynamic selection masks to enforce machining constraints and a process knowledge-based cost model to ensure efficient convergence. Leveraging the sequencing experience acquired during the learning process, this method can solve the machining sequencing problem within an acceptable computation time. Experiments demonstrate that the proposed method outperforms existing methods in both total cost and computation time, enabling more efficient machining of complex parts. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Advanced Manufacturing Technology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 188627050
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Knowledge-guided deep reinforcement learning framework for feature machining step sequencing.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wang%2C+Pengyu%22">Wang, Pengyu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22You%2C+Youpeng%22">You, Youpeng</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Liu%2C+Weichao%22">Liu, Weichao</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ding%2C+Dawei%22">Ding, Dawei</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Xu%2C+Fengyu%22">Xu, Fengyu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> 13915964356@njupt.edu.cn</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Advanced+Manufacturing+Technology%22">International Journal of Advanced Manufacturing Technology</searchLink>. Oct2025, Vol. 140 Issue 9/10, p5617-5636. 20p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer-aided+process+planning%22">Computer-aided process planning</searchLink><br /><searchLink fieldCode="DE" term="%22Machining%22">Machining</searchLink><br /><searchLink fieldCode="DE" term="%22Feature+selection%22">Feature selection</searchLink><br /><searchLink fieldCode="DE" term="%22Expertise%22">Expertise</searchLink><br /><searchLink fieldCode="DE" term="%22Reinforcement+learning%22">Reinforcement learning</searchLink><br /><searchLink fieldCode="DE" term="%22Economic+efficiency%22">Economic efficiency</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Machining sequencing is a critical step in computer-aided process planning (CAPP) for numerical control (NC) machining, directly impacting efficiency and cost. Consequently, the machining sequencing method is crucial for practical manufacturing processes. However, existing sequencing methods face two main limitations: (1) they often treat machining features (MFs) as the smallest unit, neglecting that complex features require decomposition into sub-features and multiple feature machining steps (FMSs); (2) while exact methods are very time-consuming, prevailing approximate methods suffer from inconsistent performance, repeated iterative computations, and an inability to learn from experience. To address these challenges, this paper proposes a knowledge-guided deep reinforcement learning (DRL) framework for FMS-level sequencing. The method incorporates dynamic selection masks to enforce machining constraints and a process knowledge-based cost model to ensure efficient convergence. Leveraging the sequencing experience acquired during the learning process, this method can solve the machining sequencing problem within an acceptable computation time. Experiments demonstrate that the proposed method outperforms existing methods in both total cost and computation time, enabling more efficient machining of complex parts. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of International Journal of Advanced Manufacturing Technology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=188627050
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s00170-025-16606-4
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 5617
    Subjects:
      – SubjectFull: Computer-aided process planning
        Type: general
      – SubjectFull: Machining
        Type: general
      – SubjectFull: Feature selection
        Type: general
      – SubjectFull: Expertise
        Type: general
      – SubjectFull: Reinforcement learning
        Type: general
      – SubjectFull: Economic efficiency
        Type: general
    Titles:
      – TitleFull: Knowledge-guided deep reinforcement learning framework for feature machining step sequencing.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Wang, Pengyu
      – PersonEntity:
          Name:
            NameFull: You, Youpeng
      – PersonEntity:
          Name:
            NameFull: Liu, Weichao
      – PersonEntity:
          Name:
            NameFull: Ding, Dawei
      – PersonEntity:
          Name:
            NameFull: Xu, Fengyu
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 15
              M: 10
              Text: Oct2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 02683768
          Numbering:
            – Type: volume
              Value: 140
            – Type: issue
              Value: 9/10
          Titles:
            – TitleFull: International Journal of Advanced Manufacturing Technology
              Type: main
ResultId 1