Exploiting Environment Configurability in Reinforcement Learning
Saved in:
| Title: | Exploiting Environment Configurability in Reinforcement Learning |
|---|---|
| Description: | In recent decades, Reinforcement Learning (RL) has emerged as an effective approach to address complex control tasks. In a Markov Decision Process (MDP), the framework typically used, the environment is assumed to be a fixed entity that cannot be altered externally. There are, however, several real-world scenarios in which the environment can be modified to a limited extent. This book, Exploiting Environment Configurability in Reinforcement Learning, aims to formalize and study diverse aspects of environment configuration. In a traditional MDP, the agent perceives the state of the environment and performs actions. As a consequence, the environment transitions to a new state and generates a reward signal. The goal of the agent consists of learning a policy, i.e., a prescription of actions that maximize the long-term reward. Although environment configuration arises quite often in real applications, the topic is very little explored in the literature. The contributions in the book are theoretical, algorithmic, and experimental and can be broadly subdivided into three parts. The first part introduces the novel formalism of Configurable Markov Decision Processes (Conf-MDPs) to model the configuration opportunities offered by the environment. The second part of the book focuses on the cooperative Conf-MDP setting and investigates the problem of finding an agent policy and an environment configuration that jointly optimize the long-term reward. The third part addresses two specific applications of the Conf-MDP framework: policy space identification and control frequency adaptation. The book will be of interest to all those using RL as part of their work. |
| Authors: | Alberto Maria Metelli |
| Resource Type: | eBook. |
| Subjects: | Reinforcement learning |
| Categories: | COMPUTERS / Computer Science |
| Database: | eBook Collection (EBSCOhost) |
| FullText | Links: – Type: ebook-pdf Text: Availability: 0 |
|---|---|
| Header | DbId: nlebk DbLabel: eBook Collection (EBSCOhost) An: 3575340 RelevancyScore: 1110 AccessLevel: 6 PubType: eBook PubTypeId: ebook PreciseRelevancyScore: 1109.74133300781 |
| IllustrationInfo | |
| ImageInfo | – Size: thumb Target: https://rps2images.ebscohost.com/rpsweb/othumb?id=NL$3575340$PDF&s=r – Size: medium Target: https://rps2images.ebscohost.com/rpsweb/othumb?id=NL$3575340$PDF&s=d |
| Items | – Name: Title Label: Title Group: Ti Data: Exploiting Environment Configurability in Reinforcement Learning – Name: Abstract Label: Description Group: Ab Data: In recent decades, Reinforcement Learning (RL) has emerged as an effective approach to address complex control tasks. In a Markov Decision Process (MDP), the framework typically used, the environment is assumed to be a fixed entity that cannot be altered externally. There are, however, several real-world scenarios in which the environment can be modified to a limited extent. This book, Exploiting Environment Configurability in Reinforcement Learning, aims to formalize and study diverse aspects of environment configuration. In a traditional MDP, the agent perceives the state of the environment and performs actions. As a consequence, the environment transitions to a new state and generates a reward signal. The goal of the agent consists of learning a policy, i.e., a prescription of actions that maximize the long-term reward. Although environment configuration arises quite often in real applications, the topic is very little explored in the literature. The contributions in the book are theoretical, algorithmic, and experimental and can be broadly subdivided into three parts. The first part introduces the novel formalism of Configurable Markov Decision Processes (Conf-MDPs) to model the configuration opportunities offered by the environment. The second part of the book focuses on the cooperative Conf-MDP setting and investigates the problem of finding an agent policy and an environment configuration that jointly optimize the long-term reward. The third part addresses two specific applications of the Conf-MDP framework: policy space identification and control frequency adaptation. The book will be of interest to all those using RL as part of their work. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Alberto+Maria+Metelli%22">Alberto Maria Metelli</searchLink> – Name: TypePub Label: Resource Type Group: TypPub Data: eBook. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Reinforcement+learning%22">Reinforcement learning</searchLink> – Name: SubjectBISAC Label: Categories Group: Su Data: <searchLink fieldCode="ZK" term="%22COMPUTERS+%2F+Computer+Science%22">COMPUTERS / Computer Science</searchLink> |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=nlebk&AN=3575340 |
| RecordInfo | BibRecord: BibEntity: Classifications: – Code: 006.31 Scheme: ddc Type: prePub Languages: – Code: eng Text: English Subjects: – SubjectFull: Reinforcement learning Type: general Titles: – TitleFull: Exploiting Environment Configurability in Reinforcement Learning Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Alberto Maria Metelli – PersonEntity: Name: NameFull: Alberto Maria Metelli IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2022 – D: 25 M: 03 Type: profile Y: 2023 Identifiers: – Type: isbn-print Value: 9781643683621 – Type: isbn-electronic Value: 9781643683638 Numbering: – Type: volume Value: 00361 Titles: – TitleFull: Exploiting Environment Configurability in Reinforcement Learning Type: main |
| ResultId | 1 |
