Constrained Markov Decision Processes

Citations Over TimeTop 1% of 2021 papers

Abstract

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other.

Related Papers

• → Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short Paper)(2017)11,253 cited
• → Nonlinear Programming(1997)10,911 cited
• → Reward Constrained Policy Optimization(2018)235 cited