An Introduction to Optimal Control Theory - Onésimo Hernández-Lerma, Leonardo R. Laura-Guarachi, Saul Mendoza-Palacios, David González-Sánchez

An Introduction to Optimal Control Theory

The Dynamic Programming Approach
Buch | Softcover
XV, 273 Seiten
2024 | 2023
Springer International Publishing (Verlag)
978-3-031-21141-6 (ISBN)
64,19 inkl. MwSt

This book introduces optimal control problems for large families of deterministic and stochastic systems with discrete or continuous time parameter. These families include most of the systems studied in many disciplines, including Economics, Engineering, Operations Research, and Management Science, among many others.

The main objective is to give a concise, systematic, and reasonably self contained presentation of some key topics in optimal control theory. To this end, most of the analyses are based on the dynamic programming (DP) technique. This technique is applicable to almost all control problems that appear in theory and applications. They include, for instance, finite and infinite horizon control problems in which the underlying dynamic system follows either a deterministic or stochastic difference or differential equation. In the infinite horizon case, it also uses DP to study undiscounted problems, such as the ergodic or long-run average cost.

 After a general introduction to control problems, the book covers the topic dividing into four parts with different dynamical systems: control of discrete-time deterministic systems, discrete-time stochastic systems, ordinary differential equations, and finally a general continuous-time MCP with applications for stochastic differential equations.

The first and second part should be accessible to undergraduate students with some knowledge of elementary calculus, linear algebra, and some concepts from probability theory (random variables, expectations, and so forth). Whereas the third and fourth part would be appropriate for advanced undergraduates or graduate students who have a working knowledge of mathematical analysis (derivatives, integrals, ...) and stochastic processes.



David Gonzalez-Sanchez is an associate professor at the Mathematics Department of Universidad de Sonora and CONACYT, Mexico. He obtained a PhD degree in mathematics at CINVESTAV-IPN and a Masters in Economics at CIDE, both in Mexico. His main research interests are optimal control and game theory as well as some of its applications.
Onésimo Henández-Lerma is a researcher in topics related to discrete- and continuous-time stochastic control problems and dynamic games. He is a member of the Inaugural Class of Fellows of the American Mathematical Society.
Leonardo Laura-Guarachi received the  Ph. D. degree in Mathematical Sciences from the Universidad Nacional Autónoma de México. Currently he is an associate professor at the SEPI-ESE-IPN.  His research interests include optimal control problems, dynamic games, and their applications.

Saul Mendoza-Palacios is a researcher at the Center for Economic Studies of El Colegio de México. He concluded his doctoral studies at the Mathematics Department of CINVESTAV-IPN. His research interest are in evolutionary games, optimal transport theory in market matching models, optimal control, and applications in economics.

Introduction: optimal control problems-. Discrete-time deterministic systems.- Discrete-time stochastic control systems.- Continuous-time deterministic systems.- Continuous-time Markov control processes.- Controlled diffusion processes.- Appendices.- Bibliography.- Index.

"This book is an introduction to optimal control theory, including deterministic and stochastic systems, with discrete-time and continuous-time parameters. The presentation of the book is very clear and no previous knowledge of control theory is required." (Hui Zhao, Mathematical Reviews, February, 2024)

Erscheinungsdatum
Reihe/Serie Texts in Applied Mathematics
Zusatzinfo XV, 273 p. 4 illus., 1 illus. in color.
Verlagsort Cham
Sprache englisch
Maße 155 x 235 mm
Themenwelt Mathematik / Informatik Mathematik Wahrscheinlichkeit / Kombinatorik
Schlagworte Controlled diffusion processes • Discounted cost problems • Dynamic Programming • Long-run average cost problems • Markov control processes
ISBN-10 3-031-21141-3 / 3031211413
ISBN-13 978-3-031-21141-6 / 9783031211416
Zustand Neuware
Haben Sie eine Frage zum Produkt?
Mehr entdecken
aus dem Bereich

von Jim Sizemore; John Paul Mueller

Buch | Softcover (2024)
Wiley-VCH (Verlag)
28,00
Eine Einführung in die faszinierende Welt des Zufalls

von Norbert Henze

Buch | Softcover (2024)
Springer Spektrum (Verlag)
39,99