Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations

Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations
Author: Martino Bardi
Publisher: Springer Science & Business Media
Total Pages: 588
Release: 2009-05-21
Genre: Science
ISBN: 0817647554

This softcover book is a self-contained account of the theory of viscosity solutions for first-order partial differential equations of Hamilton–Jacobi type and its interplay with Bellman’s dynamic programming approach to optimal control and differential games. It will be of interest to scientists involved in the theory of optimal control of deterministic linear and nonlinear systems. The work may be used by graduate students and researchers in control theory both as an introductory textbook and as an up-to-date reference book.

Controlled Markov Processes and Viscosity Solutions

Controlled Markov Processes and Viscosity Solutions
Author: Wendell H. Fleming
Publisher: Springer Science & Business Media
Total Pages: 436
Release: 2006-02-04
Genre: Mathematics
ISBN: 0387310711

This book is an introduction to optimal stochastic control for continuous time Markov processes and the theory of viscosity solutions. It covers dynamic programming for deterministic optimal control problems, as well as to the corresponding theory of viscosity solutions. New chapters in this second edition introduce the role of stochastic optimal control in portfolio optimization and in pricing derivatives in incomplete markets and two-controller, zero-sum differential games.

Nonlinear Optimal Control Theory

Nonlinear Optimal Control Theory
Author: Leonard David Berkovitz
Publisher: CRC Press
Total Pages: 394
Release: 2012-08-25
Genre: Mathematics
ISBN: 1466560266

Nonlinear Optimal Control Theory presents a deep, wide-ranging introduction to the mathematical theory of the optimal control of processes governed by ordinary differential equations and certain types of differential equations with memory. Many examples illustrate the mathematical issues that need to be addressed when using optimal control techniques in diverse areas. Drawing on classroom-tested material from Purdue University and North Carolina State University, the book gives a unified account of bounded state problems governed by ordinary, integrodifferential, and delay systems. It also discusses Hamilton-Jacobi theory. By providing a sufficient and rigorous treatment of finite dimensional control problems, the book equips readers with the foundation to deal with other types of control problems, such as those governed by stochastic differential equations, partial differential equations, and differential games.

An Introduction To Viscosity Solutions for Fully Nonlinear PDE with Applications to Calculus of Variations in L∞

An Introduction To Viscosity Solutions for Fully Nonlinear PDE with Applications to Calculus of Variations in L∞
Author: Nikos Katzourakis
Publisher: Springer
Total Pages: 125
Release: 2014-11-26
Genre: Mathematics
ISBN: 3319128299

The purpose of this book is to give a quick and elementary, yet rigorous, presentation of the rudiments of the so-called theory of Viscosity Solutions which applies to fully nonlinear 1st and 2nd order Partial Differential Equations (PDE). For such equations, particularly for 2nd order ones, solutions generally are non-smooth and standard approaches in order to define a "weak solution" do not apply: classical, strong almost everywhere, weak, measure-valued and distributional solutions either do not exist or may not even be defined. The main reason for the latter failure is that, the standard idea of using "integration-by-parts" in order to pass derivatives to smooth test functions by duality, is not available for non-divergence structure PDE.

Viscosity Solutions and Applications

Viscosity Solutions and Applications
Author: Martino Bardi
Publisher: Springer
Total Pages: 268
Release: 2006-11-13
Genre: Mathematics
ISBN: 3540690433

The volume comprises five extended surveys on the recent theory of viscosity solutions of fully nonlinear partial differential equations, and some of its most relevant applications to optimal control theory for deterministic and stochastic systems, front propagation, geometric motions and mathematical finance. The volume forms a state-of-the-art reference on the subject of viscosity solutions, and the authors are among the most prominent specialists. Potential readers are researchers in nonlinear PDE's, systems theory, stochastic processes.

Stochastic Optimal Control in Infinite Dimension

Stochastic Optimal Control in Infinite Dimension
Author: Giorgio Fabbri
Publisher: Springer
Total Pages: 928
Release: 2017-06-22
Genre: Mathematics
ISBN: 3319530674

Providing an introduction to stochastic optimal control in infinite dimension, this book gives a complete account of the theory of second-order HJB equations in infinite-dimensional Hilbert spaces, focusing on its applicability to associated stochastic optimal control problems. It features a general introduction to optimal stochastic control, including basic results (e.g. the dynamic programming principle) with proofs, and provides examples of applications. A complete and up-to-date exposition of the existing theory of viscosity solutions and regular solutions of second-order HJB equations in Hilbert spaces is given, together with an extensive survey of other methods, with a full bibliography. In particular, Chapter 6, written by M. Fuhrman and G. Tessitore, surveys the theory of regular solutions of HJB equations arising in infinite-dimensional stochastic control, via BSDEs. The book is of interest to both pure and applied researchers working in the control theory of stochastic PDEs, and in PDEs in infinite dimension. Readers from other fields who want to learn the basic theory will also find it useful. The prerequisites are: standard functional analysis, the theory of semigroups of operators and its use in the study of PDEs, some knowledge of the dynamic programming approach to stochastic optimal control problems in finite dimension, and the basics of stochastic analysis and stochastic equations in infinite-dimensional spaces.

Viscosity Methods in Optimal Control of Distributed Systems

Viscosity Methods in Optimal Control of Distributed Systems
Author: Emmanuel N. Barron
Publisher:
Total Pages: 4
Release: 1987
Genre:
ISBN:

The rigorous connection between viscosity solutions for the Bellman equation in optimal control and the Pontryagin Maximum Principle has been established. The method developed for controlled ordinary differential equations was extended to infinite dimensions to derive the Pontryagin principle for 1) a class of controlled nonlinear evolution equations in a Hilbert space, 2) a class of controlled nonlinear, divergence form parabolic partial differential equations; and 3) a class of differential-difference equations. Additional subjects were studied were the extension of the idea of viscosity solution to equations with only time-measureable Hamiltonians and the optimal cooling of a free boundary problem with Stefan problem dynamics. Two problems of interest in specific applications were solved. The optimal control is characterized in the class of monotone functions which minimizes the H1 distance to a given function. This problem, a specific monotone follower problem, arises in production planning. An optimal portfolio selection problem is considered which includes stock, options, bonds and borrowed cash at an interest rate different from the bond interest rate. This problem is formulated using stochastic optimal control and explicitly constructed the solution of the Bellman equation. The objective of the study was to derive the option price which the market sets to minimize the investor's maximal expected utility of wealth.

Numerical Methods For Viscosity Solutions And Applications

Numerical Methods For Viscosity Solutions And Applications
Author: Maurizio Falcone
Publisher: World Scientific
Total Pages: 249
Release: 2001-08-30
Genre: Mathematics
ISBN: 9814490377

The volume contains twelve papers dealing with the approximation of first and second order problems which arise in many fields of application including optimal control, image processing, geometrical optics and front propagation. Some contributions deal with new algorithms and technical issues related to their implementation. Other contributions are more theoretical, dealing with the convergence of approximation schemes. Many test problems have been examined to evaluate the performances of the algorithms. The volume can attract readers involved in the numerical approximation of differential models in the above-mentioned fields of applications, engineers, graduate students as well as researchers in numerical analysis.