Control and System Theory of Discrete-Time Stochastic Systems

Control and System Theory of Discrete-Time Stochastic Systems
Author: Jan H. van Schuppen
Publisher: Springer Nature
Total Pages: 940
Release: 2021-08-02
Genre: Technology & Engineering
ISBN: 3030669521

This book helps students, researchers, and practicing engineers to understand the theoretical framework of control and system theory for discrete-time stochastic systems so that they can then apply its principles to their own stochastic control systems and to the solution of control, filtering, and realization problems for such systems. Applications of the theory in the book include the control of ships, shock absorbers, traffic and communications networks, and power systems with fluctuating power flows. The focus of the book is a stochastic control system defined for a spectrum of probability distributions including Bernoulli, finite, Poisson, beta, gamma, and Gaussian distributions. The concepts of observability and controllability of a stochastic control system are defined and characterized. Each output process considered is, with respect to conditions, represented by a stochastic system called a stochastic realization. The existence of a control law is related to stochastic controllability while the existence of a filter system is related to stochastic observability. Stochastic control with partial observations is based on the existence of a stochastic realization of the filtration of the observed process.​

Finite Approximations in Discrete-Time Stochastic Control

Finite Approximations in Discrete-Time Stochastic Control
Author: Naci Saldi
Publisher: Birkhäuser
Total Pages: 196
Release: 2018-05-11
Genre: Mathematics
ISBN: 3319790331

In a unified form, this monograph presents fundamental results on the approximation of centralized and decentralized stochastic control problems, with uncountable state, measurement, and action spaces. It demonstrates how quantization provides a system-independent and constructive method for the reduction of a system with Borel spaces to one with finite state, measurement, and action spaces. In addition to this constructive view, the book considers both the information transmission approach for discretization of actions, and the computational approach for discretization of states and actions. Part I of the text discusses Markov decision processes and their finite-state or finite-action approximations, while Part II builds from there to finite approximations in decentralized stochastic control problems. This volume is perfect for researchers and graduate students interested in stochastic controls. With the tools presented, readers will be able to establish the convergence of approximation models to original models and the methods are general enough that researchers can build corresponding approximation results, typically with no additional assumptions.

Reporter

Reporter
Author: University of Michigan. Division of Research Development and Administration
Publisher:
Total Pages: 762
Release: 1979
Genre: Research
ISBN:

Fundamentals of Stochastic Filtering

Fundamentals of Stochastic Filtering
Author: Alan Bain
Publisher: Springer Science & Business Media
Total Pages: 395
Release: 2008-10-08
Genre: Mathematics
ISBN: 0387768963

This book provides a rigorous mathematical treatment of the non-linear stochastic filtering problem using modern methods. Particular emphasis is placed on the theoretical analysis of numerical methods for the solution of the filtering problem via particle methods. The book should provide sufficient background to enable study of the recent literature. While no prior knowledge of stochastic filtering is required, readers are assumed to be familiar with measure theory, probability theory and the basics of stochastic processes. Most of the technical results that are required are stated and proved in the appendices. Exercises and solutions are included.

Foundations of Deterministic and Stochastic Control

Foundations of Deterministic and Stochastic Control
Author: Jon H. Davis
Publisher: Springer Science & Business Media
Total Pages: 434
Release: 2012-12-06
Genre: Mathematics
ISBN: 1461200717

"This volume is a textbook on linear control systems with an emphasis on stochastic optimal control with solution methods using spectral factorization in line with the original approach of N. Wiener. Continuous-time and discrete-time versions are presented in parallel.... Two appendices introduce functional analytic concepts and probability theory, and there are 77 references and an index. The chapters (except for the last two) end with problems.... [T]he book presents in a clear way important concepts of control theory and can be used for teaching." —Zentralblatt Math "This is a textbook intended for use in courses on linear control and filtering and estimation on (advanced) levels. Its major purpose is an introduction to both deterministic and stochastic control and estimation. Topics are treated in both continuous time and discrete time versions.... Each chapter involves problems and exercises, and the book is supplemented by appendices, where fundamentals on Hilbert and Banach spaces, operator theory, and measure theoretic probability may be found. The book will be very useful for students, but also for a variety of specialists interested in deterministic and stochastic control and filtering." —Applications of Mathematics "The strength of the book under review lies in the choice of specialized topics it contains, which may not be found in this form elsewhere. Also, the first half would make a good standard course in linear control." —Journal of the Indian Institute of Science

College of Engineering

College of Engineering
Author: University of Michigan. College of Engineering
Publisher: UM Libraries
Total Pages: 796
Release: 1978
Genre: Engineering schools
ISBN:

Linear Stochastic Systems

Linear Stochastic Systems
Author: Peter E. Caines
Publisher: SIAM
Total Pages: 892
Release: 2018-06-12
Genre: Mathematics
ISBN: 1611974712

Linear Stochastic Systems, originally published in 1988, is today as comprehensive a reference to the theory of linear discrete-time-parameter systems as ever. Its most outstanding feature is the unified presentation, including both input-output and state space representations of stochastic linear systems, together with their interrelationships. The author first covers the foundations of linear stochastic systems and then continues through to more sophisticated topics including the fundamentals of stochastic processes and the construction of stochastic systems; an integrated exposition of the theories of prediction, realization (modeling), parameter estimation, and control; and a presentation of stochastic adaptive control theory. Written in a clear, concise manner and accessible to graduate students, researchers, and teachers, this classic volume also includes background material to make it self-contained and has complete proofs for all the principal results of the book. Furthermore, this edition includes many corrections of errata collected over the years.

Mathematical Control Theory

Mathematical Control Theory
Author: Eduardo D. Sontag
Publisher: Springer Science & Business Media
Total Pages: 543
Release: 2013-11-21
Genre: Mathematics
ISBN: 1461205778

Geared primarily to an audience consisting of mathematically advanced undergraduate or beginning graduate students, this text may additionally be used by engineering students interested in a rigorous, proof-oriented systems course that goes beyond the classical frequency-domain material and more applied courses. The minimal mathematical background required is a working knowledge of linear algebra and differential equations. The book covers what constitutes the common core of control theory and is unique in its emphasis on foundational aspects. While covering a wide range of topics written in a standard theorem/proof style, it also develops the necessary techniques from scratch. In this second edition, new chapters and sections have been added, dealing with time optimal control of linear systems, variational and numerical approaches to nonlinear control, nonlinear controllability via Lie-algebraic methods, and controllability of recurrent nets and of linear systems with bounded controls.