Sequential Monte Carlo Methods for Nonlinear Discrete-Time Filtering

Sequential Monte Carlo Methods for Nonlinear Discrete-Time Filtering
Author: Marcelo G.
Publisher: Springer Nature
Total Pages: 87
Release: 2022-06-01
Genre: Technology & Engineering
ISBN: 3031025350

In these notes, we introduce particle filtering as a recursive importance sampling method that approximates the minimum-mean-square-error (MMSE) estimate of a sequence of hidden state vectors in scenarios where the joint probability distribution of the states and the observations is non-Gaussian and, therefore, closed-form analytical expressions for the MMSE estimate are generally unavailable. We begin the notes with a review of Bayesian approaches to static (i.e., time-invariant) parameter estimation. In the sequel, we describe the solution to the problem of sequential state estimation in linear, Gaussian dynamic models, which corresponds to the well-known Kalman (or Kalman-Bucy) filter. Finally, we move to the general nonlinear, non-Gaussian stochastic filtering problem and present particle filtering as a sequential Monte Carlo approach to solve that problem in a statistically optimal way. We review several techniques to improve the performance of particle filters, including importance function optimization, particle resampling, Markov Chain Monte Carlo move steps, auxiliary particle filtering, and regularized particle filtering. We also discuss Rao-Blackwellized particle filtering as a technique that is particularly well-suited for many relevant applications such as fault detection and inertial navigation. Finally, we conclude the notes with a discussion on the emerging topic of distributed particle filtering using multiple processors located at remote nodes in a sensor network. Throughout the notes, we often assume a more general framework than in most introductory textbooks by allowing either the observation model or the hidden state dynamic model to include unknown parameters. In a fully Bayesian fashion, we treat those unknown parameters also as random variables. Using suitable dynamic conjugate priors, that approach can be applied then to perform joint state and parameter estimation. Table of Contents: Introduction / Bayesian Estimation of Static Vectors / The Stochastic Filtering Problem / Sequential Monte Carlo Methods / Sampling/Importance Resampling (SIR) Filter / Importance Function Selection / Markov Chain Monte Carlo Move Step / Rao-Blackwellized Particle Filters / Auxiliary Particle Filter / Regularized Particle Filters / Cooperative Filtering with Multiple Observers / Application Examples / Summary

Sequential Monte Carlo Methods for Nonlinear Discrete-time Filtering

Sequential Monte Carlo Methods for Nonlinear Discrete-time Filtering
Author: Marcelo G. S. Bruno
Publisher: Morgan & Claypool Publishers
Total Pages: 101
Release: 2013
Genre: Computers
ISBN: 1627051198

In these notes, we introduce particle filtering as a recursive importance sampling method that approximates the minimum-mean-square-error (MMSE) estimate of a sequence of hidden state vectors in scenarios where the joint probability distribution of the states and the observations is non-Gaussian and, therefore, closed-form analytical expressions for the MMSE estimate are generally unavailable. We begin the notes with a review of Bayesian approaches to static (i.e., time-invariant) parameter estimation. In the sequel, we describe the solution to the problem of sequential state estimation in linear, Gaussian dynamic models, which corresponds to the well-known Kalman (or Kalman-Bucy) filter. Finally, we move to the general nonlinear, non-Gaussian stochastic filtering problem and present particle filtering as a sequential Monte Carlo approach to solve that problem in a statistically optimal way. We review several techniques to improve the performance of particle filters, including importance function optimization, particle resampling, Markov Chain Monte Carlo move steps, auxiliary particle filtering, and regularized particle filtering. We also discuss Rao-Blackwellized particle filtering as a technique that is particularly well-suited for many relevant applications such as fault detection and inertial navigation. Finally, we conclude the notes with a discussion on the emerging topic of distributed particle filtering using multiple processors located at remote nodes in a sensor network. Throughout the notes, we often assume a more general framework than in most introductory textbooks by allowing either the observation model or the hidden state dynamic model to include unknown parameters. In a fully Bayesian fashion, we treat those unknown parameters also as random variables. Using suitable dynamic conjugate priors, that approach can be applied then to perform joint state and parameter estimation.

Sequential Monte Carlo Methods in Practice

Sequential Monte Carlo Methods in Practice
Author: Arnaud Doucet
Publisher: Springer Science & Business Media
Total Pages: 590
Release: 2013-03-09
Genre: Mathematics
ISBN: 1475734379

Monte Carlo methods are revolutionizing the on-line analysis of data in many fileds. They have made it possible to solve numerically many complex, non-standard problems that were previously intractable. This book presents the first comprehensive treatment of these techniques.

Monte Carlo Methods and Applications

Monte Carlo Methods and Applications
Author: Karl K. Sabelfeld
Publisher: Walter de Gruyter
Total Pages: 248
Release: 2012-12-06
Genre: Mathematics
ISBN: 3110293587

This is the proceedings of the "8th IMACS Seminar on Monte Carlo Methods" held from August 29 to September 2, 2011 in Borovets, Bulgaria, and organized by the Institute of Information and Communication Technologies of the Bulgarian Academy of Sciences in cooperation with the International Association for Mathematics and Computers in Simulation (IMACS). Included are 24 papers which cover all topics presented in the sessions of the seminar: stochastic computation and complexity of high dimensional problems, sensitivity analysis, high-performance computations for Monte Carlo applications, stochastic metaheuristics for optimization problems, sequential Monte Carlo methods for large-scale problems, semiconductor devices and nanostructures. The history of the IMACS Seminar on Monte Carlo Methods goes back to April 1997 when the first MCM Seminar was organized in Brussels: 1st IMACS Seminar, 1997, Brussels, Belgium 2nd IMACS Seminar, 1999, Varna, Bulgaria 3rd IMACS Seminar, 2001, Salzburg, Austria 4th IMACS Seminar, 2003, Berlin, Germany 5th IMACS Seminar, 2005, Tallahassee, USA 6th IMACS Seminar, 2007, Reading, UK 7th IMACS Seminar, 2009, Brussels, Belgium 8th IMACS Seminar, 2011, Borovets, Bulgaria

Signals and Images

Signals and Images
Author: Rosângela Fernandes Coelho
Publisher: CRC Press
Total Pages: 598
Release: 2018-09-03
Genre: Technology & Engineering
ISBN: 1498722377

Signals and Images: Advances and Results in Speech, Estimation, Compression, Recognition, Filtering, and Processing cohesively combines contributions from field experts to deliver a comprehensive account of the latest developments in signal processing. These experts detail the results of their research related to audio and speech enhancement, acoustic image estimation, video compression, biometric recognition, hyperspectral image analysis, tensor decomposition with applications in communications, adaptive sparse-interpolated filtering, signal processing for power line communications, bio-inspired signal processing, seismic data processing, arithmetic transforms for spectrum computation, particle filtering in cooperative networks, three-dimensional television, and more. This book not only shows how signal processing theory is applied in current and emerging technologies, but also demonstrates how to tackle key problems such as how to enhance speech in the time domain, improve audio quality, and meet the desired electrical consumption target for controlling carbon emissions. Signals and Images: Advances and Results in Speech, Estimation, Compression, Recognition, Filtering, and Processing serves as a guide to the next generation of signal processing solutions for speech and video coding, hearing aid devices, big data processing, smartphones, smart digital communications, acoustic sensors, and beyond.

Smartphone-Based Real-Time Digital Signal Processing

Smartphone-Based Real-Time Digital Signal Processing
Author: Nasser Kehtarnavaz
Publisher: Morgan & Claypool Publishers
Total Pages: 169
Release: 2018-12-17
Genre: Technology & Engineering
ISBN: 1681734664

Real-time or applied digital signal processing courses are offered as follow-ups to conventional or theory-oriented digital signal processing courses in many engineering programs for the purpose of teaching students the technical know-how for putting signal processing algorithms or theory into practical use. These courses normally involve access to a teaching laboratory that is equipped with hardware boards, in particular DSP boards, together with their supporting software. A number of textbooks have been written discussing how to achieve real-time implementation on these hardware boards. This book discusses how to use smartphones as hardware boards for real-time implementation of signal processing algorithms as an alternative to the hardware boards that are used in signal processing laboratory courses. The fact that mobile devices, in particular smartphones, have become powerful processing platforms led to the development of this book enabling students to use their own smartphones to run signal processing algorithms in real-time considering that these days nearly all students possess smartphones. Changing the hardware platforms that are currently used in applied or real-time signal processing courses to smartphones creates a truly mobile laboratory experience or environment for students. In addition, it relieves the cost burden associated with using dedicated signal processing boards noting that the software development tools for smartphones are free of charge and are well-maintained by smartphone manufacturers. This book is written in such a way that it can be used as a textbook for real-time or applied digital signal processing courses offered at many universities. Ten lab experiments that are commonly encountered in such courses are covered in the book. This book is written primarily for those who are already familiar with signal processing concepts and are interested in their real-time and practical aspects. Similar to existing real-time courses, knowledge of C programming is assumed. This book can also be used as a self-study guide for those who wish to become familiar with signal processing app development on either Android or iPhone smartphones.

Smartphone-Based Real-Time Digital Signal Processing, Third Edition

Smartphone-Based Real-Time Digital Signal Processing, Third Edition
Author: Abhishek Sehgal
Publisher: Springer Nature
Total Pages: 160
Release: 2022-05-31
Genre: Technology & Engineering
ISBN: 3031025431

Real-time or applied digital signal processing courses are offered as follow-ups to conventional or theory-oriented digital signal processing courses in many engineering programs for the purpose of teaching students the technical know-how for putting signal processing algorithms or theory into practical use. These courses normally involve access to a teaching laboratory that is equipped with hardware boards, in particular DSP boards, together with their supporting software. A number of textbooks have been written discussing how to achieve real-time implementation on these hardware boards. This book discusses how to use smartphones as hardware boards for real-time implementation of signal processing algorithms, thus providing an alternative to the hardware boards that are used in signal processing laboratory courses. The fact that mobile devices, in particular smartphones, have become powerful processing platforms led to the development of this book to enable students to use their own smartphones to run signal processing algorithms in real-time considering that these days nearly all students possess smartphones. Changing the hardware platforms that are currently used in applied or real-time signal processing courses to smartphones creates a truly flexible laboratory experience or environment for students. In addition, it relieves the cost burden associated with using dedicated signal processing boards noting that the software development tools for smartphones are free of charge and are well-maintained by smartphone manufacturers. This book is written in such a way that it can be used as a textbook for real-time or applied digital signal processing courses offered at many universities. Ten lab experiments that are commonly encountered in such courses are covered in the book. It is written primarily for those who are already familiar with signal processing concepts and are interested in their real-time and practical aspects. Similar to existing real-time courses, knowledge of C programming is assumed. This book can also be used as a self-study guide for those who wish to become familiar with signal processing app development on either Android or iOS smartphones/tablets.

Discrete Time Systems

Discrete Time Systems
Author: Mario Alberto Jordán
Publisher: BoD – Books on Demand
Total Pages: 541
Release: 2011-04-26
Genre: Computers
ISBN: 9533072008

Discrete-Time Systems comprehend an important and broad research field. The consolidation of digital-based computational means in the present, pushes a technological tool into the field with a tremendous impact in areas like Control, Signal Processing, Communications, System Modelling and related Applications. This book attempts to give a scope in the wide area of Discrete-Time Systems. Their contents are grouped conveniently in sections according to significant areas, namely Filtering, Fixed and Adaptive Control Systems, Stability Problems and Miscellaneous Applications. We think that the contribution of the book enlarges the field of the Discrete-Time Systems with signification in the present state-of-the-art. Despite the vertiginous advance in the field, we also believe that the topics described here allow us also to look through some main tendencies in the next years in the research area.

Anywhere-Anytime Signals and Systems Laboratory

Anywhere-Anytime Signals and Systems Laboratory
Author: Fatemeh Saki
Publisher: Springer Nature
Total Pages: 256
Release: 2022-05-31
Genre: Technology & Engineering
ISBN: 3031025423

A typical undergraduate electrical engineering curriculum incorporates a signals and systems course. The widely used approach for the laboratory component of such courses involves the utilization of MATLAB to implement signals and systems concepts. This book presents a newly developed laboratory paradigm where MATLAB codes are made to run on smartphones which are possessed by nearly all students. As a result, this laboratory paradigm provides an anywhere-anytime hardware platform or processing board for students to learn implementation aspects of signals and systems concepts. The book covers the laboratory experiments that are normally covered in signals and systems courses and discusses how to run MATLAB codes for these experiments as apps on both Android and iOS smartphones, thus enabling a truly mobile laboratory paradigm. A zipped file of the codes discussed in the book can be acquired via the website http://sites.fastspring.com/bookcodes/product/SignalsSystemsBookcodesThirdEdition

An Introduction to Kalman Filtering with MATLAB Examples

An Introduction to Kalman Filtering with MATLAB Examples
Author: Narayan Kovvali
Publisher: Springer Nature
Total Pages: 71
Release: 2022-06-01
Genre: Technology & Engineering
ISBN: 3031025369

The Kalman filter is the Bayesian optimum solution to the problem of sequentially estimating the states of a dynamical system in which the state evolution and measurement processes are both linear and Gaussian. Given the ubiquity of such systems, the Kalman filter finds use in a variety of applications, e.g., target tracking, guidance and navigation, and communications systems. The purpose of this book is to present a brief introduction to Kalman filtering. The theoretical framework of the Kalman filter is first presented, followed by examples showing its use in practical applications. Extensions of the method to nonlinear problems and distributed applications are discussed. A software implementation of the algorithm in the MATLAB programming language is provided, as well as MATLAB code for several example applications discussed in the manuscript.