Variational Methods in Signal Decomposition and Image Processing

Variational Methods in Signal Decomposition and Image Processing
Author: Konstantin Dragomiretskiy
Publisher:
Total Pages: 164
Release: 2015
Genre:
ISBN:

The work presented in this dissertation is motivated by classical problems in signal and image processing from the perspective of variational and PDE-based methods. Analytically encoding qualitative features of signals into variational energies in conjunction with modern methods in sparse optimization allows for well-founded and robust models, the optimization of which yields meaningful and cohesive signal decomposition. Part I of this dissertation is based on joint work Variational Mode Decomposition [DZ14] with Dominique Zosso, in which the goal is to recursively decompose a signal into different modes of separate spectral bands, which are unknown beforehand. In the late nineties, Huang [HSL98] introduced the Hilbert-Huang transform, also known as Empirical Mode Decomposition, in order to decompose a signal into so-called intrinsic mode functions (IMF) along with a trend, and obtain instantaneous frequency data. The HHT/EMD algorithm is widely used today, although there is no exact mathematical model corresponding to this algorithm, and, consequently, the exact properties and limits are widely unknown. We propose an entirely non-recursive variational mode decomposition model, where the modes are extracted concurrently. The model looks for a number of modes and their respective center frequencies, such that the modes reproduce the input signal, while being smooth after demodulation into baseband. In Fourier domain, this corresponds to a narrow-band prior. Our model provides a solution to the decomposition problem that is theoretically well-founded, tractable, and motivated. The variational model is efficiently optimized using an alternating direction method of multipliers approach. Preliminary results show excellent performance with respect to existing mode decomposition models. Part II of this dissertation is the n-dimensional extension of the Variational Mode Decomposition. Decomposing multidimensional signals, such as images, into spatially compact, potentially overlapping modes of essentially wavelike nature makes these components accessible for further downstream analysis such as space-frequency analysis, demodulation, estimation of local orientation, edge and corner detection, texture analysis, denoising, inpainting, and curvature estimation. The model decomposes the input signal into modes with narrow Fourier bandwidth; to cope with sharp region boundaries, incompatible with narrow bandwidth, we introduce binary support functions that act as masks on the narrow-band mode for image re-composition. L1 and TV-terms promote sparsity and spatial compactness. Constraining the support functions to partitions of the signal domain, we effectively get an image segmentation model based on spectral homogeneity. By coupling several submodes together with a single support function we are able to decompose an image into several crystal grains. Our efficient algorithm is based on variable splitting and alternate direction optimization; we employ Merriman-Bence-Osher-like [MBO92] threshold dynamics to handle eciently the motion by mean curvature of the support function boundaries under the sparsity promoting terms. The versatility and effectiveness of our proposed model is demonstrated on a broad variety of example images from different modalities. These demonstrations include the decomposition of images into overlapping modes with smooth or sharp boundaries, segmentation of images of crystal grains, and inpainting of damaged image regions through artifact detection. Part III of this dissertation is based on joint work with Igor Yanovsky of NASA Jet Propulsion Laboratory. We introduce a variational method for destriping data acquired by pushbroom type satellite imaging systems. The model leverages sparsity in signals and is based on current research in sparse optimization and compressed sensing. It is based on the basic principles of regularization and data fidelity with certain constraints using modern methods in variational optimization - namely total variation (TV), both L1 and L2 fidelity, and the alternate direction method of multipliers. The main algorithm in Part III uses sparsity promoting energy functionals to achieve two important imaging effects. The TV term maintains boundary sharpness of content in the underlying clean image, while the L1 fidelity allows for the equitable removal of stripes without over- or under-penalization, providing a more accurate model of presumably independent sensors with unspecified and unrestricted bias distribution. A comparison is made between the TV-L1 and TV-L2 models to exemplify the qualitative efficacy of an L1 striping penalty. The model makes use of novel minimization splittings and proximal mapping operators, successfully yielding more realistic destriped images in very few iterations.

The Variational Bayes Method in Signal Processing

The Variational Bayes Method in Signal Processing
Author: Václav Šmídl
Publisher: Springer Science & Business Media
Total Pages: 241
Release: 2006-03-30
Genre: Technology & Engineering
ISBN: 3540288201

Treating VB approximation in signal processing, this monograph is for academic and industrial research groups in signal processing, data analysis, machine learning and identification. It reviews distributional approximation, showing that tractable algorithms for parametric model identification can be generated in off-line and on-line contexts.

Mathematical Methods for Signal and Image Analysis and Representation

Mathematical Methods for Signal and Image Analysis and Representation
Author: Luc Florack
Publisher: Springer Science & Business Media
Total Pages: 321
Release: 2012-01-13
Genre: Mathematics
ISBN: 1447123522

Mathematical Methods for Signal and Image Analysis and Representation presents the mathematical methodology for generic image analysis tasks. In the context of this book an image may be any m-dimensional empirical signal living on an n-dimensional smooth manifold (typically, but not necessarily, a subset of spacetime). The existing literature on image methodology is rather scattered and often limited to either a deterministic or a statistical point of view. In contrast, this book brings together these seemingly different points of view in order to stress their conceptual relations and formal analogies. Furthermore, it does not focus on specific applications, although some are detailed for the sake of illustration, but on the methodological frameworks on which such applications are built, making it an ideal companion for those seeking a rigorous methodological basis for specific algorithms as well as for those interested in the fundamental methodology per se. Covering many topics at the forefront of current research, including anisotropic diffusion filtering of tensor fields, this book will be of particular interest to graduate and postgraduate students and researchers in the fields of computer vision, medical imaging and visual perception.

Scale Space and Variational Methods in Computer Vision

Scale Space and Variational Methods in Computer Vision
Author: François Lauze
Publisher: Springer
Total Pages: 712
Release: 2017-05-16
Genre: Computers
ISBN: 3319587714

This book constitutes the refereed proceedings of the 6th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2017, held in Kolding, Denmark, in June 2017. The 55 revised full papers presented were carefully reviewed and selected from 77 submissions. The papers are organized in the following topical sections: Scale Space and PDE Methods; Restoration and Reconstruction; Tomographic Reconstruction; Segmentation; Convex and Non-Convex Modeling and Optimization in Imaging; Optical Flow, Motion Estimation and Registration; 3D Vision.

Variational Methods

Variational Methods
Author: Maïtine Bergounioux
Publisher: Walter de Gruyter GmbH & Co KG
Total Pages: 621
Release: 2017-01-11
Genre: Mathematics
ISBN: 3110430495

With a focus on the interplay between mathematics and applications of imaging, the first part covers topics from optimization, inverse problems and shape spaces to computer vision and computational anatomy. The second part is geared towards geometric control and related topics, including Riemannian geometry, celestial mechanics and quantum control. Contents: Part I Second-order decomposition model for image processing: numerical experimentation Optimizing spatial and tonal data for PDE-based inpainting Image registration using phase・amplitude separation Rotation invariance in exemplar-based image inpainting Convective regularization for optical flow A variational method for quantitative photoacoustic tomography with piecewise constant coefficients On optical flow models for variational motion estimation Bilevel approaches for learning of variational imaging models Part II Non-degenerate forms of the generalized Euler・Lagrange condition for state-constrained optimal control problems The Purcell three-link swimmer: some geometric and numerical aspects related to periodic optimal controls Controllability of Keplerian motion with low-thrust control systems Higher variational equation techniques for the integrability of homogeneous potentials Introduction to KAM theory with a view to celestial mechanics Invariants of contact sub-pseudo-Riemannian structures and Einstein・Weyl geometry Time-optimal control for a perturbed Brockett integrator Twist maps and Arnold diffusion for diffeomorphisms A Hamiltonian approach to sufficiency in optimal control with minimal regularity conditions: Part I Index

Variational Methods in Image Segmentation

Variational Methods in Image Segmentation
Author: Jean-Michel Morel
Publisher: Springer Science & Business Media
Total Pages: 257
Release: 2012-12-06
Genre: Mathematics
ISBN: 1468405675

This book contains both a synthesis and mathematical analysis of a wide set of algorithms and theories whose aim is the automatic segmen tation of digital images as well as the understanding of visual perception. A common formalism for these theories and algorithms is obtained in a variational form. Thank to this formalization, mathematical questions about the soundness of algorithms can be raised and answered. Perception theory has to deal with the complex interaction between regions and "edges" (or boundaries) in an image: in the variational seg mentation energies, "edge" terms compete with "region" terms in a way which is supposed to impose regularity on both regions and boundaries. This fact was an experimental guess in perception phenomenology and computer vision until it was proposed as a mathematical conjecture by Mumford and Shah. The third part of the book presents a unified presentation of the evi dences in favour of the conjecture. It is proved that the competition of one-dimensional and two-dimensional energy terms in a variational for mulation cannot create fractal-like behaviour for the edges. The proof of regularity for the edges of a segmentation constantly involves con cepts from geometric measure theory, which proves to be central in im age processing theory. The second part of the book provides a fast and self-contained presentation of the classical theory of rectifiable sets (the "edges") and unrectifiable sets ("fractals").

Variational Methods in Image Processing

Variational Methods in Image Processing
Author: Luminita A. Vese
Publisher: CRC Press
Total Pages: 416
Release: 2015-11-18
Genre: Computers
ISBN: 1439849749

Variational Methods in Image Processing presents the principles, techniques, and applications of variational image processing. The text focuses on variational models, their corresponding Euler-Lagrange equations, and numerical implementations for image processing. It balances traditional computational models with more modern techniques that solve t

Variational Methods in Imaging

Variational Methods in Imaging
Author: Otmar Scherzer
Publisher: Springer Science & Business Media
Total Pages: 323
Release: 2008-10-09
Genre: Mathematics
ISBN: 0387309314

This book is devoted to the study of variational methods in imaging. The presentation is mathematically rigorous and covers a detailed treatment of the approach from an inverse problems point of view. Many numerical examples accompany the theory throughout the text. It is geared towards graduate students and researchers in applied mathematics. Researchers in the area of imaging science will also find this book appealing. It can serve as a main text in courses in image processing or as a supplemental text for courses on regularization and inverse problems at the graduate level.

Regularization and Bayesian Methods for Inverse Problems in Signal and Image Processing

Regularization and Bayesian Methods for Inverse Problems in Signal and Image Processing
Author: Jean-Francois Giovannelli
Publisher: John Wiley & Sons
Total Pages: 322
Release: 2015-02-16
Genre: Technology & Engineering
ISBN: 1848216378

The focus of this book is on "ill-posed inverse problems". These problems cannot be solved only on the basis of observed data. The building of solutions involves the recognition of other pieces of a priori information. These solutions are then specific to the pieces of information taken into account. Clarifying and taking these pieces of information into account is necessary for grasping the domain of validity and the field of application for the solutions built. For too long, the interest in these problems has remained very limited in the signal-image community. However, the community has since recognized that these matters are more interesting and they have become the subject of much greater enthusiasm. From the application field’s point of view, a significant part of the book is devoted to conventional subjects in the field of inversion: biological and medical imaging, astronomy, non-destructive evaluation, processing of video sequences, target tracking, sensor networks and digital communications. The variety of chapters is also clear, when we examine the acquisition modalities at stake: conventional modalities, such as tomography and NMR, visible or infrared optical imaging, or more recent modalities such as atomic force imaging and polarized light imaging.