A Study of Image Segmentation and Decomposition Models in a Variational Approach

A Study of Image Segmentation and Decomposition Models in a Variational Approach
Author: Triet Minh Le
Publisher:
Total Pages: 270
Release: 2006
Genre:
ISBN: 9780542880933

This manuscript consists of a study of image segmentation and decomposition models in a variational approach. In the segmentation case, we consider images that are corrupted by additive and multiplicative noise. In the additive case, we decompose the data f into the sum u + w + noise. Here, u is a piecewise-constant component, capturing edges and discontinuities, and it is modeled in a level set approach, while w is a smooth component, capturing the intensity inhomogeneities. The additive noise is removed from the initial data. In the multiplicative case, we consider a piecewise-constant segmentation model of the data corrupted by multiplicative noise, in a multiphase level set approach. The fidelity term is chosen appropriately for such degradation model. Then, we extend this model to piecewise-smooth segmentation, decomposing the data u into the product u · w · noise, where again u is piecewise-constant, while w is smooth. In the image decomposition case, we focus on the modeling of oscillatory components (texture or noise). In general, we decompose a given image f into u + v, with u a piecewise-smooth or "cartoon" component, and v an oscillatory component (texture or noise), in a variational approach. Y Meyer [Mey01] proposed refinements of the total variation model (L. Rudin, S. Osher and E. Fatemi [ROF92]) that better represent the oscillatory part v: the spaces of generalized functions G = div(Linfinity), F = div(BMO) = BM˙O -1, and E = B&d2;-1infinity,infinity have been proposed to model v, instead of the standard L2 space, while keeping u ∈ BV a function of bounded variation. D. Mumford and B. Gidas [MG01] also show that natural images can be seen as samples of scale invariant probability distributions that are supported on distributions only, and not on sets of functions. However, there is no simple solution to obtain in practice such decompositions f = u + v, when working with G, F, or E. We introduce energy minimization models to compute (BV, F) decompositions, and as a by-product we also introduce a simple model to realize the ( BV, G) decomposition. In particular, we investigate several methods for the computation of the BMO norm of a function in practice. We also generalize Meyer's (BV, E) model and consider the homogenenous Besov spaces B&d2;sp,q , -2

Variational Methods in Signal Decomposition and Image Processing

Variational Methods in Signal Decomposition and Image Processing
Author: Konstantin Dragomiretskiy
Publisher:
Total Pages: 164
Release: 2015
Genre:
ISBN:

The work presented in this dissertation is motivated by classical problems in signal and image processing from the perspective of variational and PDE-based methods. Analytically encoding qualitative features of signals into variational energies in conjunction with modern methods in sparse optimization allows for well-founded and robust models, the optimization of which yields meaningful and cohesive signal decomposition. Part I of this dissertation is based on joint work Variational Mode Decomposition [DZ14] with Dominique Zosso, in which the goal is to recursively decompose a signal into different modes of separate spectral bands, which are unknown beforehand. In the late nineties, Huang [HSL98] introduced the Hilbert-Huang transform, also known as Empirical Mode Decomposition, in order to decompose a signal into so-called intrinsic mode functions (IMF) along with a trend, and obtain instantaneous frequency data. The HHT/EMD algorithm is widely used today, although there is no exact mathematical model corresponding to this algorithm, and, consequently, the exact properties and limits are widely unknown. We propose an entirely non-recursive variational mode decomposition model, where the modes are extracted concurrently. The model looks for a number of modes and their respective center frequencies, such that the modes reproduce the input signal, while being smooth after demodulation into baseband. In Fourier domain, this corresponds to a narrow-band prior. Our model provides a solution to the decomposition problem that is theoretically well-founded, tractable, and motivated. The variational model is efficiently optimized using an alternating direction method of multipliers approach. Preliminary results show excellent performance with respect to existing mode decomposition models. Part II of this dissertation is the n-dimensional extension of the Variational Mode Decomposition. Decomposing multidimensional signals, such as images, into spatially compact, potentially overlapping modes of essentially wavelike nature makes these components accessible for further downstream analysis such as space-frequency analysis, demodulation, estimation of local orientation, edge and corner detection, texture analysis, denoising, inpainting, and curvature estimation. The model decomposes the input signal into modes with narrow Fourier bandwidth; to cope with sharp region boundaries, incompatible with narrow bandwidth, we introduce binary support functions that act as masks on the narrow-band mode for image re-composition. L1 and TV-terms promote sparsity and spatial compactness. Constraining the support functions to partitions of the signal domain, we effectively get an image segmentation model based on spectral homogeneity. By coupling several submodes together with a single support function we are able to decompose an image into several crystal grains. Our efficient algorithm is based on variable splitting and alternate direction optimization; we employ Merriman-Bence-Osher-like [MBO92] threshold dynamics to handle eciently the motion by mean curvature of the support function boundaries under the sparsity promoting terms. The versatility and effectiveness of our proposed model is demonstrated on a broad variety of example images from different modalities. These demonstrations include the decomposition of images into overlapping modes with smooth or sharp boundaries, segmentation of images of crystal grains, and inpainting of damaged image regions through artifact detection. Part III of this dissertation is based on joint work with Igor Yanovsky of NASA Jet Propulsion Laboratory. We introduce a variational method for destriping data acquired by pushbroom type satellite imaging systems. The model leverages sparsity in signals and is based on current research in sparse optimization and compressed sensing. It is based on the basic principles of regularization and data fidelity with certain constraints using modern methods in variational optimization - namely total variation (TV), both L1 and L2 fidelity, and the alternate direction method of multipliers. The main algorithm in Part III uses sparsity promoting energy functionals to achieve two important imaging effects. The TV term maintains boundary sharpness of content in the underlying clean image, while the L1 fidelity allows for the equitable removal of stripes without over- or under-penalization, providing a more accurate model of presumably independent sensors with unspecified and unrestricted bias distribution. A comparison is made between the TV-L1 and TV-L2 models to exemplify the qualitative efficacy of an L1 striping penalty. The model makes use of novel minimization splittings and proximal mapping operators, successfully yielding more realistic destriped images in very few iterations.

Variational Methods in Image Segmentation

Variational Methods in Image Segmentation
Author: Jean-Michel Morel
Publisher: Springer Science & Business Media
Total Pages: 257
Release: 2012-12-06
Genre: Mathematics
ISBN: 1468405675

This book contains both a synthesis and mathematical analysis of a wide set of algorithms and theories whose aim is the automatic segmen tation of digital images as well as the understanding of visual perception. A common formalism for these theories and algorithms is obtained in a variational form. Thank to this formalization, mathematical questions about the soundness of algorithms can be raised and answered. Perception theory has to deal with the complex interaction between regions and "edges" (or boundaries) in an image: in the variational seg mentation energies, "edge" terms compete with "region" terms in a way which is supposed to impose regularity on both regions and boundaries. This fact was an experimental guess in perception phenomenology and computer vision until it was proposed as a mathematical conjecture by Mumford and Shah. The third part of the book presents a unified presentation of the evi dences in favour of the conjecture. It is proved that the competition of one-dimensional and two-dimensional energy terms in a variational for mulation cannot create fractal-like behaviour for the edges. The proof of regularity for the edges of a segmentation constantly involves con cepts from geometric measure theory, which proves to be central in im age processing theory. The second part of the book provides a fast and self-contained presentation of the classical theory of rectifiable sets (the "edges") and unrectifiable sets ("fractals").

High-Order Models in Semantic Image Segmentation

High-Order Models in Semantic Image Segmentation
Author: Ismail Ben Ayed
Publisher: Academic Press
Total Pages: 184
Release: 2023-06-22
Genre: Technology & Engineering
ISBN: 0128092297

High-Order Models in Semantic Image Segmentation reviews recent developments in optimization-based methods for image segmentation, presenting several geometric and mathematical models that underlie a broad class of recent segmentation techniques. Focusing on impactful algorithms in the computer vision community in the last 10 years, the book includes sections on graph-theoretic and continuous relaxation techniques, which can compute globally optimal solutions for many problems. The book provides a practical and accessible introduction to these state-of -the-art segmentation techniques that is ideal for academics, industry researchers, and graduate students in computer vision, machine learning and medical imaging. Gives an intuitive and conceptual understanding of this mathematically involved subject by using a large number of graphical illustrations Provides the right amount of knowledge to apply sophisticated techniques for a wide range of new applications Contains numerous tables that compare different algorithms, facilitating the appropriate choice of algorithm for the intended application Presents an array of practical applications in computer vision and medical imaging Includes code for many of the algorithms that is available on the book’s companion website

Variational and Level Set Methods in Image Segmentation

Variational and Level Set Methods in Image Segmentation
Author: Amar Mitiche
Publisher: Springer
Total Pages: 192
Release: 2012-12-05
Genre: Technology & Engineering
ISBN: 9783642265624

Image segmentation consists of dividing an image domain into disjoint regions according to a characterization of the image within or in-between the regions. Therefore, segmenting an image is to divide its domain into relevant components. The efficient solution of the key problems in image segmentation promises to enable a rich array of useful applications. The current major application areas include robotics, medical image analysis, remote sensing, scene understanding, and image database retrieval. The subject of this book is image segmentation by variational methods with a focus on formulations which use closed regular plane curves to define the segmentation regions and on a level set implementation of the corresponding active curve evolution algorithms. Each method is developed from an objective functional which embeds constraints on both the image domain partition of the segmentation and the image data within or in-between the partition regions. The necessary conditions to optimize the objective functional are then derived and solved numerically. The book covers, within the active curve and level set formalism, the basic two-region segmentation methods, multiregion extensions, region merging, image modeling, and motion based segmentation. To treat various important classes of images, modeling investigates several parametric distributions such as the Gaussian, Gamma, Weibull, and Wishart. It also investigates non-parametric models. In motion segmentation, both optical flow and the movement of real three-dimensional objects are studied.

Energy Minimization Methods in Computer Vision and Pattern Recognition

Energy Minimization Methods in Computer Vision and Pattern Recognition
Author: Daniel Cremers
Publisher: Springer
Total Pages: 502
Release: 2009-08-17
Genre: Computers
ISBN: 3642036414

This book constitutes the refereed proceedings of the 7th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition, EMMCVPR 2009, held in Bonn, Germany in August 2009. The 18 revised full papers, 18 poster papers and 3 keynote lectures presented were carefully reviewed and selected from 75 submissions. The papers are organized in topical sections on discrete optimization and Markov random fields, partial differential equations, segmentation and tracking, shape optimization and registration, inpainting and image denoising, color and texture and statistics and learning.

Variational Methods in Image Segmentation

Variational Methods in Image Segmentation
Author: J.-M. Morel
Publisher: Birkhäuser
Total Pages: 248
Release: 2012-02-16
Genre: Mathematics
ISBN: 9781468405682

This book contains both a synthesis and mathematical analysis of a wide set of algorithms and theories whose aim is the automatic segmen tation of digital images as well as the understanding of visual perception. A common formalism for these theories and algorithms is obtained in a variational form. Thank to this formalization, mathematical questions about the soundness of algorithms can be raised and answered. Perception theory has to deal with the complex interaction between regions and "edges" (or boundaries) in an image: in the variational seg mentation energies, "edge" terms compete with "region" terms in a way which is supposed to impose regularity on both regions and boundaries. This fact was an experimental guess in perception phenomenology and computer vision until it was proposed as a mathematical conjecture by Mumford and Shah. The third part of the book presents a unified presentation of the evi dences in favour of the conjecture. It is proved that the competition of one-dimensional and two-dimensional energy terms in a variational for mulation cannot create fractal-like behaviour for the edges. The proof of regularity for the edges of a segmentation constantly involves con cepts from geometric measure theory, which proves to be central in im age processing theory. The second part of the book provides a fast and self-contained presentation of the classical theory of rectifiable sets (the "edges") and unrectifiable sets ("fractals").

Variational Image Segmentation, Inpainting and Denoising

Variational Image Segmentation, Inpainting and Denoising
Author: Zhi Li
Publisher:
Total Pages: 110
Release: 2016
Genre: Image processing
ISBN:

Variational methods have attracted much attention in the past decade. With rigorous mathematical analysis and computational methods, variational minimization models can handle many practical problems arising in image processing, such as image segmentation and image restoration. We propose a two-stage image segmentation approach for color images, in the first stage, the primal-dual algorithm is applied to efficiently solve the proposed minimization problem for a smoothed image solution without irrelevant and trivial information, then in the second stage, we adopt the hillclimbing procedure to segment the smoothed image. For multiplicative noise removal, we employ a difference of convex algorithm to solve the non-convex AA model. And we also improve the non-local total variation model. More precisely, we add an extra term to impose regularity to the graph formed by the weights between pixels. Thin structures can benefit from this regularization term, because it allows to adapt the weights value from the global point of view, thus thin features will not be overlooked like in the conventional non-local models. Since now the non-local total variation term has two variables, the image u and weights v, and it is concave with respect to v, the proximal alternating linearized minimization algorithm is naturally applied with variable metrics to solve the non-convex model efficiently. In the meantime, the efficiency of the proposed approaches is demonstrated on problems including image segmentation, image inpainting and image denoising.