Practical Augmented Lagrangian Methods for Constrained Optimization

Practical Augmented Lagrangian Methods for Constrained Optimization
Author: Ernesto G. Birgin
Publisher: SIAM
Total Pages: 222
Release: 2014-04-30
Genre: Mathematics
ISBN: 161197335X

This book focuses on Augmented Lagrangian techniques for solving practical constrained optimization problems. The authors rigorously delineate mathematical convergence theory based on sequential optimality conditions and novel constraint qualifications. They also orient the book to practitioners by giving priority to results that provide insight on the practical behavior of algorithms and by providing geometrical and algorithmic interpretations of every mathematical result, and they fully describe a freely available computational package for constrained optimization and illustrate its usefulness with applications.

Practical Augmented Lagrangian Methods for Constrained Optimization

Practical Augmented Lagrangian Methods for Constrained Optimization
Author: Ernesto G. Birgin
Publisher: SIAM
Total Pages: 222
Release: 2014-04-30
Genre: Mathematics
ISBN: 1611973368

This book focuses on Augmented Lagrangian techniques for solving practical constrained optimization problems. The authors: rigorously delineate mathematical convergence theory based on sequential optimality conditions and novel constraint qualifications; orient the book to practitioners by giving priority to results that provide insight on the practical behavior of algorithms and by providing geometrical and algorithmic interpretations of every mathematical result; and fully describe a freely available computational package for constrained optimization and illustrate its usefulness with applications.

Constrained Optimization and Lagrange Multiplier Methods

Constrained Optimization and Lagrange Multiplier Methods
Author: Dimitri P. Bertsekas
Publisher: Academic Press
Total Pages: 412
Release: 2014-05-10
Genre: Mathematics
ISBN: 148326047X

Computer Science and Applied Mathematics: Constrained Optimization and Lagrange Multiplier Methods focuses on the advancements in the applications of the Lagrange multiplier methods for constrained minimization. The publication first offers information on the method of multipliers for equality constrained problems and the method of multipliers for inequality constrained and nondifferentiable optimization problems. Discussions focus on approximation procedures for nondifferentiable and ill-conditioned optimization problems; asymptotically exact minimization in the methods of multipliers; duality framework for the method of multipliers; and the quadratic penalty function method. The text then examines exact penalty methods, including nondifferentiable exact penalty functions; linearization algorithms based on nondifferentiable exact penalty functions; differentiable exact penalty functions; and local and global convergence of Lagrangian methods. The book ponders on the nonquadratic penalty functions of convex programming. Topics include large scale separable integer programming problems and the exponential method of multipliers; classes of penalty functions and corresponding methods of multipliers; and convergence analysis of multiplier methods. The text is a valuable reference for mathematicians and researchers interested in the Lagrange multiplier methods.

Practical Optimization

Practical Optimization
Author: Philip E. Gill
Publisher: SIAM
Total Pages: 421
Release: 2019-12-16
Genre: Mathematics
ISBN: 1611975603

In the intervening years since this book was published in 1981, the field of optimization has been exceptionally lively. This fertility has involved not only progress in theory, but also faster numerical algorithms and extensions into unexpected or previously unknown areas such as semidefinite programming. Despite these changes, many of the important principles and much of the intuition can be found in this Classics version of Practical Optimization. This book provides model algorithms and pseudocode, useful tools for users who prefer to write their own code as well as for those who want to understand externally provided code. It presents algorithms in a step-by-step format, revealing the overall structure of the underlying procedures and thereby allowing a high-level perspective on the fundamental differences. And it contains a wealth of techniques and strategies that are well suited for optimization in the twenty-first century, and particularly in the now-flourishing fields of data science, “big data,” and machine learning. Practical Optimization is appropriate for advanced undergraduates, graduate students, and researchers interested in methods for solving optimization problems.

Non-Smooth and Complementarity-Based Distributed Parameter Systems

Non-Smooth and Complementarity-Based Distributed Parameter Systems
Author: Michael Hintermüller
Publisher: Springer Nature
Total Pages: 518
Release: 2022-02-18
Genre: Mathematics
ISBN: 3030793931

Many of the most challenging problems in the applied sciences involve non-differentiable structures as well as partial differential operators, thus leading to non-smooth distributed parameter systems. This edited volume aims to establish a theoretical and numerical foundation and develop new algorithmic paradigms for the treatment of non-smooth phenomena and associated parameter influences. Other goals include the realization and further advancement of these concepts in the context of robust and hierarchical optimization, partial differential games, and nonlinear partial differential complementarity problems, as well as their validation in the context of complex applications. Areas for which applications are considered include optimal control of multiphase fluids and of superconductors, image processing, thermoforming, and the formation of rivers and networks. Chapters are written by leading researchers and present results obtained in the first funding phase of the DFG Special Priority Program on Nonsmooth and Complementarity Based Distributed Parameter Systems: Simulation and Hierarchical Optimization that ran from 2016 to 2019.

Numerical Optimization

Numerical Optimization
Author: Jorge Nocedal
Publisher: Springer Science & Business Media
Total Pages: 686
Release: 2006-12-11
Genre: Mathematics
ISBN: 0387400656

Optimization is an important tool used in decision science and for the analysis of physical systems used in engineering. One can trace its roots to the Calculus of Variations and the work of Euler and Lagrange. This natural and reasonable approach to mathematical programming covers numerical methods for finite-dimensional optimization problems. It begins with very simple ideas progressing through more complicated concepts, concentrating on methods for both unconstrained and constrained optimization.

Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers

Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers
Author: Stephen Boyd
Publisher: Now Publishers Inc
Total Pages: 138
Release: 2011
Genre: Computers
ISBN: 160198460X

Surveys the theory and history of the alternating direction method of multipliers, and discusses its applications to a wide variety of statistical and machine learning problems of recent interest, including the lasso, sparse logistic regression, basis pursuit, covariance selection, support vector machines, and many others.