Convex Analysis and Beyond

Convex Analysis and Beyond
Author: Boris S. Mordukhovich
Publisher: Springer Nature
Total Pages: 597
Release: 2022-04-24
Genre: Mathematics
ISBN: 3030947858

This book presents a unified theory of convex functions, sets, and set-valued mappings in topological vector spaces with its specifications to locally convex, Banach and finite-dimensional settings. These developments and expositions are based on the powerful geometric approach of variational analysis, which resides on set extremality with its characterizations and specifications in the presence of convexity. Using this approach, the text consolidates the device of fundamental facts of generalized differential calculus to obtain novel results for convex sets, functions, and set-valued mappings in finite and infinite dimensions. It also explores topics beyond convexity using the fundamental machinery of convex analysis to develop nonconvex generalized differentiation and its applications. The text utilizes an adaptable framework designed with researchers as well as multiple levels of students in mind. It includes many exercises and figures suited to graduate classes in mathematical sciences that are also accessible to advanced students in economics, engineering, and other applications. In addition, it includes chapters on convex analysis and optimization in finite-dimensional spaces that will be useful to upper undergraduate students, whereas the work as a whole provides an ample resource to mathematicians and applied scientists, particularly experts in convex and variational analysis, optimization, and their applications.

Convex Optimization Algorithms

Convex Optimization Algorithms
Author: Dimitri Bertsekas
Publisher: Athena Scientific
Total Pages: 576
Release: 2015-02-01
Genre: Mathematics
ISBN: 1886529280

This book provides a comprehensive and accessible presentation of algorithms for solving convex optimization problems. It relies on rigorous mathematical analysis, but also aims at an intuitive exposition that makes use of visualization where possible. This is facilitated by the extensive use of analytical and algorithmic concepts of duality, which by nature lend themselves to geometrical interpretation. The book places particular emphasis on modern developments, and their widespread applications in fields such as large-scale resource allocation problems, signal processing, and machine learning. The book is aimed at students, researchers, and practitioners, roughly at the first year graduate level. It is similar in style to the author's 2009"Convex Optimization Theory" book, but can be read independently. The latter book focuses on convexity theory and optimization duality, while the present book focuses on algorithmic issues. The two books share notation, and together cover the entire finite-dimensional convex optimization methodology. To facilitate readability, the statements of definitions and results of the "theory book" are reproduced without proofs in Appendix B.

Convex Optimization

Convex Optimization
Author: Stephen P. Boyd
Publisher: Cambridge University Press
Total Pages: 744
Release: 2004-03-08
Genre: Business & Economics
ISBN: 9780521833783

Convex optimization problems arise frequently in many different fields. This book provides a comprehensive introduction to the subject, and shows in detail how such problems can be solved numerically with great efficiency. The book begins with the basic elements of convex sets and functions, and then describes various classes of convex optimization problems. Duality and approximation techniques are then covered, as are statistical estimation techniques. Various geometrical problems are then presented, and there is detailed discussion of unconstrained and constrained minimization problems, and interior-point methods. The focus of the book is on recognizing convex optimization problems and then finding the most appropriate technique for solving them. It contains many worked examples and homework exercises and will appeal to students, researchers and practitioners in fields such as engineering, computer science, mathematics, statistics, finance and economics.

Convex Functions and Their Applications

Convex Functions and Their Applications
Author: Constantin P. Niculescu
Publisher: Springer
Total Pages: 430
Release: 2018-06-08
Genre: Mathematics
ISBN: 3319783378

Thorough introduction to an important area of mathematics Contains recent results Includes many exercises

Variational Analysis

Variational Analysis
Author: R. Tyrrell Rockafellar
Publisher: Springer Science & Business Media
Total Pages: 747
Release: 2009-06-26
Genre: Mathematics
ISBN: 3642024319

From its origins in the minimization of integral functionals, the notion of variations has evolved greatly in connection with applications in optimization, equilibrium, and control. This book develops a unified framework and provides a detailed exposition of variational geometry and subdifferential calculus in their current forms beyond classical and convex analysis. Also covered are set-convergence, set-valued mappings, epi-convergence, duality, and normal integrands.

Convex Analysis and Minimization Algorithms II

Convex Analysis and Minimization Algorithms II
Author: Jean-Baptiste Hiriart-Urruty
Publisher: Springer Science & Business Media
Total Pages: 362
Release: 2013-03-14
Genre: Business & Economics
ISBN: 366206409X

From the reviews: "The account is quite detailed and is written in a manner that will appeal to analysts and numerical practitioners alike...they contain everything from rigorous proofs to tables of numerical calculations.... one of the strong features of these books...that they are designed not for the expert, but for those who whish to learn the subject matter starting from little or no background...there are numerous examples, and counter-examples, to back up the theory...To my knowledge, no other authors have given such a clear geometric account of convex analysis." "This innovative text is well written, copiously illustrated, and accessible to a wide audience"

Convex Optimization

Convex Optimization
Author: Sébastien Bubeck
Publisher: Foundations and Trends (R) in Machine Learning
Total Pages: 142
Release: 2015-11-12
Genre: Convex domains
ISBN: 9781601988607

This monograph presents the main complexity theorems in convex optimization and their corresponding algorithms. It begins with the fundamental theory of black-box optimization and proceeds to guide the reader through recent advances in structural optimization and stochastic optimization. The presentation of black-box optimization, strongly influenced by the seminal book by Nesterov, includes the analysis of cutting plane methods, as well as (accelerated) gradient descent schemes. Special attention is also given to non-Euclidean settings (relevant algorithms include Frank-Wolfe, mirror descent, and dual averaging), and discussing their relevance in machine learning. The text provides a gentle introduction to structural optimization with FISTA (to optimize a sum of a smooth and a simple non-smooth term), saddle-point mirror prox (Nemirovski's alternative to Nesterov's smoothing), and a concise description of interior point methods. In stochastic optimization it discusses stochastic gradient descent, mini-batches, random coordinate descent, and sublinear algorithms. It also briefly touches upon convex relaxation of combinatorial problems and the use of randomness to round solutions, as well as random walks based methods.

Optima and Equilibria

Optima and Equilibria
Author: Jean-Pierre Aubin
Publisher: Springer Science & Business Media
Total Pages: 442
Release: 2013-03-09
Genre: Mathematics
ISBN: 3662035391

Progress in the theory of economic equilibria and in game theory has proceeded hand in hand with that of the mathematical tools used in the field, namely nonlinear analysis and, in particular, convex analysis. Jean-Pierre Aubin, one of the leading specialists in nonlinear analysis and its application to economics, has written a rigorous and concise - yet still elementary and self-contained - textbook providing the mathematical tools needed to study optima and equilibria, as solutions to problems, arising in economics, management sciences, operations research, cooperative and non-cooperative games, fuzzy games etc. It begins with the foundations of optimization theory, and mathematical programming, and in particular convex and nonsmooth analysis. Nonlinear analysis is then presented, first game-theoretically, then in the framework of set valued analysis. These results are then applied to the main classes of economic equilibria. The book contains numerous exercises and problems: the latter allow the reader to venture into areas of nonlinear analysis that lie beyond the scope of the book and of most graduate courses.

Lectures on Modern Convex Optimization

Lectures on Modern Convex Optimization
Author: Aharon Ben-Tal
Publisher: SIAM
Total Pages: 500
Release: 2001-01-01
Genre: Technology & Engineering
ISBN: 0898714915

Here is a book devoted to well-structured and thus efficiently solvable convex optimization problems, with emphasis on conic quadratic and semidefinite programming. The authors present the basic theory underlying these problems as well as their numerous applications in engineering, including synthesis of filters, Lyapunov stability analysis, and structural design. The authors also discuss the complexity issues and provide an overview of the basic theory of state-of-the-art polynomial time interior point methods for linear, conic quadratic, and semidefinite programming. The book's focus on well-structured convex problems in conic form allows for unified theoretical and algorithmical treatment of a wide spectrum of important optimization problems arising in applications.

Advances in Convex Analysis and Global Optimization

Advances in Convex Analysis and Global Optimization
Author: Nicolas Hadjisavvas
Publisher: Springer Science & Business Media
Total Pages: 601
Release: 2013-12-01
Genre: Mathematics
ISBN: 146130279X

There has been much recent progress in global optimization algo rithms for nonconvex continuous and discrete problems from both a theoretical and a practical perspective. Convex analysis plays a fun damental role in the analysis and development of global optimization algorithms. This is due essentially to the fact that virtually all noncon vex optimization problems can be described using differences of convex functions and differences of convex sets. A conference on Convex Analysis and Global Optimization was held during June 5 -9, 2000 at Pythagorion, Samos, Greece. The conference was honoring the memory of C. Caratheodory (1873-1950) and was en dorsed by the Mathematical Programming Society (MPS) and by the Society for Industrial and Applied Mathematics (SIAM) Activity Group in Optimization. The conference was sponsored by the European Union (through the EPEAEK program), the Department of Mathematics of the Aegean University and the Center for Applied Optimization of the University of Florida, by the General Secretariat of Research and Tech nology of Greece, by the Ministry of Education of Greece, and several local Greek government agencies and companies. This volume contains a selective collection of refereed papers based on invited and contribut ing talks presented at this conference. The two themes of convexity and global optimization pervade this book. The conference provided a forum for researchers working on different aspects of convexity and global opti mization to present their recent discoveries, and to interact with people working on complementary aspects of mathematical programming.