Advances and Trends in Optimization with Engineering Applications

Advances and Trends in Optimization with Engineering Applications
Author: Tamas Terlaky
Publisher: SIAM
Total Pages: 730
Release: 2017-04-26
Genre: Mathematics
ISBN: 1611974674

Optimization is of critical importance in engineering. Engineers constantly strive for the best possible solutions, the most economical use of limited resources, and the greatest efficiency. As system complexity increases, these goals mandate the use of state-of-the-art optimization techniques. In recent years, the theory and methodology of optimization have seen revolutionary improvements. Moreover, the exponential growth in computational power, along with the availability of multicore computing with virtually unlimited memory and storage capacity, has fundamentally changed what engineers can do to optimize their designs. This is a two-way process: engineers benefit from developments in optimization methodology, and challenging new classes of optimization problems arise from novel engineering applications. Advances and Trends in Optimization with Engineering Applications reviews 10 major areas of optimization and related engineering applications, providing a broad summary of state-of-the-art optimization techniques most important to engineering practice. Each part provides a clear overview of a specific area and discusses a range of real-world problems. The book provides a solid foundation for engineers and mathematical optimizers alike who want to understand the importance of optimization methods to engineering and the capabilities of these methods.

Convex Optimization

Convex Optimization
Author: Sébastien Bubeck
Publisher: Foundations and Trends (R) in Machine Learning
Total Pages: 142
Release: 2015-11-12
Genre: Convex domains
ISBN: 9781601988607

This monograph presents the main complexity theorems in convex optimization and their corresponding algorithms. It begins with the fundamental theory of black-box optimization and proceeds to guide the reader through recent advances in structural optimization and stochastic optimization. The presentation of black-box optimization, strongly influenced by the seminal book by Nesterov, includes the analysis of cutting plane methods, as well as (accelerated) gradient descent schemes. Special attention is also given to non-Euclidean settings (relevant algorithms include Frank-Wolfe, mirror descent, and dual averaging), and discussing their relevance in machine learning. The text provides a gentle introduction to structural optimization with FISTA (to optimize a sum of a smooth and a simple non-smooth term), saddle-point mirror prox (Nemirovski's alternative to Nesterov's smoothing), and a concise description of interior point methods. In stochastic optimization it discusses stochastic gradient descent, mini-batches, random coordinate descent, and sublinear algorithms. It also briefly touches upon convex relaxation of combinatorial problems and the use of randomness to round solutions, as well as random walks based methods.

Meta-Heuristics

Meta-Heuristics
Author: Stefan Voß
Publisher: Springer Science & Business Media
Total Pages: 513
Release: 2012-12-06
Genre: Business & Economics
ISBN: 1461557755

Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimizations comprises a carefully refereed selection of extended versions of the best papers presented at the Second Meta-Heuristics Conference (MIC 97). The selected articles describe the most recent developments in theory and applications of meta-heuristics, heuristics for specific problems, and comparative case studies. The book is divided into six parts, grouped mainly by the techniques considered. The extensive first part with twelve papers covers tabu search and its application to a great variety of well-known combinatorial optimization problems (including the resource-constrained project scheduling problem and vehicle routing problems). In the second part we find one paper where tabu search and simulated annealing are investigated comparatively and two papers which consider hybrid methods combining tabu search with genetic algorithms. The third part has four papers on genetic and evolutionary algorithms. Part four arrives at a new paradigm within meta-heuristics. The fifth part studies the behavior of parallel local search algorithms mainly from a tabu search perspective. The final part examines a great variety of additional meta-heuristics topics, including neural networks and variable neighbourhood search as well as guided local search. Furthermore, the integration of meta-heuristics with the branch-and-bound paradigm is investigated.

Advances in Structural Engineering—Optimization

Advances in Structural Engineering—Optimization
Author: Sinan Melih Nigdeli
Publisher: Springer Nature
Total Pages: 310
Release: 2020-12-04
Genre: Technology & Engineering
ISBN: 303061848X

This book is an up-to-date source for computation applications of optimization, prediction via artificial intelligence methods, and evaluation of metaheuristic algorithm with different structural applications. As the current interest of researcher, metaheuristic algorithms are a high interest topic area since advance and non-optimized problems via mathematical methods are challenged by the development of advance and modified algorithms. The artificial intelligence (AI) area is also important in predicting optimum results by skipping long iterative optimization processes. The machine learning used in generation of AI models also needs optimum results of metaheuristic-based approaches. This book is a great source to researcher, graduate students, and bachelor students who gain project about structural optimization. Differently from the academic use, the chapter that emphasizes different scopes and methods can take the interest and help engineer working in design and production of structural engineering projects.

Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers

Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers
Author: Stephen Boyd
Publisher: Now Publishers Inc
Total Pages: 138
Release: 2011
Genre: Computers
ISBN: 160198460X

Surveys the theory and history of the alternating direction method of multipliers, and discusses its applications to a wide variety of statistical and machine learning problems of recent interest, including the lasso, sparse logistic regression, basis pursuit, covariance selection, support vector machines, and many others.

Network Optimization and Control

Network Optimization and Control
Author: Srinivas Shakkottai
Publisher: Now Publishers Inc
Total Pages: 123
Release: 2008
Genre: Data transmission systems
ISBN: 1601981023

Network Optimization and Control is the ideal starting point for a mature reader with little background on the subject of congestion control to understand the basic concepts underlying network resource allocation.

Optimization with Sparsity-Inducing Penalties

Optimization with Sparsity-Inducing Penalties
Author: Francis Bach
Publisher:
Total Pages: 124
Release: 2011-12-23
Genre: Computers
ISBN: 9781601985101

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel selection. It turns out that many of the related estimation problems can be cast as convex optimization problems by regularizing the empirical risk with appropriate nonsmooth norms. Optimization with Sparsity-Inducing Penalties presents optimization tools and techniques dedicated to such sparsity-inducing penalties from a general perspective. It covers proximal methods, block-coordinate descent, reweighted ?2-penalized techniques, working-set and homotopy methods, as well as non-convex formulations and extensions, and provides an extensive set of experiments to compare various algorithms from a computational point of view. The presentation of Optimization with Sparsity-Inducing Penalties is essentially based on existing literature, but the process of constructing a general framework leads naturally to new results, connections and points of view. It is an ideal reference on the topic for anyone working in machine learning and related areas.

Online Learning and Online Convex Optimization

Online Learning and Online Convex Optimization
Author: Shai Shalev-Shwartz
Publisher: Foundations & Trends
Total Pages: 88
Release: 2012
Genre: Computers
ISBN: 9781601985460

Online Learning and Online Convex Optimization is a modern overview of online learning. Its aim is to provide the reader with a sense of some of the interesting ideas and in particular to underscore the centrality of convexity in deriving efficient online learning algorithms.

Proximal Algorithms

Proximal Algorithms
Author: Neal Parikh
Publisher: Now Pub
Total Pages: 130
Release: 2013-11
Genre: Mathematics
ISBN: 9781601987167

Proximal Algorithms discusses proximal operators and proximal algorithms, and illustrates their applicability to standard and distributed convex optimization in general and many applications of recent interest in particular. Much like Newton's method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton's method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Proximal Algorithms discusses different interpretations of proximal operators and algorithms, looks at their connections to many other topics in optimization and applied mathematics, surveys some popular algorithms, and provides a large number of examples of proximal operators that commonly arise in practice.

Applied Optimization

Applied Optimization
Author: Ross Baldick
Publisher: Cambridge University Press
Total Pages: 859
Release: 2009-01-18
Genre: Technology & Engineering
ISBN: 1107394082

The starting point in the formulation of any numerical problem is to take an intuitive idea about the problem in question and to translate it into precise mathematical language. This book provides step-by-step descriptions of how to formulate numerical problems and develops techniques for solving them. A number of engineering case studies motivate the development of efficient algorithms that involve, in some cases, transformation of the problem from its initial formulation into a more tractable form. Five general problem classes are considered: linear systems of equations, non-linear systems of equations, unconstrained optimization, equality-constrained optimization and inequality-constrained optimization. The book contains many worked examples and homework exercises and is suitable for students of engineering or operations research taking courses in optimization. Supplementary material including solutions, lecture slides and appendices are available online at www.cambridge.org/9780521855648.