Optimization Techniques in Statistics

Optimization Techniques in Statistics
Author: Jagdish S. Rustagi
Publisher: Elsevier
Total Pages: 376
Release: 2014-05-19
Genre: Mathematics
ISBN: 1483295710

Statistics help guide us to optimal decisions under uncertainty. A large variety of statistical problems are essentially solutions to optimization problems. The mathematical techniques of optimization are fundamentalto statistical theory and practice. In this book, Jagdish Rustagi provides full-spectrum coverage of these methods, ranging from classical optimization and Lagrange multipliers, to numerical techniques using gradients or direct search, to linear, nonlinear, and dynamic programming using the Kuhn-Tucker conditions or the Pontryagin maximal principle. Variational methods and optimization in function spaces are also discussed, as are stochastic optimization in simulation, including annealing methods. The text features numerous applications, including: Finding maximum likelihood estimates, Markov decision processes, Programming methods used to optimize monitoring of patients in hospitals, Derivation of the Neyman-Pearson lemma, The search for optimal designs, Simulation of a steel mill. Suitable as both a reference and a text, this book will be of interest to advanced undergraduate or beginning graduate students in statistics, operations research, management and engineering sciences, and related fields. Most of the material can be covered in one semester by students with a basic background in probability and statistics. Covers optimization from traditional methods to recent developments such as Karmarkars algorithm and simulated annealing Develops a wide range of statistical techniques in the unified context of optimization Discusses applications such as optimizing monitoring of patients and simulating steel mill operations Treats numerical methods and applications Includes exercises and references for each chapter Covers topics such as linear, nonlinear, and dynamic programming, variational methods, and stochastic optimization

Introduction to Optimization Methods and their Application in Statistics

Introduction to Optimization Methods and their Application in Statistics
Author: B. Everitt
Publisher: Springer Science & Business Media
Total Pages: 87
Release: 2012-12-06
Genre: Science
ISBN: 9400931530

Optimization techniques are used to find the values of a set of parameters which maximize or minimize some objective function of interest. Such methods have become of great importance in statistics for estimation, model fitting, etc. This text attempts to give a brief introduction to optimization methods and their use in several important areas of statistics. It does not pretend to provide either a complete treatment of optimization techniques or a comprehensive review of their application in statistics; such a review would, of course, require a volume several orders of magnitude larger than this since almost every issue of every statistics journal contains one or other paper which involves the application of an optimization method. It is hoped that the text will be useful to students on applied statistics courses and to researchers needing to use optimization techniques in a statistical context. Lastly, my thanks are due to Bertha Lakey for typing the manuscript.

Optimizing Methods in Statistics

Optimizing Methods in Statistics
Author: Jagdish S. Rustagi
Publisher: Academic Press
Total Pages: 505
Release: 2014-05-10
Genre: Mathematics
ISBN: 1483260348

Optimizing Method in Statistics is a compendium of papers dealing with variational methods, regression analysis, mathematical programming, optimum seeking methods, stochastic control, optimum design of experiments, optimum spacings, and order statistics. One paper reviews three optimization problems encountered in parameter estimation, namely, 1) iterative procedures for maximum likelihood estimation, based on complete or censored samples, of the parameters of various populations; 2) optimum spacings of quantiles for linear estimation; and 3) optimum choice of order statistics for linear estimation. Another paper notes the possibility of posing various adaptive filter algorithms to make the filter learn the system model while the system is operating in real time. By reducing the time necessary for process modeling, the time required to implement the acceptable system design can also be reduced One paper evaluates the parallel structure between duality relationships for the linear functional version of the generalized Neyman-Pearson problem, as well as the duality relationships of linear programming as these apply to bounded-variable linear programming problems. The compendium can prove beneficial to mathematicians, students, and professor of calculus, statistics, or advanced mathematics.

Experimental Methods for the Analysis of Optimization Algorithms

Experimental Methods for the Analysis of Optimization Algorithms
Author: Thomas Bartz-Beielstein
Publisher: Springer Science & Business Media
Total Pages: 469
Release: 2010-11-02
Genre: Computers
ISBN: 3642025382

In operations research and computer science it is common practice to evaluate the performance of optimization algorithms on the basis of computational results, and the experimental approach should follow accepted principles that guarantee the reliability and reproducibility of results. However, computational experiments differ from those in other sciences, and the last decade has seen considerable methodological research devoted to understanding the particular features of such experiments and assessing the related statistical methods. This book consists of methodological contributions on different scenarios of experimental analysis. The first part overviews the main issues in the experimental analysis of algorithms, and discusses the experimental cycle of algorithm development; the second part treats the characterization by means of statistical distributions of algorithm performance in terms of solution quality, runtime and other measures; and the third part collects advanced methods from experimental design for configuring and tuning algorithms on a specific class of instances with the goal of using the least amount of experimentation. The contributor list includes leading scientists in algorithm design, statistical design, optimization and heuristics, and most chapters provide theoretical background and are enriched with case studies. This book is written for researchers and practitioners in operations research and computer science who wish to improve the experimental assessment of optimization algorithms and, consequently, their design.

Optimization for Data Analysis

Optimization for Data Analysis
Author: Stephen J. Wright
Publisher: Cambridge University Press
Total Pages: 239
Release: 2022-04-21
Genre: Computers
ISBN: 1316518981

A concise text that presents and analyzes the fundamental techniques and methods in optimization that are useful in data science.