Measures of Information and Their Applications

Measures of Information and Their Applications
Author: Jagat Narain Kapur
Publisher: New Age International
Total Pages: 592
Release: 1994
Genre: Computers
ISBN:

The present book may be regarded as a successor of author's Maximum Entropy Models in Science and Engineering (Wiley), Generalized Maximum Entropy Principle (Sandford), Entropy Optimization Principles and Their Applications (Academic) and Insight into Entropy Optimizations Principles (MSTS). It contains sixty research investigations of the author on measures of entropy, directed divergence, weighted directed divergence, information, principles of maximum entropy, minimum entropy, minimum cross-entropy, minimum entropy, minimum information, minimum weighted information and maximum weighted entropy, most likely and most feasible distributions, duals of optimization problems, entropy optimization under inequality constraints, characterising moments, parameter estimation, maximum entropy approximation for a probability distribution, proving inequalities, laws of information, entropic mean, mean-entropy frontier, logistic-type growth models, birth-death processes, distributions of statistical mechanics, estimation of missing values, theorems of information theory and many others.

Entropy Optimization Principles with Applications

Entropy Optimization Principles with Applications
Author: Jagat Narain Kapur
Publisher:
Total Pages: 440
Release: 1992
Genre: Computers
ISBN:

This senior-level textbook on entropy provides a conceptual framework for the study of probabilistic systems with its elucidation of three key concepts - Shannon's information theory, Jaynes' maximum entropy principle and Kullback's minimum cross-entropy principle.

Entropy-Based Parameter Estimation in Hydrology

Entropy-Based Parameter Estimation in Hydrology
Author: V.P. Singh
Publisher: Springer Science & Business Media
Total Pages: 382
Release: 2013-04-17
Genre: Science
ISBN: 9401714312

Since the pioneering work of Shannon in the late 1940's on the development of the theory of entropy and the landmark contributions of Jaynes a decade later leading to the development of the principle of maximum entropy (POME), the concept of entropy has been increasingly applied in a wide spectrum of areas, including chemistry, electronics and communications engineering, data acquisition and storage and retreival, data monitoring network design, ecology, economics, environmental engineering, earth sciences, fluid mechanics, genetics, geology, geomorphology, geophysics, geotechnical engineering, hydraulics, hydrology, image processing, management sciences, operations research, pattern recognition and identification, photogrammetry, psychology, physics and quantum mechanics, reliability analysis, reservoir engineering, statistical mechanics, thermodynamics, topology, transportation engineering, turbulence modeling, and so on. New areas finding application of entropy have since continued to unfold. The entropy concept is indeed versatile and its applicability widespread. In the area of hydrology and water resources, a range of applications of entropy have been reported during the past three decades or so. This book focuses on parameter estimation using entropy for a number of distributions frequently used in hydrology. In the entropy-based parameter estimation the distribution parameters are expressed in terms of the given information, called constraints. Thus, the method lends itself to a physical interpretation of the parameters. Because the information to be specified usually constitutes sufficient statistics for the distribution under consideration, the entropy method provides a quantitative way to express the information contained in the distribution.

Entropy and Energy Dissipation in Water Resources

Entropy and Energy Dissipation in Water Resources
Author: V.P. Singh
Publisher: Springer Science & Business Media
Total Pages: 583
Release: 2012-12-06
Genre: Science
ISBN: 9401124302

Since the landmark contributions of C. E. Shannon in 1948, and those of E. T. Jaynes about a decade later, applications of the concept of entropy and the principle of maximum entropy have proliterated in science and engineering. Recent years have witnessed a broad range of new and exciting developments in hydrology and water resources using the entropy concept. These have encompassed innovative methods for hydrologic network design, transfer of information, flow forecasting, reliability assessment for water distribution systems, parameter estimation, derivation of probability distributions, drainage-network analysis, sediment yield modeling and pollutant loading, bridge-scour analysis, construction of velocity profiles, comparative evaluation of hydrologic models, and so on. Some of these methods hold great promise for advancement of engineering practice, permitting rational alternatives to conventional approaches. On the other hand, the concepts of energy and energy dissipation are being increasingly applied to a wide spectrum of problems in environmental and water resources. Both entropy and energy dissipation have their origin in thermodynamics, and are related concepts. Yet, many of the developments using entropy seem to be based entirely on statistical interpretation and have seemingly little physical content. For example, most of the entropy-related developments and applications in water resources have been based on the information-theoretic interpretation of entropy. We believe if the power of the entropy concept is to be fully realized, then its physical basis has to be established.

Encyclopedia of Optimization

Encyclopedia of Optimization
Author: Christodoulos A. Floudas
Publisher: Springer Science & Business Media
Total Pages: 4646
Release: 2008-09-04
Genre: Mathematics
ISBN: 0387747583

The goal of the Encyclopedia of Optimization is to introduce the reader to a complete set of topics that show the spectrum of research, the richness of ideas, and the breadth of applications that has come from this field. The second edition builds on the success of the former edition with more than 150 completely new entries, designed to ensure that the reference addresses recent areas where optimization theories and techniques have advanced. Particularly heavy attention resulted in health science and transportation, with entries such as "Algorithms for Genomics", "Optimization and Radiotherapy Treatment Design", and "Crew Scheduling".

Information and Entropy Econometrics

Information and Entropy Econometrics
Author: Amos Golan
Publisher: Now Publishers Inc
Total Pages: 167
Release: 2008
Genre: Business & Economics
ISBN: 160198104X

Information and Entropy Econometrics - A Review and Synthesis summarizes the basics of information theoretic methods in econometrics and the connecting theme among these methods. The sub-class of methods that treat the observed sample moments as stochastic is discussed in greater details. I Information and Entropy Econometrics - A Review and Synthesis -focuses on inter-connection between information theory, estimation and inference. -provides a detailed survey of information theoretic concepts and quantities used within econometrics and then show how these quantities are used within IEE. -pays special attention for the interpretation of these quantities and for describing the relationships between information theoretic estimators and traditional estimators. Readers need a basic knowledge of econometrics, but do not need prior knowledge of information theory. The survey is self contained and interested readers can replicate all results and examples provided. Whenever necessary the readers are referred to the relevant literature. Information and Entropy Econometrics - A Review and Synthesis will benefit researchers looking for a concise introduction to the basics of IEE and to acquire the basic tools necessary for using and understanding these methods. Applied researchers can use the book to learn improved new methods, and applications for extracting information from noisy and limited data and for learning from these data.

Parameter Estimation and Inverse Problems

Parameter Estimation and Inverse Problems
Author: Richard C. Aster
Publisher: Academic Press
Total Pages: 316
Release: 2005-01-11
Genre: Business & Economics
ISBN: 0120656043

Preface -- 1. Introduction -- 2. Linear Regression -- 3. Discretizing Continuous Inverse Problems -- 4. Rank Deficiency and Ill-Conditioning -- 5. Tikhonov Regularization -- 6. Iterative Methods -- 7. Other Regularization Techniques -- 8. Fourier Techniques -- 9. Nonlinear Regression -- 10. Nonlinear Inverse Problems -- 11. Bayesian Methods -- Appendix A: Review of Linear Algebra -- Appendix B: Review of Probability and Statistics -- Appendix C: Glossary of Notation -- Bibliography -- IndexLinear Regression -- Discretizing Continuous Inverse Problems -- Rank Deficiency and Ill-Conditioning -- Tikhonov Regularization -- Iterative Methods -- Other Regularization Techniques -- Fourier Techniques -- Nonlinear Regression -- Nonlinear Inverse Problems -- Bayesian Methods.

Maximum-entropy Models in Science and Engineering

Maximum-entropy Models in Science and Engineering
Author: Jagat Narain Kapur
Publisher: John Wiley & Sons
Total Pages: 660
Release: 1989
Genre: Technology & Engineering
ISBN: 9788122402162

This Is The First Comprehensive Book About Maximum Entropy Principle And Its Applications To A Diversity Of Fields Like Statistical Mechanics, Thermo-Dynamics, Business, Economics, Insurance, Finance, Contingency Tables, Characterisation Of Probability Distributions (Univariate As Well As Multivariate, Discrete As Well As Continuous), Statistical Inference, Non-Linear Spectral Analysis Of Time Series, Pattern Recognition, Marketing And Elections, Operations Research And Reliability Theory, Image Processing, Computerised Tomography, Biology And Medicine. There Are Over 600 Specially Constructed Exercises And Extensive Historical And Bibliographical Notes At The End Of Each Chapter.The Book Should Be Of Interest To All Applied Mathematicians, Physicists, Statisticians, Economists, Engineers Of All Types, Business Scientists, Life Scientists, Medical Scientists, Radiologists And Operations Researchers Who Are Interested In Applying The Powerful Methodology Based On Maximum Entropy Principle In Their Respective Fields.