Complex-valued Neural Networks

Complex-valued Neural Networks
Author: Akira Hirose
Publisher: World Scientific
Total Pages: 387
Release: 2003
Genre: Computers
ISBN: 9812384642

In recent years, complex-valued neural networks have widened the scope of application in optoelectronics, imaging, remote sensing, quantum neural devices and systems, spatiotemporal analysis of physiological neural systems, and artificial neural information processing. In this first-ever book on complex-valued neural networks, the most active scientists at the forefront of the field describe theories and applications from various points of view to provide academic and industrial researchers with a comprehensive understanding of the fundamentals, features and prospects of the powerful complex-valued networks.

Complex-Valued Neural Networks with Multi-Valued Neurons

Complex-Valued Neural Networks with Multi-Valued Neurons
Author: Igor Aizenberg
Publisher: Springer
Total Pages: 273
Release: 2011-06-24
Genre: Technology & Engineering
ISBN: 3642203531

Complex-Valued Neural Networks have higher functionality, learn faster and generalize better than their real-valued counterparts. This book is devoted to the Multi-Valued Neuron (MVN) and MVN-based neural networks. It contains a comprehensive observation of MVN theory, its learning, and applications. MVN is a complex-valued neuron whose inputs and output are located on the unit circle. Its activation function is a function only of argument (phase) of the weighted sum. MVN derivative-free learning is based on the error-correction rule. A single MVN can learn those input/output mappings that are non-linearly separable in the real domain. Such classical non-linearly separable problems as XOR and Parity n are the simplest that can be learned by a single MVN. Another important advantage of MVN is a proper treatment of the phase information. These properties of MVN become even more remarkable when this neuron is used as a basic one in neural networks. The Multilayer Neural Network based on Multi-Valued Neurons (MLMVN) is an MVN-based feedforward neural network. Its backpropagation learning algorithm is derivative-free and based on the error-correction rule. It does not suffer from the local minima phenomenon. MLMVN outperforms many other machine learning techniques in terms of learning speed, network complexity and generalization capability when solving both benchmark and real-world classification and prediction problems. Another interesting application of MVN is its use as a basic neuron in multi-state associative memories. The book is addressed to those readers who develop theoretical fundamentals of neural networks and use neural networks for solving various real-world problems. It should also be very suitable for Ph.D. and graduate students pursuing their degrees in computational intelligence.

Complex Valued Nonlinear Adaptive Filters

Complex Valued Nonlinear Adaptive Filters
Author: Danilo P. Mandic
Publisher: John Wiley & Sons
Total Pages: 344
Release: 2009-04-20
Genre: Science
ISBN: 0470742631

This book was written in response to the growing demand for a text that provides a unified treatment of linear and nonlinear complex valued adaptive filters, and methods for the processing of general complex signals (circular and noncircular). It brings together adaptive filtering algorithms for feedforward (transversal) and feedback architectures and the recent developments in the statistics of complex variable, under the powerful frameworks of CR (Wirtinger) calculus and augmented complex statistics. This offers a number of theoretical performance gains, which is illustrated on both stochastic gradient algorithms, such as the augmented complex least mean square (ACLMS), and those based on Kalman filters. This work is supported by a number of simulations using synthetic and real world data, including the noncircular and intermittent radar and wind signals.

Complex-Valued Neural Networks

Complex-Valued Neural Networks
Author: Akira Hirose
Publisher: John Wiley & Sons
Total Pages: 238
Release: 2013-05-08
Genre: Computers
ISBN: 1118590066

Presents the latest advances in complex-valued neural networks by demonstrating the theory in a wide range of applications Complex-valued neural networks is a rapidly developing neural network framework that utilizes complex arithmetic, exhibiting specific characteristics in its learning, self-organizing, and processing dynamics. They are highly suitable for processing complex amplitude, composed of amplitude and phase, which is one of the core concepts in physical systems to deal with electromagnetic, light, sonic/ultrasonic waves as well as quantum waves, namely, electron and superconducting waves. This fact is a critical advantage in practical applications in diverse fields of engineering, where signals are routinely analyzed and processed in time/space, frequency, and phase domains. Complex-Valued Neural Networks: Advances and Applications covers cutting-edge topics and applications surrounding this timely subject. Demonstrating advanced theories with a wide range of applications, including communication systems, image processing systems, and brain-computer interfaces, this text offers comprehensive coverage of: Conventional complex-valued neural networks Quaternionic neural networks Clifford-algebraic neural networks Presented by international experts in the field, Complex-Valued Neural Networks: Advances and Applications is ideal for advanced-level computational intelligence theorists, electromagnetic theorists, and mathematicians interested in computational intelligence, artificial intelligence, machine learning theories, and algorithms.

Complex-valued Neural Networks: Theories And Applications

Complex-valued Neural Networks: Theories And Applications
Author: Akira Hirose
Publisher: World Scientific
Total Pages: 387
Release: 2003-11-18
Genre: Computers
ISBN: 9814485373

In recent years, complex-valued neural networks have widened the scope of application in optoelectronics, imaging, remote sensing, quantum neural devices and systems, spatiotemporal analysis of physiological neural systems, and artificial neural information processing. In this first-ever book on complex-valued neural networks, the most active scientists at the forefront of the field describe theories and applications from various points of view to provide academic and industrial researchers with a comprehensive understanding of the fundamentals, features and prospects of the powerful complex-valued networks.

Neural Networks

Neural Networks
Author: Berndt Müller
Publisher: Springer Science & Business Media
Total Pages: 340
Release: 2012-12-06
Genre: Computers
ISBN: 3642577601

Neural Networks presents concepts of neural-network models and techniques of parallel distributed processing in a three-step approach: - A brief overview of the neural structure of the brain and the history of neural-network modeling introduces to associative memory, preceptrons, feature-sensitive networks, learning strategies, and practical applications. - The second part covers subjects like statistical physics of spin glasses, the mean-field theory of the Hopfield model, and the "space of interactions" approach to the storage capacity of neural networks. - The final part discusses nine programs with practical demonstrations of neural-network models. The software and source code in C are on a 3 1/2" MS-DOS diskette can be run with Microsoft, Borland, Turbo-C, or compatible compilers.

Building Neural Networks

Building Neural Networks
Author: David M. Skapura
Publisher: Addison-Wesley Professional
Total Pages: 308
Release: 1996
Genre: Computers
ISBN: 9780201539219

Organized by application areas, rather than by specific network architectures or learning algorithms, Building Neural Networks shows why certain networks are more suitable than others for solving specific kinds of problems. Skapura also reviews principles of neural information processing and furnishes an operations summary of the most popular neural-network processing models.

Efficient Processing of Deep Neural Networks

Efficient Processing of Deep Neural Networks
Author: Vivienne Sze
Publisher: Springer Nature
Total Pages: 254
Release: 2022-05-31
Genre: Technology & Engineering
ISBN: 3031017668

This book provides a structured treatment of the key principles and techniques for enabling efficient processing of deep neural networks (DNNs). DNNs are currently widely used for many artificial intelligence (AI) applications, including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at the cost of high computational complexity. Therefore, techniques that enable efficient processing of deep neural networks to improve key metrics—such as energy-efficiency, throughput, and latency—without sacrificing accuracy or increasing hardware costs are critical to enabling the wide deployment of DNNs in AI systems. The book includes background on DNN processing; a description and taxonomy of hardware architectural approaches for designing DNN accelerators; key metrics for evaluating and comparing different designs; features of DNN processing that are amenable to hardware/algorithm co-design to improve energy efficiency and throughput; and opportunities for applying new technologies. Readers will find a structured introduction to the field as well as formalization and organization of key concepts from contemporary work that provide insights that may spark new ideas.

Interpretable Machine Learning

Interpretable Machine Learning
Author: Christoph Molnar
Publisher: Lulu.com
Total Pages: 320
Release: 2020
Genre: Computers
ISBN: 0244768528

This book is about making machine learning models and their decisions interpretable. After exploring the concepts of interpretability, you will learn about simple, interpretable models such as decision trees, decision rules and linear regression. Later chapters focus on general model-agnostic methods for interpreting black box models like feature importance and accumulated local effects and explaining individual predictions with Shapley values and LIME. All interpretation methods are explained in depth and discussed critically. How do they work under the hood? What are their strengths and weaknesses? How can their outputs be interpreted? This book will enable you to select and correctly apply the interpretation method that is most suitable for your machine learning project.

Principal Component Neural Networks

Principal Component Neural Networks
Author: K. I. Diamantaras
Publisher: Wiley-Interscience
Total Pages: 282
Release: 1996-03-08
Genre: Computers
ISBN:

Systematically explores the relationship between principal component analysis (PCA) and neural networks. Provides a synergistic examination of the mathematical, algorithmic, application and architectural aspects of principal component neural networks. Using a unified formulation, the authors present neural models performing PCA from the Hebbian learning rule and those which use least squares learning rules such as back-propagation. Examines the principles of biological perceptual systems to explain how the brain works. Every chapter contains a selected list of applications examples from diverse areas.