Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design

Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design
Author: Nan Zheng
Publisher: John Wiley & Sons
Total Pages: 296
Release: 2019-12-31
Genre: Computers
ISBN: 1119507383

Explains current co-design and co-optimization methodologies for building hardware neural networks and algorithms for machine learning applications This book focuses on how to build energy-efficient hardware for neural networks with learning capabilities—and provides co-design and co-optimization methodologies for building hardware neural networks that can learn. Presenting a complete picture from high-level algorithm to low-level implementation details, Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design also covers many fundamentals and essentials in neural networks (e.g., deep learning), as well as hardware implementation of neural networks. The book begins with an overview of neural networks. It then discusses algorithms for utilizing and training rate-based artificial neural networks. Next comes an introduction to various options for executing neural networks, ranging from general-purpose processors to specialized hardware, from digital accelerator to analog accelerator. A design example on building energy-efficient accelerator for adaptive dynamic programming with neural networks is also presented. An examination of fundamental concepts and popular learning algorithms for spiking neural networks follows that, along with a look at the hardware for spiking neural networks. Then comes a chapter offering readers three design examples (two of which are based on conventional CMOS, and one on emerging nanotechnology) to implement the learning algorithm found in the previous chapter. The book concludes with an outlook on the future of neural network hardware. Includes cross-layer survey of hardware accelerators for neuromorphic algorithms Covers the co-design of architecture and algorithms with emerging devices for much-improved computing efficiency Focuses on the co-design of algorithms and hardware, which is especially critical for using emerging devices, such as traditional memristors or diffusive memristors, for neuromorphic computing Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design is an ideal resource for researchers, scientists, software engineers, and hardware engineers dealing with the ever-increasing requirement on power consumption and response time. It is also excellent for teaching and training undergraduate and graduate students about the latest generation neural networks with powerful learning capabilities.

Resistive Switching: Oxide Materials, Mechanisms, Devices and Operations

Resistive Switching: Oxide Materials, Mechanisms, Devices and Operations
Author: Jennifer Rupp
Publisher: Springer Nature
Total Pages: 386
Release: 2021-10-15
Genre: Technology & Engineering
ISBN: 3030424243

This book provides a broad examination of redox-based resistive switching memories (ReRAM), a promising technology for novel types of nanoelectronic devices, according to the International Technology Roadmap for Semiconductors, and the materials and physical processes used in these ionic transport-based switching devices. It covers defect kinetic models for switching, ReRAM deposition/fabrication methods, tuning thin film microstructures, and material/device characterization and modeling. A slate of world-renowned authors address the influence of type of ionic carriers, their mobility, the role of the local and chemical composition and environment, and facilitate readers’ understanding of the effects of composition and structure at different length scales (e.g., crystalline vs amorphous phases, impact of extended defects such as dislocations and grain boundaries). ReRAMs show outstanding potential for scaling down to the atomic level, fast operation in the nanosecond range, low power consumption, and non-volatile storage. The book is ideal for materials scientists and engineers concerned with novel types of nanoelectronic devices such as memories, memristors, and switches for logic and neuromorphic computing circuits beyond the von Neumann concept.

Synaptic Plasticity for Neuromorphic Systems

Synaptic Plasticity for Neuromorphic Systems
Author: Christian Mayr
Publisher: Frontiers Media SA
Total Pages: 178
Release: 2016-06-26
Genre: Neurosciences. Biological psychiatry. Neuropsychiatry
ISBN: 2889198774

One of the most striking properties of biological systems is their ability to learn and adapt to ever changing environmental conditions, tasks and stimuli. It emerges from a number of different forms of plasticity, that change the properties of the computing substrate, mainly acting on the modification of the strength of synaptic connections that gate the flow of information across neurons. Plasticity is an essential ingredient for building artificial autonomous cognitive agents that can learn to reliably and meaningfully interact with the real world. For this reason, the neuromorphic community at large has put substantial effort in the design of different forms of plasticity and in putting them to practical use. These plasticity forms comprise, among others, Short Term Depression and Facilitation, Homeostasis, Spike Frequency Adaptation and diverse forms of Hebbian learning (e.g. Spike Timing Dependent Plasticity). This special research topic collects the most advanced developments in the design of the diverse forms of plasticity, from the single circuit to the system level, as well as their exploitation in the implementation of cognitive systems.

Resistive Random Access Memory (RRAM)

Resistive Random Access Memory (RRAM)
Author: Shimeng Yu
Publisher: Springer Nature
Total Pages: 71
Release: 2022-06-01
Genre: Technology & Engineering
ISBN: 3031020308

RRAM technology has made significant progress in the past decade as a competitive candidate for the next generation non-volatile memory (NVM). This lecture is a comprehensive tutorial of metal oxide-based RRAM technology from device fabrication to array architecture design. State-of-the-art RRAM device performances, characterization, and modeling techniques are summarized, and the design considerations of the RRAM integration to large-scale array with peripheral circuits are discussed. Chapter 2 introduces the RRAM device fabrication techniques and methods to eliminate the forming process, and will show its scalability down to sub-10 nm regime. Then the device performances such as programming speed, variability control, and multi-level operation are presented, and finally the reliability issues such as cycling endurance and data retention are discussed. Chapter 3 discusses the RRAM physical mechanism, and the materials characterization techniques to observe the conductive filaments and the electrical characterization techniques to study the electronic conduction processes. It also presents the numerical device modeling techniques for simulating the evolution of the conductive filaments as well as the compact device modeling techniques for circuit-level design. Chapter 4 discusses the two common RRAM array architectures for large-scale integration: one-transistor-one-resistor (1T1R) and cross-point architecture with selector. The write/read schemes are presented and the peripheral circuitry design considerations are discussed. Finally, a 3D integration approach is introduced for building ultra-high density RRAM array. Chapter 5 is a brief summary and will give an outlook for RRAM’s potential novel applications beyond the NVM applications.

Neuromorphic Photonics

Neuromorphic Photonics
Author: Paul R. Prucnal
Publisher: CRC Press
Total Pages: 412
Release: 2017-05-08
Genre: Science
ISBN: 1498725244

This book sets out to build bridges between the domains of photonic device physics and neural networks, providing a comprehensive overview of the emerging field of "neuromorphic photonics." It includes a thorough discussion of evolution of neuromorphic photonics from the advent of fiber-optic neurons to today’s state-of-the-art integrated laser neurons, which are a current focus of international research. Neuromorphic Photonics explores candidate interconnection architectures and devices for integrated neuromorphic networks, along with key functionality such as learning. It is written at a level accessible to graduate students, while also intending to serve as a comprehensive reference for experts in the field.

Memristors for Neuromorphic Circuits and Artificial Intelligence Applications

Memristors for Neuromorphic Circuits and Artificial Intelligence Applications
Author: Jordi Suñé
Publisher: MDPI
Total Pages: 244
Release: 2020-04-09
Genre: Technology & Engineering
ISBN: 3039285769

Artificial Intelligence (AI) has found many applications in the past decade due to the ever increasing computing power. Artificial Neural Networks are inspired in the brain structure and consist in the interconnection of artificial neurons through artificial synapses. Training these systems requires huge amounts of data and, after the network is trained, it can recognize unforeseen data and provide useful information. The so-called Spiking Neural Networks behave similarly to how the brain functions and are very energy efficient. Up to this moment, both spiking and conventional neural networks have been implemented in software programs running on conventional computing units. However, this approach requires high computing power, a large physical space and is energy inefficient. Thus, there is an increasing interest in developing AI tools directly implemented in hardware. The first hardware demonstrations have been based on CMOS circuits for neurons and specific communication protocols for synapses. However, to further increase training speed and energy efficiency while decreasing system size, the combination of CMOS neurons with memristor synapses is being explored. The memristor is a resistor with memory which behaves similarly to biological synapses. This book explores the state-of-the-art of neuromorphic circuits implementing neural networks with memristors for AI applications.

Memristors and Memristive Systems

Memristors and Memristive Systems
Author: Ronald Tetzlaff
Publisher: Springer Science & Business Media
Total Pages: 409
Release: 2013-12-11
Genre: Technology & Engineering
ISBN: 1461490685

This book provides a comprehensive overview of current research on memristors, memcapacitors and, meminductors. In addition to an historical overview of the research in this area, coverage includes the theory behind memristive circuits, as well as memcapacitance, and meminductance. Details are shown for recent applications of memristors for resistive random access memories, neuromorphic systems and hybrid CMOS/memristor circuits. Methods for the simulation of memristors are demonstrated and an introduction to neuromorphic modeling is provided.

Neuromorphic Devices for Brain-inspired Computing

Neuromorphic Devices for Brain-inspired Computing
Author: Qing Wan
Publisher: John Wiley & Sons
Total Pages: 258
Release: 2022-05-16
Genre: Technology & Engineering
ISBN: 3527349790

Explore the cutting-edge of neuromorphic technologies with applications in Artificial Intelligence In Neuromorphic Devices for Brain-Inspired Computing: Artificial Intelligence, Perception, and Robotics, a team of expert engineers delivers a comprehensive discussion of all aspects of neuromorphic electronics designed to assist researchers and professionals to understand and apply all manner of brain-inspired computing and perception technologies. The book covers both memristic and neuromorphic devices, including spintronic, multi-terminal, and neuromorphic perceptual applications. Summarizing recent progress made in five distinct configurations of brain-inspired computing, the authors explore this promising technology’s potential applications in two specific areas: neuromorphic computing systems and neuromorphic perceptual systems. The book also includes: A thorough introduction to two-terminal neuromorphic memristors, including memristive devices and resistive switching mechanisms Comprehensive explorations of spintronic neuromorphic devices and multi-terminal neuromorphic devices with cognitive behaviors Practical discussions of neuromorphic devices based on chalcogenide and organic materials In-depth examinations of neuromorphic computing and perceptual systems with emerging devices Perfect for materials scientists, biochemists, and electronics engineers, Neuromorphic Devices for Brain-Inspired Computing: Artificial Intelligence, Perception, and Robotics will also earn a place in the libraries of neurochemists, neurobiologists, and neurophysiologists.