Efficient Processing of Deep Neural Networks

Efficient Processing of Deep Neural Networks
Author: Vivienne Sze
Publisher: Springer Nature
Total Pages: 254
Release: 2022-05-31
Genre: Technology & Engineering
ISBN: 3031017668

This book provides a structured treatment of the key principles and techniques for enabling efficient processing of deep neural networks (DNNs). DNNs are currently widely used for many artificial intelligence (AI) applications, including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at the cost of high computational complexity. Therefore, techniques that enable efficient processing of deep neural networks to improve key metrics—such as energy-efficiency, throughput, and latency—without sacrificing accuracy or increasing hardware costs are critical to enabling the wide deployment of DNNs in AI systems. The book includes background on DNN processing; a description and taxonomy of hardware architectural approaches for designing DNN accelerators; key metrics for evaluating and comparing different designs; features of DNN processing that are amenable to hardware/algorithm co-design to improve energy efficiency and throughput; and opportunities for applying new technologies. Readers will find a structured introduction to the field as well as formalization and organization of key concepts from contemporary work that provide insights that may spark new ideas.

In-/Near-Memory Computing

In-/Near-Memory Computing
Author: Daichi Fujiki
Publisher: Springer Nature
Total Pages: 124
Release: 2022-05-31
Genre: Technology & Engineering
ISBN: 3031017722

This book provides a structured introduction of the key concepts and techniques that enable in-/near-memory computing. For decades, processing-in-memory or near-memory computing has been attracting growing interest due to its potential to break the memory wall. Near-memory computing moves compute logic near the memory, and thereby reduces data movement. Recent work has also shown that certain memories can morph themselves into compute units by exploiting the physical properties of the memory cells, enabling in-situ computing in the memory array. While in- and near-memory computing can circumvent overheads related to data movement, it comes at the cost of restricted flexibility of data representation and computation, design challenges of compute capable memories, and difficulty in system and software integration. Therefore, wide deployment of in-/near-memory computing cannot be accomplished without techniques that enable efficient mapping of data-intensive applications to such devices, without sacrificing accuracy or increasing hardware costs excessively. This book describes various memory substrates amenable to in- and near-memory computing, architectural approaches for designing efficient and reliable computing devices, and opportunities for in-/near-memory acceleration of different classes of applications.

Emerging Non-volatile Memory Technologies

Emerging Non-volatile Memory Technologies
Author: Wen Siang Lew
Publisher: Springer Nature
Total Pages: 439
Release: 2021-01-09
Genre: Science
ISBN: 9811569126

This book offers a balanced and comprehensive guide to the core principles, fundamental properties, experimental approaches, and state-of-the-art applications of two major groups of emerging non-volatile memory technologies, i.e. spintronics-based devices as well as resistive switching devices, also known as Resistive Random Access Memory (RRAM). The first section presents different types of spintronic-based devices, i.e. magnetic tunnel junction (MTJ), domain wall, and skyrmion memory devices. This section describes how their developments have led to various promising applications, such as microwave oscillators, detectors, magnetic logic, and neuromorphic engineered systems. In the second half of the book, the underlying device physics supported by different experimental observations and modelling of RRAM devices are presented with memory array level implementation. An insight into RRAM desired properties as synaptic element in neuromorphic computing platforms from material and algorithms viewpoint is also discussed with specific example in automatic sound classification framework.

NANO-CHIPS 2030

NANO-CHIPS 2030
Author: Boris Murmann
Publisher: Springer Nature
Total Pages: 597
Release: 2020-06-08
Genre: Science
ISBN: 3030183386

In this book, a global team of experts from academia, research institutes and industry presents their vision on how new nano-chip architectures will enable the performance and energy efficiency needed for AI-driven advancements in autonomous mobility, healthcare, and man-machine cooperation. Recent reviews of the status quo, as presented in CHIPS 2020 (Springer), have prompted the need for an urgent reassessment of opportunities in nanoelectronic information technology. As such, this book explores the foundations of a new era in nanoelectronics that will drive progress in intelligent chip systems for energy-efficient information technology, on-chip deep learning for data analytics, and quantum computing. Given its scope, this book provides a timely compendium that hopes to inspire and shape the future of nanoelectronics in the decades to come.

Memristors for Neuromorphic Circuits and Artificial Intelligence Applications

Memristors for Neuromorphic Circuits and Artificial Intelligence Applications
Author: Jordi Suñé
Publisher: MDPI
Total Pages: 244
Release: 2020-04-09
Genre: Technology & Engineering
ISBN: 3039285769

Artificial Intelligence (AI) has found many applications in the past decade due to the ever increasing computing power. Artificial Neural Networks are inspired in the brain structure and consist in the interconnection of artificial neurons through artificial synapses. Training these systems requires huge amounts of data and, after the network is trained, it can recognize unforeseen data and provide useful information. The so-called Spiking Neural Networks behave similarly to how the brain functions and are very energy efficient. Up to this moment, both spiking and conventional neural networks have been implemented in software programs running on conventional computing units. However, this approach requires high computing power, a large physical space and is energy inefficient. Thus, there is an increasing interest in developing AI tools directly implemented in hardware. The first hardware demonstrations have been based on CMOS circuits for neurons and specific communication protocols for synapses. However, to further increase training speed and energy efficiency while decreasing system size, the combination of CMOS neurons with memristor synapses is being explored. The memristor is a resistor with memory which behaves similarly to biological synapses. This book explores the state-of-the-art of neuromorphic circuits implementing neural networks with memristors for AI applications.

In-Memory Computing Hardware Accelerators for Data-Intensive Applications

In-Memory Computing Hardware Accelerators for Data-Intensive Applications
Author: Baker Mohammad
Publisher: Springer Nature
Total Pages: 145
Release: 2023-10-27
Genre: Technology & Engineering
ISBN: 303134233X

This book describes the state-of-the-art of technology and research on In-Memory Computing Hardware Accelerators for Data-Intensive Applications. The authors discuss how processing-centric computing has become insufficient to meet target requirements and how Memory-centric computing may be better suited for the needs of current applications. This reveals for readers how current and emerging memory technologies are causing a shift in the computing paradigm. The authors do deep-dive discussions on volatile and non-volatile memory technologies, covering their basic memory cell structures, operations, different computational memory designs and the challenges associated with them. Specific case studies and potential applications are provided along with their current status and commercial availability in the market.

Frontiers of Quality Electronic Design (QED)

Frontiers of Quality Electronic Design (QED)
Author: Ali Iranmanesh
Publisher: Springer Nature
Total Pages: 690
Release: 2023-01-11
Genre: Technology & Engineering
ISBN: 3031163443

Quality Electronic Design (QED)’s landscape spans a vast region where territories of many participating disciplines and technologies overlap. This book explores the latest trends in several key topics related to quality electronic design, with emphasis on Hardware Security, Cybersecurity, Machine Learning, and application of Artificial Intelligence (AI). The book includes topics in nonvolatile memories (NVM), Internet of Things (IoT), FPGA, and Neural Networks.

System Dependability and Analytics

System Dependability and Analytics
Author: Long Wang
Publisher: Springer Nature
Total Pages: 429
Release: 2022-07-25
Genre: Technology & Engineering
ISBN: 3031020634

This book comprises chapters authored by experts who are professors and researchers in internationally recognized universities and research institutions. The book presents the results of research and descriptions of real-world systems, services, and technologies. Reading this book, researchers, professional practitioners, and graduate students will gain a clear vision on the state of the art of the research and real-world practice on system dependability and analytics. The book is published in honor of Professor Ravishankar K. Iyer, the George and Ann Fisher Distinguished Professor in the Department of Electrical and Computer Engineering at the University of Illinois at Urbana-Champaign (UIUC), Urbana, Illinois. Professor Iyer is ACM Fellow, IEEE Fellow, AAAS Fellow, and served as Interim Vice Chancellor of UIUC for research during 2008–2011. The book contains chapters written by many of his former students.

Processing-in-Memory for AI

Processing-in-Memory for AI
Author: Joo-Young Kim
Publisher: Springer Nature
Total Pages: 168
Release: 2022-07-09
Genre: Technology & Engineering
ISBN: 3030987817

This book provides a comprehensive introduction to processing-in-memory (PIM) technology, from its architectures to circuits implementations on multiple memory types and describes how it can be a viable computer architecture in the era of AI and big data. The authors summarize the challenges of AI hardware systems, processing-in-memory (PIM) constraints and approaches to derive system-level requirements for a practical and feasible PIM solution. The presentation focuses on feasible PIM solutions that can be implemented and used in real systems, including architectures, circuits, and implementation cases for each major memory type (SRAM, DRAM, and ReRAM).

Embedded Machine Learning for Cyber-Physical, IoT, and Edge Computing

Embedded Machine Learning for Cyber-Physical, IoT, and Edge Computing
Author: Sudeep Pasricha
Publisher: Springer Nature
Total Pages: 418
Release: 2023-11-01
Genre: Technology & Engineering
ISBN: 303119568X

This book presents recent advances towards the goal of enabling efficient implementation of machine learning models on resource-constrained systems, covering different application domains. The focus is on presenting interesting and new use cases of applying machine learning to innovative application domains, exploring the efficient hardware design of efficient machine learning accelerators, memory optimization techniques, illustrating model compression and neural architecture search techniques for energy-efficient and fast execution on resource-constrained hardware platforms, and understanding hardware-software codesign techniques for achieving even greater energy, reliability, and performance benefits.