Reconstruction, Identification and Implementation Methods for Spiking Neural Circuits

Reconstruction, Identification and Implementation Methods for Spiking Neural Circuits
Author: Dorian Florescu
Publisher: Springer
Total Pages: 148
Release: 2017-04-24
Genre: Technology & Engineering
ISBN: 3319570811

This work is motivated by the ongoing open question of how information in the outside world is represented and processed by the brain. Consequently, several novel methods are developed. A new mathematical formulation is proposed for the encoding and decoding of analog signals using integrate-and-fire neuron models. Based on this formulation, a novel algorithm, significantly faster than the state-of-the-art method, is proposed for reconstructing the input of the neuron. Two new identification methods are proposed for neural circuits comprising a filter in series with a spiking neuron model. These methods reduce the number of assumptions made by the state-of-the-art identification framework, allowing for a wider range of models of sensory processing circuits to be inferred directly from input-output observations. A third contribution is an algorithm that computes the spike time sequence generated by an integrate-and-fire neuron model in response to the output of a linear filter, given the input of the filter encoded with the same neuron model.

Spike-based learning application for neuromorphic engineering

Spike-based learning application for neuromorphic engineering
Author: Anup Das
Publisher: Frontiers Media SA
Total Pages: 235
Release: 2024-08-22
Genre: Science
ISBN: 2832553184

Spiking Neural Networks (SNN) closely imitate biological networks. Information processing occurs in both spatial and temporal manner, making SNN extremely interesting for the pertinent mimicking of the biological brain. Biological brains code and transmit the sensory information in the form of spikes that capture the spatial and temporal information of the environment with amazing precision. This information is processed in an asynchronous way by the neural layer performing recognition of complex spatio-temporal patterns with sub-milliseconds delay and at with a power budget in the order of 20W. The efficient spike coding mechanism and the asynchronous and sparse processing and communication of spikes seems to be key in the energy efficiency and high-speed computation capabilities of biological brains. SNN low-power and event-based computation make them more attractive when compared to other artificial neural networks (ANN).

Neural Information Processing

Neural Information Processing
Author: Akira Hirose
Publisher: Springer
Total Pages: 646
Release: 2016-09-30
Genre: Computers
ISBN: 3319466879

The four volume set LNCS 9947, LNCS 9948, LNCS 9949, and LNCS 9950 constitutes the proceedings of the 23rd International Conference on Neural Information Processing, ICONIP 2016, held in Kyoto, Japan, in October 2016. The 296 full papers presented were carefully reviewed and selected from 431 submissions. The 4 volumes are organized in topical sections on deep and reinforcement learning; big data analysis; neural data analysis; robotics and control; bio-inspired/energy efficient information processing; whole brain architecture; neurodynamics; bioinformatics; biomedical engineering; data mining and cybersecurity workshop; machine learning; neuromorphic hardware; sensory perception; pattern recognition; social networks; brain-machine interface; computer vision; time series analysis; data-driven approach for extracting latent features; topological and graph based clustering methods; computational intelligence; data mining; deep neural networks; computational and cognitive neurosciences; theory and algorithms.

Synaptic Plasticity for Neuromorphic Systems

Synaptic Plasticity for Neuromorphic Systems
Author: Christian Mayr
Publisher: Frontiers Media SA
Total Pages: 178
Release: 2016-06-26
Genre: Neurosciences. Biological psychiatry. Neuropsychiatry
ISBN: 2889198774

One of the most striking properties of biological systems is their ability to learn and adapt to ever changing environmental conditions, tasks and stimuli. It emerges from a number of different forms of plasticity, that change the properties of the computing substrate, mainly acting on the modification of the strength of synaptic connections that gate the flow of information across neurons. Plasticity is an essential ingredient for building artificial autonomous cognitive agents that can learn to reliably and meaningfully interact with the real world. For this reason, the neuromorphic community at large has put substantial effort in the design of different forms of plasticity and in putting them to practical use. These plasticity forms comprise, among others, Short Term Depression and Facilitation, Homeostasis, Spike Frequency Adaptation and diverse forms of Hebbian learning (e.g. Spike Timing Dependent Plasticity). This special research topic collects the most advanced developments in the design of the diverse forms of plasticity, from the single circuit to the system level, as well as their exploitation in the implementation of cognitive systems.

Synaptic Circuits and Functions in Bio-inspired Integrated Architectures

Synaptic Circuits and Functions in Bio-inspired Integrated Architectures
Author: Ole Richter
Publisher: University of Groningen
Total Pages: 362
Release: 2024-10-15
Genre: Technology & Engineering
ISBN:

Based upon the most advanced human-made technology on this planet, CMOS integrated circuit technology, this dissertation examines the design of hardware components and systems to establish a technological foundation for the application of future breakthroughs in the intersection of AI and neuroscience. Humans have long imagined machines, robots, and computers that learn and display intelligence akin to animals and themselves. To advance the development of these machines, specialised research in custom-built hardware designed for specific types of computation, which mirrors the structure of powerful biological nervous systems, is especially important. This dissertation is driven by the quest to harness biological and artificial neural principles to enhance the efficiency, adaptability, and intelligence of electronic neurosynaptic and neuromorphic hardware systems. It investigates the hardware design of bio-inspired neural components and their integration into more extensive scale and efficient chip architectures suitable for edge processing and near-sensor environments. Exploring all steps to the creation of a custom chip, this work selectively surveys and advances the state-of-the-art in bio-inspired mixed-signal subthreshold integrated design for neurosynaptic systems in a practical fashion. Further, it presents a novel asynchronous digital convolutional neuronal network processing pipeline integrated with a vision sensor for smart sensing. In conclusion, it sets forth a series of open challenges and future directions for the field, emphasizing the need for a robust, future-proof base for bio-inspired design and the potential of asynchronous stream processor architectures.

Biomimetic and Biohybrid Systems

Biomimetic and Biohybrid Systems
Author: Nathan F. Lepora
Publisher: Springer
Total Pages: 480
Release: 2013-07-01
Genre: Computers
ISBN: 3642398022

This book constitutes the refereed proceedings of the second International Conference on Biomimetic and Biohybrid Systems, Living Machines 2013, held in London, UK, in July/August 2013. The 65 revised full papers presented were carefully reviewed and selected from various submissions. The papers are targeted at the intersection of research on novel live-like technologies inspired by scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems

Form Versus Function: Theory and Models for Neuronal Substrates

Form Versus Function: Theory and Models for Neuronal Substrates
Author: Mihai Alexandru Petrovici
Publisher: Springer
Total Pages: 394
Release: 2016-07-19
Genre: Science
ISBN: 3319395521

This thesis addresses one of the most fundamental challenges for modern science: how can the brain as a network of neurons process information, how can it create and store internal models of our world, and how can it infer conclusions from ambiguous data? The author addresses these questions with the rigorous language of mathematics and theoretical physics, an approach that requires a high degree of abstraction to transfer results of wet lab biology to formal models. The thesis starts with an in-depth description of the state-of-the-art in theoretical neuroscience, which it subsequently uses as a basis to develop several new and original ideas. Throughout the text, the author connects the form and function of neuronal networks. This is done in order to achieve functional performance of biological brains by transferring their form to synthetic electronics substrates, an approach referred to as neuromorphic computing. The obvious aspect that this transfer can never be perfect but necessarily leads to performance differences is substantiated and explored in detail. The author also introduces a novel interpretation of the firing activity of neurons. He proposes a probabilistic interpretation of this activity and shows by means of formal derivations that stochastic neurons can sample from internally stored probability distributions. This is corroborated by the author’s recent findings, which confirm that biological features like the high conductance state of networks enable this mechanism. The author goes on to show that neural sampling can be implemented on synthetic neuromorphic circuits, paving the way for future applications in machine learning and cognitive computing, for example as energy-efficient implementations of deep learning networks. The thesis offers an essential resource for newcomers to the field and an inspiration for scientists working in theoretical neuroscience and the future of computing.

Towards an Integrated Approach to Measurement, Analysis and Modeling of Cortical Networks

Towards an Integrated Approach to Measurement, Analysis and Modeling of Cortical Networks
Author: A. Ravishankar Rao
Publisher: Frontiers Media SA
Total Pages: 266
Release: 2016-03-17
Genre: Neurosciences. Biological psychiatry. Neuropsychiatry
ISBN: 288919762X

The amount of data being produced by neuroscientists is increasing rapidly, driven by advances in neuroimaging and recording techniques spanning multiple scales of resolution. The availability of such data poses significant challenges for their processing and interpretation. To gain a deeper understanding of the surrounding issues, the Editors of this e-Book reached out to an interdisciplinary community, and formed the Cortical Networks Working Group, and the genesis of this e-Book thus began with the formation of this Working Group, which was supported by the National Institute for Mathematical and Biological Synthesis in the USA. The Group consisted of scientists from neuroscience, physics, psychology and computer science, and meetings were held in person. (A detailed list of the group members is presented in the Editorial that follows.) At the time we started, in 2010, the term “big data” was hardly in existence, though the volume of data we were handling would certainly have qualified. Furthermore, there was significant interest in harnessing the power of supercomputers to perform large scale neuronal simulations, and in creating specialized hardware to mimic neural function. We realized that the various disciplines represented in our Group could and should work together to accelerate progress in Neuroscience. We searched for common threads that could define the foundation for an integrated approach to solve important problems in the field. We adopted a network-centric perspective to address these challenges, as the data are derived from structures that are themselves network-like. We proposed three inter-twined threads, consisting of measurement of neural activity, analysis of network structures deduced from this activity, and modeling of network function, leading to theoretical insights. This approach formed the foundation of our initial call for papers. When we issued the call for papers, we were not sure how many papers would fall into each of these threads. We were pleased that we found significant interest in each thread, and the number of submissions exceeded our expectations. This is an indication that the field of neuroscience is ripe for the type of integration and interchange that we had anticipated. We first published a special topics issue after we received a sufficient number of submissions. This is now being converted to an e-book to strengthen the coherence of its contributions. One of the strong themes emerging in this e-book is that network-based measures capture better the dynamics of brain processes, and provide features with greater discriminative power than point-based measures. Another theme is the importance of network oscillations and synchrony. Current research is shedding light on the principles that govern the establishment and maintenance of network oscillation states. These principles could explain why there is impaired synchronization between different brain areas in schizophrenics and Parkinson’s patients. Such research could ultimately provide the foundation for an understanding of other psychiatric and neurodegenerative conditions. The chapters in this book cover these three main threads related to cortical networks. Some authors have combined two or more threads within a single chapter. We expect the availability of related work appearing in a single e-book to help our readers see the connection between different research efforts, and spur further insights and research.

Cameron's Thesis

Cameron's Thesis
Author: Cameron Patterson
Publisher: Lulu.com
Total Pages: 234
Release: 2012-12-30
Genre: Science
ISBN: 1326590065

Both the visualisation and management of large-scale computer hardware is difficult due to its distributed nature. This thesis develops a framework to support both these goals on the SpiNNaker neural network architecture - which can scale to more than a million processors. The solution provides visualisation and management to the SpiNNaker machine, traversing the hardware and software divide to provide a unified solution for the real-time monitoring of artificial neural networks, and the SpiNNaker hardware on which it runs. This book is the story of its development