Reconstruction, Identification and Implementation Methods for Spiking Neural Circuits

Reconstruction, Identification and Implementation Methods for Spiking Neural Circuits
Author: Dorian Florescu
Publisher: Springer
Total Pages: 148
Release: 2017-04-24
Genre: Technology & Engineering
ISBN: 3319570811

This work is motivated by the ongoing open question of how information in the outside world is represented and processed by the brain. Consequently, several novel methods are developed. A new mathematical formulation is proposed for the encoding and decoding of analog signals using integrate-and-fire neuron models. Based on this formulation, a novel algorithm, significantly faster than the state-of-the-art method, is proposed for reconstructing the input of the neuron. Two new identification methods are proposed for neural circuits comprising a filter in series with a spiking neuron model. These methods reduce the number of assumptions made by the state-of-the-art identification framework, allowing for a wider range of models of sensory processing circuits to be inferred directly from input-output observations. A third contribution is an algorithm that computes the spike time sequence generated by an integrate-and-fire neuron model in response to the output of a linear filter, given the input of the filter encoded with the same neuron model.

Learning in Spiking Neural Networks

Learning in Spiking Neural Networks
Author: Sergio Davies
Publisher:
Total Pages:
Release: 2013
Genre:
ISBN:

Artificial neural network simulators are a research field which attracts the interest of researchers from various fields, from biology to computer science. The final objectives are the understanding of the mechanisms underlying the human brain, how to reproduce them in an artificial environment, and how drugs interact with them. Multiple neural models have been proposed, each with their peculiarities, from the very complex and biologically realistic Hodgkin-Huxley neuron model to the very simple 'leaky integrate-and-fire' neuron. However, despite numerous attempts to understand the learning behaviour of the synapses, few models have been proposed. Spike-Timing-Dependent Plasticity (STDP) is one of the most relevant and biologically plausible models, and some variants (such as the triplet-based STDP rule) have been proposed to accommodate all biological observations. The research presented in this thesis focuses on a novel learning rule, based on the spike-pair STDP algorithm, which provides a statistical approach with the advantage of being less computationally expensive than the standard STDP rule, and is therefore suitable for its implementation on stand-alone computational units. The environment in which this research work has been carried out is the SpiNNaker project, which aims to provide a massively parallel computational substrate for neural simulation. To support such research, two other topics have been addressed: the first is a way to inject spikes into the SpiNNaker system through a non-real-time channel such as the Ethernet link, synchronising with the timing of the SpiNNaker system. The second research topic is focused on a way to route spikes in the SpiNNaker system based on populations of neurons. The three topics are presented in sequence after a brief introduction to the SpiNNaker project. Future work could include structural plasticity (also known as synaptic rewiring); here, during the simulation of neural networks on the SpiNNaker system, axons, dendrites and synapses may be grown or pruned according to biological observations.

Neural Information Processing

Neural Information Processing
Author: Akira Hirose
Publisher: Springer
Total Pages: 646
Release: 2016-09-30
Genre: Computers
ISBN: 3319466879

The four volume set LNCS 9947, LNCS 9948, LNCS 9949, and LNCS 9950 constitutes the proceedings of the 23rd International Conference on Neural Information Processing, ICONIP 2016, held in Kyoto, Japan, in October 2016. The 296 full papers presented were carefully reviewed and selected from 431 submissions. The 4 volumes are organized in topical sections on deep and reinforcement learning; big data analysis; neural data analysis; robotics and control; bio-inspired/energy efficient information processing; whole brain architecture; neurodynamics; bioinformatics; biomedical engineering; data mining and cybersecurity workshop; machine learning; neuromorphic hardware; sensory perception; pattern recognition; social networks; brain-machine interface; computer vision; time series analysis; data-driven approach for extracting latent features; topological and graph based clustering methods; computational intelligence; data mining; deep neural networks; computational and cognitive neurosciences; theory and algorithms.

Spike-based learning application for neuromorphic engineering

Spike-based learning application for neuromorphic engineering
Author: Anup Das
Publisher: Frontiers Media SA
Total Pages: 235
Release: 2024-08-22
Genre: Science
ISBN: 2832553184

Spiking Neural Networks (SNN) closely imitate biological networks. Information processing occurs in both spatial and temporal manner, making SNN extremely interesting for the pertinent mimicking of the biological brain. Biological brains code and transmit the sensory information in the form of spikes that capture the spatial and temporal information of the environment with amazing precision. This information is processed in an asynchronous way by the neural layer performing recognition of complex spatio-temporal patterns with sub-milliseconds delay and at with a power budget in the order of 20W. The efficient spike coding mechanism and the asynchronous and sparse processing and communication of spikes seems to be key in the energy efficiency and high-speed computation capabilities of biological brains. SNN low-power and event-based computation make them more attractive when compared to other artificial neural networks (ANN).

Form Versus Function: Theory and Models for Neuronal Substrates

Form Versus Function: Theory and Models for Neuronal Substrates
Author: Mihai Alexandru Petrovici
Publisher: Springer
Total Pages: 394
Release: 2016-07-19
Genre: Science
ISBN: 3319395521

This thesis addresses one of the most fundamental challenges for modern science: how can the brain as a network of neurons process information, how can it create and store internal models of our world, and how can it infer conclusions from ambiguous data? The author addresses these questions with the rigorous language of mathematics and theoretical physics, an approach that requires a high degree of abstraction to transfer results of wet lab biology to formal models. The thesis starts with an in-depth description of the state-of-the-art in theoretical neuroscience, which it subsequently uses as a basis to develop several new and original ideas. Throughout the text, the author connects the form and function of neuronal networks. This is done in order to achieve functional performance of biological brains by transferring their form to synthetic electronics substrates, an approach referred to as neuromorphic computing. The obvious aspect that this transfer can never be perfect but necessarily leads to performance differences is substantiated and explored in detail. The author also introduces a novel interpretation of the firing activity of neurons. He proposes a probabilistic interpretation of this activity and shows by means of formal derivations that stochastic neurons can sample from internally stored probability distributions. This is corroborated by the author’s recent findings, which confirm that biological features like the high conductance state of networks enable this mechanism. The author goes on to show that neural sampling can be implemented on synthetic neuromorphic circuits, paving the way for future applications in machine learning and cognitive computing, for example as energy-efficient implementations of deep learning networks. The thesis offers an essential resource for newcomers to the field and an inspiration for scientists working in theoretical neuroscience and the future of computing.

Synaptic Plasticity for Neuromorphic Systems

Synaptic Plasticity for Neuromorphic Systems
Author: Christian Mayr
Publisher: Frontiers Media SA
Total Pages: 178
Release: 2016-06-26
Genre: Neurosciences. Biological psychiatry. Neuropsychiatry
ISBN: 2889198774

One of the most striking properties of biological systems is their ability to learn and adapt to ever changing environmental conditions, tasks and stimuli. It emerges from a number of different forms of plasticity, that change the properties of the computing substrate, mainly acting on the modification of the strength of synaptic connections that gate the flow of information across neurons. Plasticity is an essential ingredient for building artificial autonomous cognitive agents that can learn to reliably and meaningfully interact with the real world. For this reason, the neuromorphic community at large has put substantial effort in the design of different forms of plasticity and in putting them to practical use. These plasticity forms comprise, among others, Short Term Depression and Facilitation, Homeostasis, Spike Frequency Adaptation and diverse forms of Hebbian learning (e.g. Spike Timing Dependent Plasticity). This special research topic collects the most advanced developments in the design of the diverse forms of plasticity, from the single circuit to the system level, as well as their exploitation in the implementation of cognitive systems.

Biomimetic and Biohybrid Systems

Biomimetic and Biohybrid Systems
Author: Nathan F. Lepora
Publisher: Springer
Total Pages: 480
Release: 2013-07-01
Genre: Computers
ISBN: 3642398022

This book constitutes the refereed proceedings of the second International Conference on Biomimetic and Biohybrid Systems, Living Machines 2013, held in London, UK, in July/August 2013. The 65 revised full papers presented were carefully reviewed and selected from various submissions. The papers are targeted at the intersection of research on novel live-like technologies inspired by scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems

Artificial Neural Networks and Machine Learning -- ICANN 2012

Artificial Neural Networks and Machine Learning -- ICANN 2012
Author: Alessandro Villa
Publisher: Springer
Total Pages: 763
Release: 2012-09-19
Genre: Computers
ISBN: 3642332692

The two-volume set LNCS 7552 + 7553 constitutes the proceedings of the 22nd International Conference on Artificial Neural Networks, ICANN 2012, held in Lausanne, Switzerland, in September 2012. The 162 papers included in the proceedings were carefully reviewed and selected from 247 submissions. They are organized in topical sections named: theoretical neural computation; information and optimization; from neurons to neuromorphism; spiking dynamics; from single neurons to networks; complex firing patterns; movement and motion; from sensation to perception; object and face recognition; reinforcement learning; bayesian and echo state networks; recurrent neural networks and reservoir computing; coding architectures; interacting with the brain; swarm intelligence and decision-making; mulitlayer perceptrons and kernel networks; training and learning; inference and recognition; support vector machines; self-organizing maps and clustering; clustering, mining and exploratory analysis; bioinformatics; and time weries and forecasting.