Author:
Comşa Iulia-Maria,Versari Luca,Fischbacher Thomas,Alakuijala Jyrki
Abstract
Spiking neural networks with temporal coding schemes process information based on the relative timing of neuronal spikes. In supervised learning tasks, temporal coding allows learning through backpropagation with exact derivatives, and achieves accuracies on par with conventional artificial neural networks. Here we introduce spiking autoencoders with temporal coding and pulses, trained using backpropagation to store and reconstruct images with high fidelity from compact representations. We show that spiking autoencoders with a single layer are able to effectively represent and reconstruct images from the neuromorphically-encoded MNIST and FMNIST datasets. We explore the effect of different spike time target latencies, data noise levels and embedding sizes, as well as the classification performance from the embeddings. The spiking autoencoders achieve results similar to or better than conventional non-spiking autoencoders. We find that inhibition is essential in the functioning of the spiking autoencoders, particularly when the input needs to be memorised for a longer time before the expected output spike times. To reconstruct images with a high target latency, the network learns to accumulate negative evidence and to use the pulses as excitatory triggers for producing the output spikes at the required times. Our results highlight the potential of spiking autoencoders as building blocks for more complex biologically-inspired architectures. We also provide open-source code for the model.
Reference55 articles.
1. AbadiM.
AgarwalA.
BarhamP.
BrevdoE.
ChenZ.
CitroC.
TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems2015
2. Building functional networks of spiking model neurons;Abbott;Nat. Neurosci,2016
3. Improved spikeprop for using particle swarm optimization;Ahmed;Math. Probl. Eng,2013
4. Representation learning: a review and new perspectives;Bengio;IEEE Trans. Pattern Anal. Mach. Intell,2013
5. BengioY.
LeeD.-H.
BornscheinJ.
MesnardT.
LinZ.
Towards biologically plausible deep learning. 2015
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献