Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task

Author:

Forno Evelina,Fra Vittorio,Pignari Riccardo,Macii Enrico,Urgese Gianvito

Abstract

Spiking Neural Networks (SNNs), known for their potential to enable low energy consumption and computational cost, can bring significant advantages to the realm of embedded machine learning for edge applications. However, input coming from standard digital sensors must be encoded into spike trains before it can be elaborated with neuromorphic computing technologies. We present here a detailed comparison of available spike encoding techniques for the translation of time-varying signals into the event-based signal domain, tested on two different datasets both acquired through commercially available digital devices: the Free Spoken Digit dataset (FSD), consisting of 8-kHz audio files, and the WISDM dataset, composed of 20-Hz recordings of human activity through mobile and wearable inertial sensors. We propose a complete pipeline to benchmark these encoding techniques by performing time-dependent signal classification through a Spiking Convolutional Neural Network (sCNN), including a signal preprocessing step consisting of a bank of filters inspired by the human cochlea, feature extraction by production of a sonogram, transfer learning via an equivalent ANN, and model compression schemes aimed at resource optimization. The resulting performance comparison and analysis provides a powerful practical tool, empowering developers to select the most suitable coding method based on the type of data and the desired processing algorithms, and further expands the applicability of neuromorphic computational paradigms to embedded sensor systems widely employed in the IoT and industrial domains.

Funder

Electronic Components and Systems for European Leadership

HORIZON EUROPE Framework Programme

Ministero dell’Università e della Ricerca

Publisher

Frontiers Media SA

Subject

General Neuroscience

Reference105 articles.

1. “Short paper: neuromorphic chip embedded electronic systems to expand artificial intelligence,”;Abeysekara;2019 Second International Conference on Artificial Intelligence for Industries (AI4I),2019

2. A comparison of low-complexity real-time feature extraction for neuromorphic speech recognition;Acharya;Front. Neurosci,2018

3. Unsupervised real-time anomaly detection for streaming data;Ahmad;Neurocomputing,2017

4. “Wideband speech and audio coding using gammatone filter banks,”;Ambikairajah;2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221), Vol. 2,2001

5. Feature representations for neuromorphic audio spike streams;Anumula;Front. Neurosci,2018

Cited by 6 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Review of open neuromorphic architectures and a first integration in the RISC-V PULP platform;2023 IEEE 16th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC);2023-12-18

2. SPAIC: A sub-μW/Channel, 16-Channel General-Purpose Event-Based Analog Front-End with Dual-Mode Encoders;2023 IEEE Biomedical Circuits and Systems Conference (BioCAS);2023-10-19

3. Integrate-and-fire circuit for converting analog signals to spikes using phase encoding *;Neuromorphic Computing and Engineering;2023-10-16

4. Efficiency metrics for auditory neuromorphic spike encoding techniques using information theory;Neuromorphic Computing and Engineering;2023-06-01

5. Integration of neuromorphic AI in event-driven distributed digitized systems: Concepts and research directions;Frontiers in Neuroscience;2023-02-17

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3