Abstract
AbstractWhile physical reservoir computing is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving its performance is deep reservoir computing, in which the component reservoirs are multi-layered. However, all of the deep-reservoir schemes reported so far have been effective only for simulation reservoirs and limited physical reservoirs, and there have been no reports of nanodevice implementations. Here, as an ionics-based neuromorphic nanodevice implementation of deep-reservoir computing, we report a demonstration of deep physical reservoir computing with maximum of four layers using an ion gating reservoir, which is a small and high-performance physical reservoir. While the previously reported deep-reservoir scheme did not improve the performance of the ion gating reservoir, our deep-ion gating reservoir achieved a normalized mean squared error of 9.08 × 10−3 on a second-order nonlinear autoregressive moving average task, which is the best performance of any physical reservoir so far reported in this task. More importantly, the device outperformed full simulation reservoir computing. The dramatic performance improvement of the ion gating reservoir with our deep-reservoir computing architecture paves the way for high-performance, large-scale, physical neural network devices.
Funder
MEXT | Japan Science and Technology Agency
MEXT | Japan Society for the Promotion of Science
Iketani Science and Technology Foundation
Ministry of Education, Culture, Sports, Science and Technology
Publisher
Springer Science and Business Media LLC
Reference58 articles.
1. Tanaka, G. et al. Recent advances in physical reservoir computing: A review. Neural Netw. 115, 100–123 (2019).
2. Nakajima, K. Physical reservoir computing—an introductory perspective. Jpn. J. Appl. Phys. 59, 060501 (2020).
3. Jaeger, H. The ‘echo state’ approach to analysing and training recurrent neural networks-with an Erratum note 1. Germany. Ger. Natl Res. Cent. Inf. Technol. GMD Tech. Rep. 148, 13 (2001).
4. Jaeger, H. & Haas, H. Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science 304, 78–80 (2004).
5. Paquot, Y. et al. Optoelectronic reservoir computing. Sci. Rep. 2, 287 (2012).