Exploiting oscillatory dynamics of delay systems for reservoir computing

Author:

Goldmann Mirko1ORCID,Fischer Ingo1ORCID,Mirasso Claudio R.1ORCID,C. Soriano Miguel1ORCID

Affiliation:

1. Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC, UIB-CSIC) , Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain

Abstract

Nonlinear dynamical systems exhibiting inherent memory can process temporal information by exploiting their responses to input drives. Reservoir computing is a prominent approach to leverage this ability for time-series forecasting. The computational capabilities of analog computing systems often depend on both the dynamical regime of the system and the input drive. Most studies have focused on systems exhibiting a stable fixed-point solution in the absence of input. Here, we go beyond that limitation, investigating the computational capabilities of a paradigmatic delay system in three different dynamical regimes. The system we chose has an Ikeda-type nonlinearity and exhibits fixed point, bistable, and limit-cycle dynamics in the absence of input. When driving the system, new input-driven dynamics emerge from the autonomous ones featuring characteristic properties. Here, we show that it is feasible to attain consistent responses across all three regimes, which is an essential prerequisite for the successful execution of the tasks. Furthermore, we demonstrate that we can exploit all three regimes in two time-series forecasting tasks, showcasing the versatility of this paradigmatic delay system in an analog computing context. In all tasks, the lowest prediction errors were obtained in the regime that exhibits limit-cycle dynamics in the undriven reservoir. To gain further insights, we analyzed the diverse time-distributed node responses generated in the three regimes of the undriven system. An increase in the effective dimensionality of the reservoir response is shown to affect the prediction error, as also fine-tuning of the distribution of nonlinear responses. Finally, we demonstrate that a trade-off between prediction accuracy and computational speed is possible in our continuous delay systems. Our results not only provide valuable insights into the computational capabilities of complex dynamical systems but also open a new perspective on enhancing the potential of analog computing systems implemented on various hardware platforms.

Funder

HORIZON EUROPE Marie Sklodowska-Curie Actions

Horizon 2020 Framework Programme

Publisher

AIP Publishing

Subject

Applied Mathematics,General Physics and Astronomy,Mathematical Physics,Statistical and Nonlinear Physics

Reference50 articles.

1. Q. V. Le , N.Jaitly, and G. E.Hinton, “A simple way to initialize recurrent networks of rectified linear units,” arXiv:1504.00941 (2015).

2. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication;Science,2004

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3