Affiliation:
1. Voronezh State Technical University
Abstract
The principles of machine learning are discussed in terms of non-linear mappings and signal mixing. We considered the characteristics of the capabilities of algorithmic reservoir computers based on the software implementation of artificial neurons with random weights of input signals, and physical reservoir computers using various random and non-linear phenomena. The main elements of the concept of extremal learning machines are outlined, their features and the algorithm for learning a linear output with comb regularization by the method of pseudo-inverse Moore-Penrose matrices are described. The study found the subdivision of optical reservoir computers by types and spatial scales of the physical processes used. Optical Extreme Learning Machines (OELM) are identified as a promising area of implementation. The structure of the diffractive OELM, its principle of operation based on the scattering by random elements, and its inherent limitations are described. The use of plasmonic metal nanostructures to reduce the size of such processors is proposed. To implement the quantum version of the OELM signal with frequency modulation, a new approach to processors operating on systems of artificial atoms with random interactions has been formulated. The study proposed to incite and read signals using the methods of three-pulse femtosecond pump-probe spectroscopy. The need for a low level of relaxation during the processor cycle is noted for stable operation of the circuit. The study discussed an individual atom generating high harmonics in a strong laser field as the fundamental quantum limit of the processor, and described the physical mechanism providing this effect. For each of the three OELM options, critically important tasks are formulated, the consistent solution of which will significantly bring the creation of technologically significant OELM closer.
Reference24 articles.
1. Goodfellow I., Bengio Y., Courville A. Deep Learning. London, 2016. 800 p. (Russ. ed.: Goodfellow I., Bengio Y., Courville A. Deep Learning. 2nd ed. Moscow, DMK Press Publ., 2018. 652 p.).
2. Lugnan A., Katumba A., Laporte F. Freiberger M., Sackesyn S. Photonic Neuromorphic Information Processing and Reservoir Computing. APL Photonics, 2020, no. 5, pp. 020901.
3. Nakajima K., Fischer I. (eds.). Reservoir Computing. Theory, Physical Implementations, and Applications. Singapore, 2021. 457 p.
4. Jaeger H. The ”Echo State” Approach to Analysing and Training Recurrent Neural Networks : GMD Report 148. German National Research Center for Information Technology, 2001. 47 p.
5. Maass W., Natschl¨ager T., Markram H. Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations. Neural Computation, 2020, no. 14, pp. 2531–2560.