Abstract
Abstract
Many inference scenarios rely on extracting relevant information from known data in order to make future predictions. When the underlying stochastic process satisfies certain assumptions, there is a direct mapping between its exact classical and quantum simulators, with the latter asymptotically using less memory. Here we focus on studying whether such quantum advantage persists when those assumptions are not satisfied, and the model is doomed to have imperfect accuracy. By studying the trade-off between accuracy and memory requirements, we show that quantum models can reach the same accuracy with less memory, or alternatively, better accuracy with the same memory. Finally, we discuss the implications of this result for learning tasks.
Funder
Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU
Reference40 articles.
1. Attention is all you need;Vaswani,2017
2. Formal algorithms for transformers;Phuong,2022
3. Inferring statistical complexity;Crutchfield;Phys. Rev. Lett.,1989
4. Statistical complexity of simple one-dimensional spin systems;Crutchfield;Phys. Rev. E,1997
5. Computational mechanics: pattern and prediction structure and simplicity;Shalizi;J. Stat. Phys.,2001