Author:
Chen Hao-Yuan,Chang Yen-Jui,Liao Shih-Wei,Chang Ching-Ray
Abstract
AbstractQuantum computing holds great potential for advancing the limitations of machine learning algorithms to handle higher dimensions of data and reduce overall training parameters in deep learning (DL) models. This study uses a trainable variational quantum circuit (VQC) on a gate-based quantum computing model to investigate the potential for quantum benefit in a model-free reinforcement learning problem. Through a comprehensive investigation and evaluation of the current model and capabilities of quantum computers, we designed and trained a novel hybrid quantum neural network based on the latest Qiskit and PyTorch framework. We compared its performance with a full-classical CNN with and without an incorporated VQC. Our research provides insights into the potential of deep quantum learning to solve a maze problem and, potentially, other reinforcement learning problems. We conclude that reinforcement learning problems can be practical with reasonable training epochs. Moreover, a comparative study of full-classical and hybrid quantum neural networks is discussed to understand these two approaches’ performance, advantages, and disadvantages to deep Q-learning problems, especially on larger-scale maze problems larger than 4$$\times $$
×
4.
Funder
National Science and Technology Council
Publisher
Springer Science and Business Media LLC
Reference17 articles.
1. Dalla Pozza N, Buffoni L, Martina S et al (2022) Quantum reinforcement learning: the maze problem. Quantum Mach Intell 4:11. https://doi.org/10.1007/s42484-022-00068-y
2. Chen SY-C, Yang C-HH, Qi J, Chen P-Y, Ma X, Goan H-S (2020) Variational quantum circuits for deep reinforcement learning. In IEEE access 8:141007–141024. https://doi.org/10.1109/ACCESS.2020.3010470
3. Biamonte J, Wittek P, Pancotti N et al (2017) Quantum machine learning. Nature 549:195–202. https://doi.org/10.1038/nature23474
4. Zhao C, Gao XS (2019) QDNN: DNN with quantum neural network layers. arXiv:1912.12660
5. Arthur D (2022) A hybrid quantum-classical neural network architecture for binary classification. arXiv:2201.01820