Affiliation:
1. School of Information and Communication Engineering, Hainan University, Haikou 570228, China
2. School of Electronic Infromation, Central South University, Changsha 410083, China
Abstract
In the dynamic and uncertain stock market, precise forecasting and decision-making are crucial for profitability. Traditional deep neural networks (DNN) often struggle with capturing long-term dependencies and multi-scale features in complex financial time series data. To address these challenges, we introduce CMR-DQN, an innovative framework that integrates discrete wavelet transform (DWT) for multi-scale data analysis, temporal convolutional network (TCN) for extracting deep temporal features, and a GRU–LSTM–Attention mechanism to enhance the model’s focus and memory. Additionally, CMR-DQN employs the Rainbow DQN reinforcement learning strategy to learn optimal trading strategies in a simulated environment. CMR-DQN significantly improved the total return rate on six selected stocks, with increases ranging from 20.37% to 55.32%. It also demonstrated substantial improvements over the baseline model in terms of Sharpe ratio and maximum drawdown, indicating increased excess returns per unit of total risk and reduced investment risk. These results underscore the efficiency and effectiveness of CMR-DQN in handling multi-scale time series data and optimizing stock market decisions.
Funder
Hainan University under Grant
National Key Research and Development Program of China
National Natural Science Foundation of China
Performance Computing Center of Central South University
Reference39 articles.
1. Forecasting the changes in daily stock prices in Shanghai Stock Exchange using Neural Network and Ordinary Least Squares Regression;Prime;Investig. Manag. Financ. Innov.,2020
2. Dixon, F., Halperin, I., and Bilokon, P. (2020). Machine Learning in Finance: From Theory to Practice, Springer International Publishing.
3. Recent advances in reinforcement learning in finance;Hambly;Math. Financ.,2023
4. Reinforcement learning applied to Forex trading;Rui;Appl. Soft Comput.,2018
5. Koyano, S., and Ikeda, K. (December, January 27). Online portfolio selection based on the posts of winners and losers in stock microblogs. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA.