An ensemble approach integrating LSTM and ARIMA models for enhanced financial market predictions

Abstract

Forecasting financial markets is a complex task that requires addressing various challenges, such as market complexity, data heterogeneity, the need for rapid response and constant changes in conditions, to gain a competitive advantage. To effectively address these challenges, it is necessary to constantly improve existing and develop new methods of intelligent forecasting, which will improve the accuracy of forecasts, reduce risks and increase the productivity of financial decision-making processes. In this article, we study and analyse forecasting methods in financial markets, such as support vector regression (SVR), autoregressive integrated moving average (ARIMA), long short-term memory recurrent neural network (LSTM) and extreme gradient boosting algorithm (XG-Boost). Based on this analysis, we propose an ensemble forecasting procedure that integrates LSTM and ARIMA models. Due to the careful combination of these models, our approach yields better results than individual methods. For example, our model demonstrates a significant 15% improvement in root mean square error (RMSE) and a slight improvement in coefficient of determination compared with LSTM. Furthermore, simulation results obtained on three real-world datasets and evaluated using the RMSE criterion confirm the superiority of our proposed method over alternative methods such as LSTMs, transformer models and optimized deep recurrent neural networks with long short-term memory for financial market forecasting. Furthermore, our approach creates the prerequisites for parallelizing both models, thus providing an opportunity to accelerate forecasting results in future research.