Affiliation:
1. Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
2. Research Center of Spatial-Temporal Data Management and Data Science, Institute of Software, Chinese Academy of Sciences, Beijing 100090, China
Abstract
Query optimization is one of the key factors affecting the performance of database systems that aim to enact the query execution plan with minimum cost. Particularly in distributed database systems, due to the multiple copies of the data that are stored in different data nodes, resulting in the dramatic increase in the feasible query execution plans for a query statement. Because of the increasing volume of stored data, the cluster size of distributed databases also increases, resulting in poor performance of current query optimization algorithms. In this case, a dynamic perturbation-based artificial bee colony algorithm is proposed to solve the query optimization problem in distributed database systems. The improved artificial bee colony algorithm improves the global search capability by combining the selection, crossover, and mutation operators of the genetic algorithm to overcome the problem of falling into the local optimal solution easily. At the same time, the dynamic perturbation factor is introduced so that the algorithm parameters can be dynamically varied along with the process of iteration as well as the convergence degree of the whole population to improve the convergence efficiency of the algorithm. Finally, comparative experiments conducted to assess the average execution cost of Top-k query plans generated by the algorithms and the convergence speed of algorithms under the conditions of query statements in six different dimension sets. The results demonstrate that the Top-k query plans generated by the proposed method have a lower execution cost and a faster convergence speed, which can effectively improve the query efficiency. However, this method requires more execution time.
Funder
National Key R&D Program of China
Key R&D Program of Shandong Province
National Natural Science of Foundation of China
Reference41 articles.
1. IDC (2018, October 16). Global Data Volume Trends [EB/OL]. Available online: https://www.seagate.com/files/www-content/our-StoryAmazon/trends/files/idc-seagate-dataage-chine-whitepaper.pdf.
2. MGI (2011, May 13). Big Data: The Next Frontier for Innovation, Competition, and Productivity [EB/OL]. Available online: https://www.mckinsey.com/business-Functions/mckinsey-digital/our-insights/big-data-the-next-frontier-for-innovation.
3. Fault-tolerant based group key servers with enhancement of utilizing the contributory server for cloud storage applications;Vivekrabinson;IETE J. Res.,2021
4. Design and analysis of stochastic DSS query optimizers in a distributed database system;Sharma;Egypt. Inform. J.,2016
5. Özsu, M.T., and Valduriez, P. (1999). Principles of Distributed Database Systems, Prentice-Hall, Inc.. [2nd ed.].