MonkeyKing: Adaptive Parameter Tuning on Big Data Platforms with Deep Reinforcement Learning-Reference-Cited by-同舟云学术

MonkeyKing: Adaptive Parameter Tuning on Big Data Platforms with Deep Reinforcement Learning

Published:2020-08-01 Issue:4 Volume:8 Page:270-290
ISSN:2167-6461
Container-title:Big Data
language:en
Short-container-title:Big Data

Author:

Du Haizhou¹²,Han Ping²,Xiang Qiao³,Huang Sheng²

Affiliation:

1. College of Electronics and Information Engineering, Tongji University, Shanghai, China.

2. School of Computer Science and Technology, Shanghai University of Electric Power, Shanghai, China.

3. Department of Computer Science, Yale University, New Haven, Connecticut, USA.

Publisher

Mary Ann Liebert Inc

Subject

Information Systems and Management,Computer Science Applications,Information Systems

Link

https://www.liebertpub.com/doi/pdf/10.1089/big.2019.0123

Reference46 articles.

1. 4. Alipourfard O, Liu HH, Chen J, et al. Cherrypick: Adaptively unearthing the best cloud configurations for big data analytics. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), Boston, MA: USENIX Association, 2017. pp. 469–482.

2. A Methodology for Spark Parameter Tuning

3. 6. Wang H, Cao Y. An energy efficiency optimization and control model for hadoop clusters. IEEE Access. 7:2019;40534–40549.

4. 7. 4th International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2018, Sousse, Tunisia, March 21–24, 2018. IEEE, 2018.

5. 8. Zhang F, Zhai J, Snir M, et al. (Eds): Network and Parallel Computing—15th IFIP WG 10.3 International Conference, NPC 2018, Muroran, Japan, November 29–December 1, 2018, Proceedings, volume 11276 of Lecture Notes in Computer Science. Springer, 2018.

Cited by 8 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Semantic Feature-Driven Automatic Parameter Optimization of Apache Spark;2024 4th International Conference on Neural Networks, Information and Communication (NNICE);2024-01-19

2. Deep reinforcement learning enhances artistic creativity: The case study of program art students integrating computer deep learning;Journal of Intelligent Systems;2024-01-01

3. Hyperparameter Black-Box Optimization to Improve the Automatic Classification of Support Tickets;Algorithms;2023-01-10

4. An innovative parameter optimization of Spark Streaming based on D3QN with Gaussian process regression;Mathematical Biosciences and Engineering;2023

5. Design and evaluation of adaptive system for big data cyber security analytics;Expert Systems with Applications;2022-11