Spark Parameter Tuning via Trial-and-Error

Author:

Petridis Panagiotis,Gounaris Anastasios,Torres Jordi

Publisher

Springer International Publishing

Reference10 articles.

1. Awan, A.J., Brorsson, M., Vlassov, V., Ayguade, E.: How data volume affects spark based data analytics on a scale-up server (2015). arXiv:1507.08340

2. Holl, S., Zimmermann, O., Palmblad, M., Mohammed, Y., Hofmann-Apitius, M.: A new optimization phase for scientific workflow management systems. Future Gener. Comput. Syst. 36, 352–362 (2014)

3. Karau, H., Konwinski, A., Wendell, P., Zaharia, M.: Learning Spark: Lightning-Fast Data Analysis. O’Reilly Media, Sebastopol (2015)

4. Ousterhout, K., Rasti, R., Ratnasamy, S., Shenker, S., Chun, B.G.: Making sense of performance in data analytics frameworks. In: 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2015), pp. 293–307 (2015)

5. Petridis, P., Gounaris, A., Torres, J.: Spark parameter tuning via trial-and-error. arXiv:1607.07348

Cited by 20 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Performance optimization of Spark MLlib workloads using cost efficient RICG model on exponential projective sampling;Cluster Computing;2024-05-08

2. MFRLMO: Model-free reinforcement learning for multi-objective optimization of apache spark;ICST Transactions on Scalable Information Systems;2024-02-20

3. Co-Tuning of Cloud Infrastructure and Distributed Data Processing Platforms;2023 IEEE International Conference on Big Data (BigData);2023-12-15

4. Performance Driven Experimental Analysis of Apache Spark Configuration Parameters;2023 7th International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS);2023-11-02

5. Mjolnir: A framework agnostic auto-tuning system with deep reinforcement learning;Applied Intelligence;2022-10-20

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3