Auto-tuning Spark Big Data Workloads on POWER8-Reference-Cited by-同舟云学术

Auto-tuning Spark Big Data Workloads on POWER8

Published:2016-09-11 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 2016 International Conference on Parallel Architectures and Compilation
language:
Short-container-title:

Author:

Jia Zhen¹,Xue Chao²,Chen Guancheng²,Zhan Jianfeng¹,Zhang Lixin¹,Lin Yonghua²,Hofstee Peter³

Affiliation:

1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

2. IBM Research-China, Beijing, China

3. IBM Research-Austin, Austin, TX, USA

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/2967938.2967957

Reference50 articles.

1. Apache Flink. https://flink.apache.org/index.html. Apache Flink. https://flink.apache.org/index.html.

2. Performance counters for linux. https://perf.wiki.kernel.org/index.php. Performance counters for linux. https://perf.wiki.kernel.org/index.php.

3. Spark Performance Tests. In Webpage: https://github.com/databricks/spark-perf. Spark Performance Tests. In Webpage: https://github.com/databricks/spark-perf.

4. BAE Detica. The big data refinery: Distilling intelligence from big data. White Paper https://www.baesystemsdetica.com/uploads/resources/Big_Data_Refinery_Whitepaper_single_pages_19.06.12.pdf July 2012. BAE Detica. The big data refinery: Distilling intelligence from big data. White Paper https://www.baesystemsdetica.com/uploads/resources/Big_Data_Refinery_Whitepaper_single_pages_19.06.12.pdf July 2012.

Cited by 18 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Towards General and Efficient Online Tuning for Spark;Proceedings of the VLDB Endowment;2023-08

2. SimCost: cost-effective resource provision prediction and recommendation for spark workloads;Distributed and Parallel Databases;2023-06-22

3. LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications;Proceedings of the 2022 International Conference on Management of Data;2022-06-10

4. Runtime prediction of big data jobs: performance comparison of machine learning algorithms and analytical models;Journal of Big Data;2022-05-19

5. Adaptive Code Learning for Spark Configuration Tuning;2022 IEEE 38th International Conference on Data Engineering (ICDE);2022-05