Efficient shuffle management for DAG computing frameworks based on the FRQ model-Reference-Cited by-同舟云学术

Efficient shuffle management for DAG computing frameworks based on the FRQ model

Published:2021-03 Issue: Volume:149 Page:163-173
ISSN:0743-7315
Container-title:Journal of Parallel and Distributed Computing
language:en
Short-container-title:Journal of Parallel and Distributed Computing

Author:

Ren Rui,Wu Chunghsuan,Fu Zhouwang,Song Tao,Liu Yanqiang^ORCID,Qi Zhengwei,Guan Haibing

Funder

National Natural Science Foundation of China

National Key Research and Development Program of China

Publisher

Elsevier BV

Subject

Artificial Intelligence,Computer Networks and Communications,Hardware and Architecture,Theoretical Computer Science,Software

Reference46 articles.

1. F. Ahmad, S.T. Chakradhar, A. Raghunathan, T. Vijaykumar, ShuffleWatcher: Shuffle-aware scheduling in multi-tenant MapReduce Clusters, in: USENIX Annual Technical Conference, 2014, pp. 1–12.

2. PACMan: Coordinated memory caching for parallel jobs;Ananthanarayanan,2012

3. Towards automatic optimization of MapReduce programs;Babu,2010

4. Apache Flink: Stream and batch processing in a single engine;Carbone;Bull. IEEE Comput. Soc. Tech. Comm. Data Eng.,2015

5. Interactive analytical processing in big data systems: A cross-industry study of MapReduce workloads;Chen;Proc. VLDB Endow.,2012

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Optimization of the Join between Large Tables in the Spark Distributed Framework;Applied Sciences;2023-05-19

2. Hadoop Map Reduce Techniques: Simplified Data Processing on Large Clusters with Data Mining;2022 Sixth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC);2022-11-10