On exploring efficient shuffle design for in-memory MapReduce-Reference-Cited by-同舟云学术

On exploring efficient shuffle design for in-memory MapReduce

Published:2016-06-26 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 3rd ACM SIGMOD Workshop on Algorithms and Systems for MapReduce and Beyond
language:
Short-container-title:

Author:

Daikoku Harunobu¹,Kawashima Hideyuki¹,Tatebe Osamu¹

Affiliation:

1. University of Tsukuba

Funder

JST CREST Statistical Computational Comsmology with Big Astronomical Imaging Data

JST CREST System Software for Post Petascale Data Intenseive Science

JSPS KAKENHI

JST CREST Extreme Big Data (EBD) Next Generation Big Data Infrastructure Technologies Towards Yottabyte / Year

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/2926534.2926538

Reference29 articles.

1. MapReduce with communication overlap (MaRCO)

2. Apache. Apache hadoop. http://hadoop.apache.org/. Apache. Apache hadoop. http://hadoop.apache.org/.

3. Apache. Apache hive. http://hive.apache.org/. Apache. Apache hive. http://hive.apache.org/.

4. Apache. Apache spark. http://spark.apache.org/. Apache. Apache spark. http://spark.apache.org/.

5. Apache. Randomtextwriter.java. https://github.com/apache/hadoop/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/RandomTextWriter.java. Apache. Randomtextwriter.java. https://github.com/apache/hadoop/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/RandomTextWriter.java.

Cited by 1 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Skew-Aware Collective Communication for MapReduce Shuffling;IEICE Transactions on Information and Systems;2019-12-01