Optimization of Spark Data Skew in Big Data Environment-Reference-Cited by-同舟云学术

Optimization of Spark Data Skew in Big Data Environment

Published:2023-08-25 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 2023 International Conference on Computer, Vision and Intelligent Technology
language:
Short-container-title:

Author:

Wang Huanshu¹^ORCID,Wang Huali¹^ORCID

Affiliation:

1. Changsha University of Science & Technology, China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3627341.3630380

Reference21 articles.

1. Research on University Campus Big Data Platform Based on Hadoop and Spark [J] .;Ping L;Software Engineering

2. Improving Load Balancing for MapReduce-based Matching [J];Midoun K;International Journal of Artificial Intelligence,2019

3. Martha V S , Zhao W , Xu X . h- MapReduce : A Framework for Workload Balancing in MapReduce [C]//IEEE Computer Society . IEEE Computer Society , 2013 : 637-644. Martha V S, Zhao W, Xu X .h-MapReduce: A Framework for Workload Balancing in MapReduce [C]//IEEE Computer Society.IEEE Computer Society, 2013:637-644.

4. Gufler B , Augsten N , Reiser A , HANDLING DATA SKEW IN MAPREDUCE [C]//CLOSER 2011 - Proceedings of the 1st International Conference on Cloud Computing and Services Science , Noordwijkerhout , Netherlands , 7-9 May, 2011:1-7. Gufler B, Augsten N, Reiser A, HANDLING DATA SKEW IN MAPREDUCE [C]//CLOSER 2011 - Proceedings of the 1st International Conference on Cloud Computing and Services Science, Noordwijkerhout, Netherlands, 7-9 May, 2011:1-7.

5. Son J Choi H Chung Y D .Skew-Tolerant Key Distribution for Load Balancing in MapReduce [J] .Ieice Trans.inf . & Syst 2012 95 (2): 677-680. Son J Choi H Chung Y D .Skew-Tolerant Key Distribution for Load Balancing in MapReduce [J] .Ieice Trans.inf . & Syst 2012 95 (2): 677-680.