ImRP: A Predictive Partition Method for Data Skew Alleviation in Spark Streaming Environment-Reference-Cited by-同舟云学术

ImRP: A Predictive Partition Method for Data Skew Alleviation in Spark Streaming Environment

Published:2020-12 Issue: Volume:100 Page:102699
ISSN:0167-8191
Container-title:Parallel Computing
language:en
Short-container-title:Parallel Computing

Author:

Fu Zhongming,Tang Zhuo,Yang Li,Li Kenli,Li Keqin

Publisher

Elsevier BV

Subject

Artificial Intelligence,Computer Graphics and Computer-Aided Design,Computer Networks and Communications,Hardware and Architecture,Theoretical Computer Science,Software

Reference41 articles.

1. Real-time stream processing for big data;Wingerath;it - Information Technology,2016

2. Spark streaming, https://spark.apache.org/streaming/.

3. M. Zaharia, An architecture for fast and general data processing on large clusters, in: Ph.D. thesis, EECS Department, University of California, Berkeley (Feb 2014). http://www2.eecs.berkeley.edu/Pubs/TechRpts/2014/EECS-2014-12.html.

4. Apache storm, http://storm.apache.org/.

5. Telegraphcq: continuous dataflow processing;Chandrasekaran,2003

Cited by 6 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Cost-Aware Scheduling and Data Skew Alleviation for Big Data Processing in Heterogeneous Cloud Environment;Journal of Grid Computing;2023-06-22

2. Adaptive load balancing in cluster computing environment;The Journal of Supercomputing;2023-06-10

3. An innovative parameter optimization of Spark Streaming based on D3QN with Gaussian process regression;Mathematical Biosciences and Engineering;2023

4. A Cluster-Based Partition Method of Remote Sensing Data for Efficient Distributed Image Processing;Remote Sensing;2022-10-05

5. Dynamic data replacement and adaptive scheduling policies in spark;Cluster Computing;2022-01-19