Author:
Chuang Ming-Chin,Yen Chia-Cheng,Hung Chia-Jui
Abstract
Recently, with the increase in network bandwidth, various cloud computing applications have become popular. A large number of network data packets will be generated in such a network. However, most existing network architectures cannot effectively handle big data, thereby necessitating an efficient mechanism to reduce task completion time when large amounts of data are processed in data center networks. Unfortunately, achieving the minimum task completion time in the Hadoop system is an NP-complete problem. Although many studies have proposed schemes for improving network performance, they have shortcomings that degrade their performance. For this reason, in this study, we propose a centralized solution, called the bandwidth-aware rescheduling (BARE) mechanism for software-defined network (SDN)-based data center networks. BARE improves network performance by employing a prefetching mechanism and a centralized network monitor to collect global information, sorting out the locality data process, splitting tasks, and executing a rescheduling mechanism with a scheduler to reduce task completion time. Finally, we used simulations to demonstrate our scheme’s effectiveness. Simulation results show that our scheme outperforms other existing schemes in terms of task completion time and the ratio of data locality.
Funder
Ministry of Science and Technology, Taiwan
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference25 articles.
1. Apache Hadoophttp://hadoop.apache.org/
2. MapReduce
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Towards Greener Data Centers via Programmable Data Plane;2023 IEEE 24th International Conference on High Performance Switching and Routing (HPSR);2023-06-05
2. Deep Reinforcement Learning- based load balancing strategy for multiple controllers in SDN;e-Prime - Advances in Electrical Engineering, Electronics and Energy;2022
3. Energy-efficient SDN for Internet of Things in smart city;Internet of Things and Cyber-Physical Systems;2022