MaxHadoop: An Efficient Scalable Emulation Tool to Test SDN Protocols in Emulated Hadoop Environments-Reference-Cited by-同舟云学术

MaxHadoop: An Efficient Scalable Emulation Tool to Test SDN Protocols in Emulated Hadoop Environments

Published:2020-07-29 Issue:4 Volume:28 Page:1610-1638
ISSN:1064-7570
Container-title:Journal of Network and Systems Management
language:en
Short-container-title:J Netw Syst Manage

Author:

Calcaterra Claudio,Carmenini Alessio,Marotta Andrea^ORCID,Bucci Ubaldo,Cassioli Dajana

Abstract

AbstractThis paper presents MaxHadoop, a flexible and scalable emulation tool, which allows the efficient and accurate emulation of Hadoop environments over Software Defined Networks (SDNs). Hadoop has been designed to manage endless data-streams over networks, making it a tailored candidate to support the new class of network services belonging to Big Data. The development of Hadoop is contemporary with the evolution of networks towards the new architectures “Software Defined.” To create our emulation environment, tailored to SDNs, we employ MaxiNet, given its capability of emulating large-scale SDNs. We make it possible to emulate realistic Hadoop scenarios on large-scale SDNs using low-cost commodity hardware, by resolving a few key limitations of MaxiNet through appropriate configuration settings. We validate the MaxHadoop emulator by executing two benchmarks, namely WordCount and TeraSort, to evaluate a set of Key Performance Indicators. The tests’ outcomes evidence that MaxHadoop outperforms other existing emulation tools running over commodity hardware. Finally, we show the potentiality of MaxHadoop by utilizing it to perform a comparison of SDN-based network protocols.

Publisher

Springer Science and Business Media LLC

Subject

Strategy and Management,Computer Networks and Communications,Hardware and Architecture,Information Systems

Link

https://link.springer.com/content/pdf/10.1007/s10922-020-09552-x.pdf

Reference33 articles.

1. Elalaoui, A.E., Benzekki, K., Fergougui, A.E.: Software-defined networking (SDN): a survey. Secur. Commun. Netw. 9, 5803–5833 (2016)

2. Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J., McKeown, N., Anderson, T.: Openflow: enabling innovation in campus networks. Int. J. Parallel Programm. 38, 69–74 (2008)

3. Fang, G., Lee, B., Qiao, Y., Wang, X.: Doopnet: an emulator for network performance analysis of Hadoop clusters using Docker and Mininet. In: IEEE Symposium on Computers and Communication (ISCC), pp. 784–790, (2016)

4. Schwabe, A., Wallaschek, F., Zahraee, MH., Karl, H., Wette, P., Dräxler, M.: MaxiNet: Distributed emulation of software-defined networks. In: 2014 IFIP Networking Conference, pp. 1–9, (2014)

5. Lebiednik, Brian., Mangal, Aman., Tiwari, Niharika.: A survey and evaluation of data center network topologies. arXiv preprint arXiv:1605.01701. (2016)

Cited by 4 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Towards an Integrated Framework for Managing Software-Defined Networking Models;SoutheastCon 2023;2023-04-01

2. Emulation Tool Diversity for Future Engineering Education;2022 IEEE IFEES World Engineering Education Forum - Global Engineering Deans Council (WEEF-GEDC);2022-11-27

3. A Cost-Aware Management Framework for Placement of Data-Intensive Applications on Federated Cloud;Journal of Network and Systems Management;2021-03-05

4. BigDataSDNSim: A simulator for analyzing big data applications in software‐defined cloud data centers;Software: Practice and Experience;2020-10-27