Affiliation:
1. University of Fribourg, Switzerland
2. TU Darmstadt & Google
3. TU Darmstadt
4. Intel
5. Microsoft Research
Abstract
Modern cloud networks are a fundamental pillar of data-intensive applications. They provide high-speed transaction (packet) rates and low overhead, enabling, for instance, truly scalable database designs. These networks, however, are fundamentally different from conventional ones. Arguably, the two key discerning technologies are RDMA and programmable network devices. Today, these technologies are not niche technologies anymore and are widely deployed across all major cloud vendors. The question is thus not if but how a new breed of data-intensive applications can benefit from modern networks, given the perceived difficulty in using and programming them. This tutorial addresses these challenges by exposing how the underlying principles changed as the network evolved and by presenting the new system design opportunities they opened. In the process, we also discuss several hard-earned lessons accumulated by making the transition first-hand.
Publisher
Association for Computing Machinery (ACM)
Subject
General Earth and Planetary Sciences,Water Science and Technology,Geography, Planning and Development
Reference31 articles.
1. Wei Bai , Shanim Sainul Abdeen , Ankit Agrawal, Krishan Kumar Attre, Paramvir Bahl, et al. 2023 . Empowering Azure Storage with RDMA. In NSDI. Wei Bai, Shanim Sainul Abdeen, Ankit Agrawal, Krishan Kumar Attre, Paramvir Bahl, et al. 2023. Empowering Azure Storage with RDMA. In NSDI.
2. C. Binnig A. Crotty A. Galakatos T. Kraska and E. Zamanian. 2016. The End of Slow Networks: It's Time for a Redesign. In PVLDB. C. Binnig A. Crotty A. Galakatos T. Kraska and E. Zamanian. 2016. The End of Slow Networks: It's Time for a Redesign. In PVLDB.
3. M. Blöcher T. Ziegler C. Binnig and P. Eugster. 2018. Boosting Scalable Data Analytics with Modern Programmable Networks. In DaMoN. M. Blöcher T. Ziegler C. Binnig and P. Eugster. 2018. Boosting Scalable Data Analytics with Modern Programmable Networks. In DaMoN.
4. M. Burke , S. Dharanipragada , S. Joyner , A. Szekeres , J. Nelson , I. Zhang , and D. R. K. Ports . 2021 . PRISM: Rethinking the RDMA Interface for Distributed Systems. In SOSP. M. Burke, S. Dharanipragada, S. Joyner, A. Szekeres, J. Nelson, I. Zhang, and D. R. K. Ports. 2021. PRISM: Rethinking the RDMA Interface for Distributed Systems. In SOSP.
5. N. Gebara A. Lerner M. Yang M. Yu P. Costa and M. Ghobadi. 2020. Challenging the Stateless Quo of Programmable Switches. In HotNets. N. Gebara A. Lerner M. Yang M. Yu P. Costa and M. Ghobadi. 2020. Challenging the Stateless Quo of Programmable Switches. In HotNets.