Affiliation:
1. University of California: San Diego, La Jolla, CA
Abstract
Today's cloud-based services integrate globally distributed resources into seamless computing platforms. Provisioning and accounting for the resource usage of these Internet-scale applications presents a challenging technical problem. This paper presents the design and implementation of distributed rate limiters, which work together to enforce a global rate limit across traffic aggregates at multiple sites, enabling the coordinated policing of a cloud-based service's network traffic. Our abstraction not only enforces a global limit, but also ensures that congestion-responsive transport-layer flows behave as if they traversed a single, shared limiter. We present two designs - one general purpose, and one optimized for TCP - that allow service operators to explicitly trade off between communication costs and system accuracy, efficiency, and scalability. Both designs are capable of rate limiting thousands of flows with negligible overhead (less than 3% in the tested configuration). We demonstrate that our TCP-centric design is scalable to hundreds of nodes while robust to both loss and communication delay, making it practical for deployment in nationwide service providers.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Software
Reference40 articles.
1. Packeteer. http://www.packeteer.com. Packeteer. http://www.packeteer.com.
2. Akamai Technologies. Personal communication June 2007. Akamai Technologies. Personal communication June 2007.
3. Amazon. Elastic compute cloud. http://aws.amazon.com/ec2. Amazon. Elastic compute cloud. http://aws.amazon.com/ec2.
4. Sizing router buffers
5. Distributed top-k monitoring
Cited by
65 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Misreporting Attacks Against Load Balancers in Software-Defined Networking;Mobile Networks and Applications;2024-01-09
2. Noah: Reinforcement-Learning-Based Rate Limiter for Microservices in Large-Scale E-Commerce Services;IEEE Transactions on Neural Networks and Learning Systems;2023-09
3. Toward Next-Generation Distributed Rate-limiters;2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing Workshops (CCGridW);2023-05
4. Optimized Throttling for OAuth-Based Authorization Servers;Lecture Notes in Business Information Processing;2023
5. Elastic cloud services;Proceedings of the 13th Symposium on Cloud Computing;2022-11-07