Affiliation:
1. Microsoft Research
2. Microsoft Azure
3. University of Pennsylvania
4. Carnegie Mellon University
5. University of Washington
Abstract
Serverless is a popular choice for cloud service architects because it can provide scalability and load-based billing with minimal developer effort. Functions-as-a-service (FaaS) are originally stateless, but emerging frameworks add stateful abstractions. For instance, the widely used Durable Functions (DF) allow developers to write advanced serverless applications, including reliable workflows and actors, in a programming language of choice. DF implicitly and continuosly persists the state and progress of applications, which greatly simplifies development, but can create an IOps bottleneck.
To improve efficiency, we introduce Netherite, a novel architecture for executing serverless workflows on an elastic cluster. Netherite groups the numerous application objects into a smaller number of partitions, and pipelines the state persistence of each partition. This improves latency and throughput, as it enables workflow steps to group commit, even if causally dependent. Moreover, Netherite leverages FASTER's hybrid log approach to support larger-than-memory application state, and to enable efficient partition movement between compute hosts.
Our evaluation shows that (a) Netherite achieves lower latency and higher throughput than the original DF engine, by more than an order of magnitude in some cases, and (b) that Netherite has lower latency than some commonly used alternatives, like AWS Step Functions or cloud storage triggers.
Publisher
Association for Computing Machinery (ACM)
Subject
General Earth and Planetary Sciences,Water Science and Technology,Geography, Planning and Development
Reference67 articles.
1. [n.d.]. AWS Lambda - Serverless Compute - Amazon Web Services. https://aws.amazon.com/lambda/. [n.d.]. AWS Lambda - Serverless Compute - Amazon Web Services. https://aws.amazon.com/lambda/.
2. 2022. Apache Airflow. https://airflow.apache.org/. 2022. Apache Airflow. https://airflow.apache.org/.
3. 2022. Apache Kafka. http://kafka.apache.org. 2022. Apache Kafka. http://kafka.apache.org.
4. 2022. Apache OpenWhisk. https://openwhisk.apache.org/. 2022. Apache OpenWhisk. https://openwhisk.apache.org/.
5. 2022. AWS Step Functions. https://aws.amazon.com/step-functions/. 2022. AWS Step Functions. https://aws.amazon.com/step-functions/.
Cited by
11 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献