INFless: a native serverless system for low-latency, high-throughput inference-Reference-Cited by-同舟云学术

INFless: a native serverless system for low-latency, high-throughput inference

Published:2022-02-22 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems
language:
Short-container-title:

Author:

Yang Yanan¹^ORCID,Zhao Laiping¹,Li Yiming¹,Zhang Huanyu¹,Li Jie¹,Zhao Mingyang¹,Chen Xingzhen²,Li Keqiu¹

Affiliation:

1. Tianjin University, China

2. 58.com, China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3503222.3507709

Reference42 articles.

1. Fathom: reference workloads for modern deep learning methods

2. AILab. 2019. Deep learning inference. https://github.com/wuba/dl_inference AILab. 2019. Deep learning inference. https://github.com/wuba/dl_inference

3. BATCH: Machine Learning Inference Serving on Serverless Platforms with Adaptive Batching

4. AWS. 2020. Serverless Application Lens: Alexa Skills. https://docs.aws.amazon.com/wellarchitected/latest/serverless-applications-lens/alexa-skills.html AWS. 2020. Serverless Application Lens: Alexa Skills. https://docs.aws.amazon.com/wellarchitected/latest/serverless-applications-lens/alexa-skills.html

5. Microsoft Azure. 2020. Azure Functions—Serverless Architecture. https://azure.microsoft.com/en-us/services/functions/ Microsoft Azure. 2020. Azure Functions—Serverless Architecture. https://azure.microsoft.com/en-us/services/functions/

Cited by 46 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. InSS: An Intelligent Scheduling Orchestrator for Multi-GPU Inference With Spatio-Temporal Sharing;IEEE Transactions on Parallel and Distributed Systems;2024-10

2. DeInfer: A GPU resource allocation algorithm with spatial sharing for near-deterministic inferring tasks;Proceedings of the 53rd International Conference on Parallel Processing;2024-08-12

3. QUART: Latency-Aware FaaS System for Pipelining Large Model Inference;2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS);2024-07-23

4. Optimizing Simultaneous Autoscaling for Serverless Cloud Computing;2024 IEEE 17th International Conference on Cloud Computing (CLOUD);2024-07-07

5. Incendio: Priority-Based Scheduling for Alleviating Cold Start in Serverless Computing;IEEE Transactions on Computers;2024-07