Towards Optimal Preemptive GPU Time-Sharing for Edge Model Serving-Reference-Cited by-同舟云学术

登录注册会员服务联系我们

Towards Optimal Preemptive GPU Time-Sharing for Edge Model Serving

Published:2023-12-11 Issue: Volume: Page:13-18
ISSN:
Container-title:Proceedings of the 9th International Workshop on Container Technologies and Container Clouds
language:
Short-container-title:

Author:

Xia Zhengxu¹^ORCID,Hao Yitian¹^ORCID,Duan Jun²^ORCID,Wang Chen²^ORCID,Jiang Junchen¹^ORCID

Affiliation:

1. University of Chicago, USA

2. IBM Thomas J. Watson Research Center, USA

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3631311.3632401

Reference31 articles.

1. Amazon sagemaker. https://aws.amazon.com/sagemaker/. Accessed: 2023-07-07.

2. Host multiple models in one container behind one endpoint. https://docs.aws.amazon.com/sagemaker/latest/dg/multi-model-endpoints.html. Accessed: 2023-07-07.

3. Introducing the hugging face llm inference container for amazon sagemaker. https://huggingface.co/blog/sagemaker-huggingface-llm. Accessed: 2023-07-07.

4. Kserve documentation website. https://kserve.github.io/website/0.10/. Accessed: 2023-07-07.

5. Modelmesh. https://github.com/kserve/modelmesh. Accessed: 2023-07-07.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线，采集、加工和组织学术论文而形成的新型学术文献查询和分析系统，可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容，当前同舟云学术共收录了国内外主流学术期刊6万余种，收集的期刊论文及会议论文总量共计约1.5亿篇，并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询！咨询电话：010-8811{复制后删除}0370

www.globalauthorid.com

TOP