SPLIT: QoS-Aware DNN Inference on Shared GPU via Evenly-Sized Model Splitting-Reference-Cited by-同舟云学术

SPLIT: QoS-Aware DNN Inference on Shared GPU via Evenly-Sized Model Splitting

Published:2023-08-07 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 52nd International Conference on Parallel Processing
language:
Short-container-title:

Author:

Luo Diaohan¹^ORCID,Yu Tian¹^ORCID,Wu Yuewen²^ORCID,Wu Heng³^ORCID,Wang Tao¹^ORCID,Zhang Wenbo⁴^ORCID

Affiliation:

1. University of Chinese Academy of Sciences, China

2. Institute of Software, Chinese Academy of Sciences, China

3. Institute of Software, Chinese Academy of Sciences, China and Chongqing School, University of Chinese Academy of Science, China

4. Institute of Software, Chinese Academy of Sciences, China and University of Chinese Academy of Sciences, Nanjing, and Nanjing Institute of Software Technology, China

Funder

Provincial Key Research and Development Program of Shandong, China

National Natural Science Foundation of China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3605573.3605627

Reference35 articles.

1. Martín Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , 2016 . { TensorFlow} : A System for { Large-Scale} Machine Learning . In 12th USENIX symposium on operating systems design and implementation (OSDI 16) . 265–283. Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, 2016. { TensorFlow} : A System for { Large-Scale} Machine Learning. In 12th USENIX symposium on operating systems design and implementation (OSDI 16). 265–283.

2. Generating Complex, Realistic Cloud Workloads using Recurrent Neural Networks

3. Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Q. Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , Luis Ceze , Carlos Guestrin , and Arvind Krishnamurthy . 2018 . TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2018 , Carlsbad, CA, USA , October 8-10, 2018, Andrea C. Arpaci-Dusseau and Geoff Voelker (Eds.). USENIX Association, 578–594. https://www.usenix.org/conference/osdi18/presentation/chen Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Q. Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, and Arvind Krishnamurthy. 2018. TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2018, Carlsbad, CA, USA, October 8-10, 2018, Andrea C. Arpaci-Dusseau and Geoff Voelker (Eds.). USENIX Association, 578–594. https://www.usenix.org/conference/osdi18/presentation/chen

4. PREMA: A Predictive Multi-Task Scheduling Algorithm For Preemptible Neural Processing Units

5. Automated Cognitive Health Assessment From Smart Home-Based Behavior Data

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. MediatorDNN: Contention Mitigation for Co-Located DNN Inference Jobs;2024 IEEE 17th International Conference on Cloud Computing (CLOUD);2024-07-07

2. Objective-Driven Differentiable Optimization of Traffic Prediction and Resource Allocation for Split AI Inference Edge Networks;IEEE Transactions on Machine Learning in Communications and Networking;2024