AutoInfer: Self-Driving Management for Resource-Efficient, SLO-Aware Machine=Learning Inference in GPU Clusters-Reference-Cited by-同舟云学术

AutoInfer: Self-Driving Management for Resource-Efficient, SLO-Aware Machine=Learning Inference in GPU Clusters

Published:2023-04-01 Issue:7 Volume:10 Page:6271-6285
ISSN:2327-4662
Container-title:IEEE Internet of Things Journal
language:
Short-container-title:IEEE Internet Things J.

Author:

Cai Binlei¹^ORCID,Guo Qin²,Dong Xiaodong³^ORCID

Affiliation:

1. Shandong Computer Science Center (National Supercomputer Center in Jinan), Shandong Provincial Key Laboratory of Computer Networks, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China

2. School of Science, Shandong Jianzhu University, Jinan, China

3. College of Computer Science, Nankai University, Tianjin, China

Funder

Shandong Provincial Natural Science Foundation of China

National Science Foundation for Young Scientists of China

Fundamental Research Funds for the Central Universities

Youth Project of Tianjin Natural Science Foundation

Major Innovation Projects of Science and Education Integration Pilot Project of Qilu University of Technology

Shandong Provincial Key Research and Development Program

Shandong Intelligent Public Security Joint Innovation Center

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Subject

Computer Networks and Communications,Computer Science Applications,Hardware and Architecture,Information Systems,Signal Processing

Link

http://xplorestaging.ieee.org/ielx7/6488907/10079218/09956001.pdf?arnumber=9956001

Reference63 articles.

1. Serving DNNs like clockwork: Performance predictability from the bottom up;gujarati;Proc OSDI,2020

2. Collaborative reliability prediction of service-oriented systems

3. InferLine

4. Predicting Quality of Service for Selection by Neighborhood-Based Collaborative Filtering

5. BATCH: Machine Learning Inference Serving on Serverless Platforms with Adaptive Batching

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Latency-Guaranteed Co-Location of Inference and Training for Reducing Data Center Expenses;2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS);2024-07-23

2. CoFRIS: Coordinated Frequency and Resource Scaling for GPU Inference Servers;Proceedings of the 14th International Green and Sustainable Computing Conference;2023-10-28