GMM: An Efficient GPU Memory Management-based Model Serving System for Multiple DNN Inference Models-Reference-Cited by-同舟云学术

GMM: An Efficient GPU Memory Management-based Model Serving System for Multiple DNN Inference Models

Published:2024-08-12 Issue: Volume: Page:660-668
ISSN:
Container-title:Proceedings of the 53rd International Conference on Parallel Processing
language:
Short-container-title:

Author:

Piao XinYu¹^ORCID,Kim Jong-Kook¹^ORCID

Affiliation:

1. Korea University, South Korea

Funder

National Research Foundation of Korea

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3673038.3673122

Reference21 articles.

1. Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, 2016. { TensorFlow} : a system for { Large-Scale} machine learning. In 12th USENIX symposium on operating systems design and implementation (OSDI 16). 265–283.

2. Zhihao Bai, Zhen Zhang, Yibo Zhu, and Xin Jin. 2020. { PipeSwitch} : Fast pipelined context switching for deep learning applications. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). 499–514.

3. James Bradbury Roy Frostig Peter Hawkins Matthew James Johnson Chris Leary Dougal Maclaurin George Necula Adam Paszke Jake VanderPlas Skye Wanderman-Milne and Qiao Zhang. 2018. JAX: composable transformations of Python+NumPy programs. http://github.com/google/jax

4. Daniel Crankshaw, Xin Wang, Guilio Zhou, Michael J Franklin, Joseph E Gonzalez, and Ion Stoica. 2017. Clipper: A Low-Latency online prediction serving system. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). 613–627.

5. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020).