Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU-Reference-Cited by-同舟云学术

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Published:2023-11-12 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 21st ACM Conference on Embedded Networked Sensor Systems
language:
Short-container-title:

Author:

Zhao Zhihe¹^ORCID,Ling Neiwen¹^ORCID,Guan Nan²^ORCID,Xing Guoliang³^ORCID

Affiliation:

1. The Chinese University of Hong Kong, Hong Kong, Hong Kong

2. City University of Hong Kong, Hong Kong, China

3. The Chinese University of Hong Kong, Hong Kong, China

Funder

Research Grants Council (RGC) of Hong Kong under Collaborative Research Fund (CRF) C4072-21G

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3625687.3625789

Reference53 articles.

1. 2023. AMD Ryzen™ Embedded Family. https://www.amd.com/en/products/embedded-ryzen-series?gclid=Cj0KCQjwtsCgBhDEARIsAE7RYh1ldW0JK-snwE61wNNbhkSG8acBGKg5IpqwGrFXC7Hs85Fj4jWHcA8aAtj0EALw_wcB.

2. 2023. NVIDIA Nsight Systems. https://developer.nvidia.com/nsight-systems.

3. 2023. NVIDIA Triton Inference Server Organization. https://github.com/triton-inference-server.

4. EffiSha

5. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, and Arvind Krishnamurthy. 2018. TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). USENIX Association, Carlsbad, CA, 578--594. https://www.usenix.org/conference/osdi18/presentation/chen

Cited by 3 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. BCEdge: SLO-Aware DNN Inference Services With Adaptive Batch-Concurrent Scheduling on Edge Devices;IEEE Transactions on Network and Service Management;2024-08

2. Efficiency Optimization Techniques in Privacy-Preserving Federated Learning With Homomorphic Encryption: A Brief Survey;IEEE Internet of Things Journal;2024-07-15

3. Pantheon: Preemptible Multi-DNN Inference on Mobile Edge GPUs;Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services;2024-06-03