STI: Turbocharge NLP Inference at the Edge via Elastic Pipelining-Reference-Cited by-同舟云学术

STI: Turbocharge NLP Inference at the Edge via Elastic Pipelining

Published:2023-01-27 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2
language:
Short-container-title:

Author:

Guo Liwei¹,Choe Wonkyo¹,Lin Felix Xiaozhu¹

Affiliation:

1. University of Virginia, USA

Funder

NSF

Virginia Commonwealth Cyber Initiative

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3575693.3575698

Reference67 articles.

1. 2022. Hugging Face:nlptown/bert-base-multilingual-uncased-sentiment. https://huggingface.co/nlptown/bert-base-multilingual-uncased-sentiment (Accessed on 07/07/2022) 2022. Hugging Face:nlptown/bert-base-multilingual-uncased-sentiment. https://huggingface.co/nlptown/bert-base-multilingual-uncased-sentiment (Accessed on 07/07/2022)

2. 2022. PyTorch. https://pytorch.org/ (Accessed on 03/14/2022) 2022. PyTorch. https://pytorch.org/ (Accessed on 03/14/2022)

3. 2022. PyTorch 1.11 TorchData and functorch are now available | PyTorch. https://pytorch.org/blog/pytorch-1.11-released/ (Accessed on 07/07/2022) 2022. PyTorch 1.11 TorchData and functorch are now available | PyTorch. https://pytorch.org/blog/pytorch-1.11-released/ (Accessed on 07/07/2022)

4. 2022. TensorFlow. https://www.tensorflow.org/ (Accessed on 03/14/2022) 2022. TensorFlow. https://www.tensorflow.org/ (Accessed on 03/14/2022)

5. 2022. Version 0.23.2 — scikit-learn 1.1.1 documentation. https://scikit-learn.org/stable/whats_new/v0.23.html (Accessed on 07/07/2022) 2022. Version 0.23.2 — scikit-learn 1.1.1 documentation. https://scikit-learn.org/stable/whats_new/v0.23.html (Accessed on 07/07/2022)

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. OTAS: An Elastic Transformer Serving System via Token Adaptation;IEEE INFOCOM 2024 - IEEE Conference on Computer Communications;2024-05-20

2. Training and Serving System of Foundation Models: A Comprehensive Survey;IEEE Open Journal of the Computer Society;2024