ITIF: Integrated Transformers Inference Framework for Multiple Tenants on GPU-Reference-Cited by-同舟云学术

ITIF: Integrated Transformers Inference Framework for Multiple Tenants on GPU

Published:2023-08-07 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 52nd International Conference on Parallel Processing
language:
Short-container-title:

Author:

Zhang Yuning¹^ORCID,Zhang Zao¹^ORCID,Bao Wei¹^ORCID,Yuan Dong¹^ORCID

Affiliation:

1. The University of Sydney, Australia

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3605573.3605585

Reference32 articles.

1. Yang Bai , Xufeng Yao , Qi Sun , and Bei Yu . 2021 . AutoGTCO: Graph and Tensor Co-Optimize for Image Recognition with Transformers on GPU. In 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD). IEEE, 1–9. Yang Bai, Xufeng Yao, Qi Sun, and Bei Yu. 2021. AutoGTCO: Graph and Tensor Co-Optimize for Image Recognition with Transformers on GPU. In 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD). IEEE, 1–9.

2. Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , Amanda Askell , 2020. Language models are few-shot learners. Advances in neural information processing systems 33 ( 2020 ), 1877–1901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877–1901.

3. Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , Luis Ceze , 2018 . { TVM} : An automated { End-to-End} optimizing compiler for deep learning . In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) . 578–594. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, 2018. { TVM} : An automated { End-to-End} optimizing compiler for deep learning. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). 578–594.

4. Daniel Crankshaw , Xin Wang , Guilio Zhou , Michael J Franklin , Joseph E Gonzalez , and Ion Stoica . 2017 . Clipper: A { Low-Latency} Online Prediction Serving System . In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) . 613–627. Daniel Crankshaw, Xin Wang, Guilio Zhou, Michael J Franklin, Joseph E Gonzalez, and Ion Stoica. 2017. Clipper: A { Low-Latency} Online Prediction Serving System. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). 613–627.

5. ImageNet: A large-scale hierarchical image database