Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS-Reference-Cited by-同舟云学术

Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS

Published:2022-04 Issue: Volume: Page:
ISSN:
Container-title:2022 IEEE International Symposium on High-Performance Computer Architecture (HPCA)
language:
Short-container-title:

Author:

Zhao Han¹,Cui Weihao¹,Chen Quan¹,Zhang Youtao²,Lu Yanchao³,Li Chao¹,Leng Jingwen¹,Guo Minyi¹

Affiliation:

1. Shanghai Jiao Tong University

2. University of Pittsburgh

3. NVIDIA

Funder

National Natural Science Foundation of China

Publisher

IEEE

Link

http://xplorestaging.ieee.org/ielx7/9773179/9773180/09773253.pdf?arnumber=9773253

Reference65 articles.

1. Improving neural network efficiency via post-training quan-tization with adaptive floating-point;liu;Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV 2021),0

2. Improving GPGPU resource utilization through alternative thread block scheduling

3. Fractional GPUs: Software-Based Compute and Memory Bandwidth Reservation for GPUs

4. GDP: Using Dataflow Properties to Accurately Estimate Interference-Free Performance at Runtime

5. Densely Connected Convolutional Networks

Cited by 13 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. VitBit: Enhancing Embedded GPU Performance for AI Workloads through Register Operand Packing;Proceedings of the 53rd International Conference on Parallel Processing;2024-08-12

2. Securing AI Inference in the Cloud: Is CPU-GPU Confidential Computing Ready?;2024 IEEE 17th International Conference on Cloud Computing (CLOUD);2024-07-07

3. JUNO: Optimizing High-Dimensional Approximate Nearest Neighbour Search with Sparsity-Aware Algorithm and Ray-Tracing Core Mapping;Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2;2024-04-27

4. ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores;Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming;2024-02-20

5. MSHGN: Multi-scenario adaptive hierarchical spatial graph convolution network for GPU utilization prediction in heterogeneous GPU clusters;Journal of Parallel and Distributed Computing;2024-02