Auto-ViT-Acc: An FPGA-Aware Automatic Acceleration Framework for Vision Transformer with Mixed-Scheme Quantization-Reference-Cited by-同舟云学术

Auto-ViT-Acc: An FPGA-Aware Automatic Acceleration Framework for Vision Transformer with Mixed-Scheme Quantization

Published:2022-08 Issue: Volume: Page:
ISSN:
Container-title:2022 32nd International Conference on Field-Programmable Logic and Applications (FPL)
language:
Short-container-title:

Author:

Li Zhengang¹,Sun Mengshu¹,Lu Alec²,Ma Haoyu³,Yuan Geng¹,Xie Yanyue¹,Tang Hao⁴,Li Yanyu¹,Leeser Miriam¹,Wang Zhangyang⁵,Lin Xue¹,Fang Zhenman²

Affiliation:

1. Northeastern University

2. Simon Fraser University

3. University of California,Irvine

4. ETH Zurich

5. The University of Texas at Austin

Funder

NSF

Publisher

IEEE

Link

http://xplorestaging.ieee.org/ielx7/10035104/10035106/10035108.pdf?arnumber=10035108

Reference29 articles.

1. Attention is all you need;Vaswani;Advances in Neural Information Processing Systems,2017

2. An image is worth 16x16 words: Trans-formers for image recognition at scale;Dosovitskiy,2021

3. Training data-efficient image transformers distillation through attention;Touvron,2021

4. Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

5. Binaryconnect: Training deep neural networks with binary weights during propagations;Courbariaux;Advances in Neural Information Processing Systems,2015

Cited by 24 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. P²-ViT: Power-of-Two Post-Training Quantization and Acceleration for Fully Quantized Vision Transformer;IEEE Transactions on Very Large Scale Integration (VLSI) Systems;2024-09

2. BlissCam: Boosting Eye Tracking Efficiency with Learned In-Sensor Sparse Sampling;2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA);2024-06-29

3. Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers;Proceedings of the 38th ACM International Conference on Supercomputing;2024-05-30

4. A Case for Low Bitwidth Floating Point Arithmetic on FPGA for Transformer Based DNN Inference;2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW);2024-05-27

5. Hardware Accelerator for MobileViT Vision Transformer with Reconfigurable Computation;2024 IEEE International Symposium on Circuits and Systems (ISCAS);2024-05-19