Sanger: A Co-Design Framework for Enabling Sparse Attention using Reconfigurable Architecture-Reference-Cited by-同舟云学术

Sanger: A Co-Design Framework for Enabling Sparse Attention using Reconfigurable Architecture

Published:2021-10-17 Issue: Volume: Page:
ISSN:
Container-title:MICRO-54: 54th Annual IEEE/ACM International Symposium on Microarchitecture
language:
Short-container-title:

Author:

Lu Liqiang¹,Jin Yicheng²,Bi Hangrui²,Luo Zizhang²,Li Peng³,Wang Tao²,Liang Yun¹

Affiliation:

1. Peking University, China

2. Peking University

3. Advanced Institute of Information Technology, Peking University

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3466752.3480125

Reference70 articles.

1. Chisel

2. Yoshua Bengio N. Léonard and Aaron C. Courville. 2013. Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation. ArXiv abs/1308.3432(2013). Yoshua Bengio N. Léonard and Aaron C. Courville. 2013. Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation. ArXiv abs/1308.3432(2013).

Cited by 64 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. A survey of FPGA and ASIC designs for transformer inference acceleration and optimization;Journal of Systems Architecture;2024-10

2. Hardware–Software Co-Design Enabling Static and Dynamic Sparse Attention Mechanisms;IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems;2024-09

3. P²-ViT: Power-of-Two Post-Training Quantization and Acceleration for Fully Quantized Vision Transformer;IEEE Transactions on Very Large Scale Integration (VLSI) Systems;2024-09

4. Mentor: A Memory-Efficient Sparse-dense Matrix Multiplication Accelerator Based on Column-Wise Product;ACM Transactions on Architecture and Code Optimization;2024-08-26

5. CoDA: A Co-Design Framework for Versatile and Efficient Attention Accelerators;IEEE Transactions on Computers;2024-08