A 28nm 27.5TOPS/W Approximate-Computing-Based Transformer Processor with Asymptotic Sparsity Speculating and Out-of-Order Computing-Reference-Cited by-同舟云学术

A 28nm 27.5TOPS/W Approximate-Computing-Based Transformer Processor with Asymptotic Sparsity Speculating and Out-of-Order Computing

Published:2022-02-20 Issue: Volume: Page:
ISSN:
Container-title:2022 IEEE International Solid- State Circuits Conference (ISSCC)
language:
Short-container-title:

Author:

Wang Yang¹,Qin Yubin¹,Deng Dazheng¹,Wei Jingchuan¹,Zhou Yang¹,Fan Yuanqi¹,Chen Tianbao²,Sun Hao¹,Liu Leibo¹,Wei Shaojun¹,Yin Shouyi¹

Affiliation:

1. Tsinghua University,Beijing,China

2. Tsing Micro,Beijing,China

Funder

NSFC

National Key Research and Development Program

Beijing Innovation Center for Future Chip

BAAl

Publisher

IEEE

Link

http://xplorestaging.ieee.org/ielx7/9731529/9731102/09731686.pdf?arnumber=9731686

Reference6 articles.

1. An 8.93 TOPS/W LSTM Recurrent Neural Network Accelerator Featuring Hierarchical Coarse-Grain Sparsity for On-Device Speech Recognition

2. ELSA: Hardware-Software Co-design for Efficient, Lightweight Self-Attention Mechanism in Neural Networks

3. NVIDIA A100 Tensor Core GPU Architecture;nVidia Whitepaper,0

4. A 25mm2 SoC for loT Devices with 18ms Noise-Robust Speech-to-Text Latency via Bayesian Speech Denoising and Attention-Based Sequence-to-Sequence DNN Speech Recognition in 16nm FinFET;tambe;ISSCC,2021

5. A3: Accelerating Attention Mechanisms in Neural Networks with Approximation;ham;IEEE HPCA,2020

Cited by 26 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. BSViT: A Bit-Serial Vision Transformer Accelerator Exploiting Dynamic Patch and Weight Bit-Group Quantization;IEEE Transactions on Circuits and Systems I: Regular Papers;2024-09

2. Survey of Deep Learning Accelerators for Edge and Emerging Computing;Electronics;2024-07-29

3. LLMCompass: Enabling Efficient Hardware Design for Large Language Model Inference;2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA);2024-06-29

4. A 28.6 mJ/iter Stable Diffusion Processor for Text-to-Image Generation with Patch Similarity-based Sparsity Augmentation and Text-based Mixed-Precision;2024 IEEE International Symposium on Circuits and Systems (ISCAS);2024-05-19

5. On-Chip-Registration Supported ASR Processor Using Two-Step Transfer-Learning TWN;IEEE Transactions on Circuits and Systems II: Express Briefs;2024-05