Affiliation:
1. The George Washington University, Washington, D.C., USA
2. Halmstad University, Halmstad, Sweden
Abstract
The acceleration of
Deep Neural Networks (DNNs)
has attracted much attention in research. Many critical real-time applications benefit from DNN accelerators but are limited by their compute-intensive nature. This work introduces an accelerator for
Convolutional Neural Network (CNN)
, based on a hybrid optoelectronic computing architecture and
residue number system (RNS)
. The RNS reduces the optical critical path and lowers the power requirements. In addition, the
wavelength division multiplexing (WDM)
allows high-speed operation at the system level by enabling high-level parallelism. The proposed RNS compute modules use one-hot encoding, and thus enable fast switching between the electrical and optical domains. We propose a new architecture that combines residue electrical adders and optical multipliers as the matrix-vector multiplication unit. Moreover, we enhance the implementation of different CNN computational kernels using WDM-enabled RNS based integrated photonics. The area and power efficiency of the proposed accelerator are 0.39 TOPS/s/mm
2
and 3.22 TOPS/s/W, respectively. In terms of computation capability, the proposed chip is 12.7× and 4.02× better than other optical implementation and memristor implementation, respectively. Our experimental evaluation using DNN benchmarks illustrates that our architecture can perform on average more than 72 times faster than GPU under the same power budget.
Funder
Air Force Office of Scientific Research
Publisher
Association for Computing Machinery (ACM)
Subject
Electrical and Electronic Engineering,Hardware and Architecture,Software
Reference73 articles.
1. Hossam O. Ahmed, Maged Ghoneima, and Mohamed Dessouky. 2018. High-speed 2D parallel MAC unit hardware accelerator for convolutional neural network. In Proceedings of SAI Intelligent Systems Conference. Springer, 655–663.
2. NEUROM: a ROM based RNS digital neuron
3. PUMA
4. All optical residue arithmetic with micro ring resonators and its application
5. Digital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs)
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献