Affiliation:
1. Ecole polytechnique de Montreal, Canada
2. Concordia university, Canada
Abstract
Integrated photonics arises as a fast and energy-efficient technology for the implementation of artificial neural networks (ANNs). Indeed, with the growing interest in ANNs, photonics shows great promise to overcome current limitations of electronic-based implementation. For example, it has been shown that neural networks integrating optical matrix multiplications can potentially run two orders of magnitude faster than their electronic counterparts. However, the transposition in the optical domain of the activation functions, which is a key feature of ANNs, remains a challenge. There is no direct optical implementation of state-of-the-art activation functions. Currently, most designs require time-consuming and power-hungry electro-optical conversions. In this survey, we review both all-optical and opto-electronic activation functions proposed in the state-of-the-art. We present activation functions with their key characteristics, and we summarize challenges for their use in the context of all-optical neural networks. We then highlight research directions for the implementation of fully optical neural networks.
Publisher
Association for Computing Machinery (ACM)
Subject
General Computer Science,Theoretical Computer Science
Reference88 articles.
1. Ion Stoica et al. 2017. A Berkeley View of Systems Challenges for AI. Retrieved from https://arXiv:cs.AI/1712.05855
2. Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks;al Yu-Hsin Chen et;IEEE J. Solid-State Circ.,2016
3. Deep learning with coherent nanophotonic circuits
4. Photonic Neural Networks: A Survey
5. Optimal design for universal multiport interferometers
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献