Affiliation:
1. Department of Mechanical and Mechatronics Engineering, and Waterloo Institute of Nanotechnology University of Waterloo Waterloo Ontario N2L 3G1 Canada
2. State Key Laboratory of Inorganic Synthesis and Preparative Chemistry College of Chemistry Jilin University Changchun 130012 P. R. China
3. Frontier Institute of Science and Technology (FIST) Xi'an Jiaotong University No. 28 Xianning West Road Xi'an Shaanxi 710049 P. R. China
Abstract
AbstractTraditional machine vision is suffering from redundant sensing data, bulky structures, and high energy consumption. Biological‐inspired neuromorphic systems are promising for compact and energy‐efficient machine vision. Multifunctional optoelectronics enabling multispectrum sensitivity for broadband image sensing, feature extraction, and neuromorphic computing are vital for machine visions. Here, an optoelectronic synapse is designed that enables image sensing, convolutional processing, and computing. Multiple synaptic plasticity triggered by photons can implement photonic computing and information transmission. Convolutional processing is realized by ultralow energy kernel generators fully controlled by photons. Meanwhile, the device shows the ability of conductance modulations under electronic stimulations that implement neuromorphic computing. For the first time, this two‐terminal broadband optoelectronic synapse enables front‐end retinomorphic image sensing, convolutional processing, and back‐end neuromorphic computing. The integrated photonic information encryption, convolutional image preprocessing, and neuromorphic computing capabilities are promising for compact monolithic neuromorphic machine vision systems.
Funder
Natural Sciences and Engineering Research Council of Canada
Canada Research Chairs
Subject
Electrochemistry,Condensed Matter Physics,Biomaterials,Electronic, Optical and Magnetic Materials