Spatiotemporal diffractive deep neural networks

Abstract

A spatiotemporal diffractive deep neural network (STD2NN) is proposed for spatiotemporal signal processing. The STD2NN is formed by gratings, which convert the signal from the frequency domain to the spatial domain, and multiple layers consisting of spatial lenses and space light modulators (SLMs), which conduct spatiotemporal phase modulation. An all-optical backpropagation (BP) algorithm for SLM phase tuning is proposed, with the gradient of the loss function computed by the inner product of the forward propagating optical field and the backward propagating conjugated error field. As a proof of concept, a spatiotemporal word “OPTICA” is generated by the STD2NN. Afterwards, a spatiotemporal optical vortex (STOV) beam multiplexer based on the STD2NN is demonstrated, which converts the spatially separated Gaussian beams into the STOV wave-packets with different topological charges. Both cases illustrate the capability of the proposed STD2NN to generate and process the spatiotemporal signals.