Affiliation:
1. University of Wisconsin, Morgridge Institute for Research, Madison, WI
2. MIT Media Lab, Cambridge, MA
3. Universidad de Zaragoza, Zaragoza, Spain
4. MIT Department of Chemistry, Cambridge, MA
Abstract
We present a novel imaging technique, which we call
femto-photography
, to capture and visualize the propagation of light through table-top scenes with an effective exposure time of 1.85 ps per frame. This is equivalent to a resolution of about one half trillion frames per second; between frames, light travels approximately just 0.5 mm. Since cameras with such extreme shutter speed obviously do not exist, we first re-purpose modern imaging hardware to record an ensemble average of repeatable events that are synchronized to a streak sensor, in which the time of arrival of light from the scene is coded in one of the sensor's spatial dimensions. We then introduce reconstruction methods that allow us to visualize the propagation of femtosecond light pulses through the scenes. Given this fast resolution and the finite speed of light, we observe that the camera does not necessarily capture the events in the same order as they occur in reality: we thus introduce the notion of
time-unwarping
between the camera's and the world's space--time coordinate systems, to take this into account. We apply our femto-photography technique to visualizations of very different scenes, which allow us to observe the rich dynamics of time-resolved light transport effects, including scattering, specular reflections, diffuse interreflections, diffraction, caustics, and subsurface scattering. Our work has potential applications in artistic, educational, and scientific visualizations; industrial imaging to analyze material properties; and medical imaging to reconstruct subsurface elements. In addition, our time-resolved technique has already motivated new forms of computational photography, as well as novel algorithms for the analysis and synthesis of light transport.
Publisher
Association for Computing Machinery (ACM)
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Computational Image Formation: Simulators in the Deep Learning Era;Journal of Imaging Science and Technology;2023-11-01
2. Model Study of Transient Imaging With Multi-Frequency Time-of-Flight Sensors;IEEE Transactions on Pattern Analysis and Machine Intelligence;2021-10-01
3. Time resolved characterization of stray light;Optical Measurement Systems for Industrial Inspection XII;2021-06-20
4. Stray light characterization with ultrafast time-of-flight imaging;Scientific Reports;2021-05-12
5. Fast Foveating Cameras for Dense Adaptive Resolution;IEEE Transactions on Pattern Analysis and Machine Intelligence;2021