Event-based Dual Photography for Transparent Scene Reconstruction

Light transport contains all light information between the light source and the image sensor. As an important application of light transport, dual photography has been a popular research topic, but it is challenged by long acquisition time, low signal-to-noise ratio and storage/processing of a large number of measurements. In this paper, we propose a novel hardware setup that combines a flying-spot MEMS modulated projector with an event camera to implement dual photography for 3D scanning in both line-of-sight (LoS) and non-line-of- sight (NLoS) scenes with a transparent object. Particularly, we achieved depth extraction from the LoS scenes and 3D reconstruction of the object in a NLoS scene using event light transport.