Depth and Transient Imaging with Compressive SPAD Array Cameras

Qilin Sun, Xiong Dun, Yifan Peng, Wolfgang Heidrich
Accepted to IEEE/CVF Conference on Computer Vision and Patern Recognition (CVPR), 2018


main
Schematic of our compressive transient imaging system.

Abstract

Time-of-flight depth imaging and transient imaging are two imaging modalities that have recently received a lot of interest. Despite much research, existing hardware systems are limited either in terms of temporal resolution or are prohibitively expensive. Arrays of Single Photon Avalanche Diodes (SPADs) promise to fill this gap by providing higher temporal resolution at an affordable cost. Unfortunately SPAD arrays are to date only available in relatively small resolutions. In this work we aim to overcome the spatial resolution limit of SPAD arrays by employing a compressive sensing camera design. Using a DMD and custom optics, we achieve an image resolution of up to 800×400 on SPAD Arrays of resolution 64×32. Using our new data fitting model for the time histograms, we suppress the noise while abstracting the phase and amplitude information, so as to realize a temporal resolution of a few tens of picoseconds.

Results

human face
Experimental reconstructed depth image and intensity image. Scale bar:10mm

Transient
Compressive transient imaging. Scale bar:10mm

Resources

Paper: [Sun2018CompressiveSPADArray.pdf (~1.6MB)] 
SuppDoc: [Sun2018CompressiveSPADArraySupp.pdf (~2.6MB)] 
Poster: [Sun2018CompressiveSPADArraySupp.pdf (~1.8MB)] 
Videos and DMD optics(3D printing file): [Supp_Videos_3DprintingModel.zip (~1.3MB)] 
All images are © IEEE Xplore, reproduced here by permission of IEEE Xplore for your personal use. Not for redistribution.