Publications

Computational Imaging Group

Years:



2024
Z. Shi, I. Chugunov, M. Bijelic, G. Côté, J. Yeom, Q. Fu, H. Amata, W. Heidrich, F. Heide:
Split-Aperture 2-in-1 Computational Cameras
ACM Trans. Graphics (Proc. SIGGRAPH), 2024
E. Tseng, G. Kuo, S.-H. Baek, N. Matsuda, A. Maimone, F. Schiffers, P. Chakravarthula, Q. Fu, W. Heidrich, D. Lanman, F. Heide:
Neural étendue expander for ultra-wide-angle high-fidelity holographic display
Nature Communications, 2024


2023
Y. Zheng, Q. Fu, H. Amata, P. Chakravarthula, F. Heide, W. Heidrich:
Hexagonal diffractive optical elements
Optics Express, 2023
Project page
H. Amata, Q. Fu, W. Heidrich:
Additive fabrication of SiO2-based micro-optics with lag-free depth and reduced roughness
Optics Express, 2023
Project page
Y. Wang, R. Idoughi, W. Heidrich:
Learning Adaptive Tensorial Density Fields for Clean Cryo-EM Reconstruction
NeurIPS, 2023
Project page
Y. Wang, R. Idoughi, D. Rückert, R. Li, W. Heidrich:
Adaptive Differentiable Grids for Cryo-Electron Tomography Reconstruction and Denoising
Bioinformatics Advances, 2023
Project page
M. Souza, W. Heidrich:
MetaISP – Exploiting Global Scene Structure for Accurate Multi-Device Color Rendition
Vision, Modeling, and Visualization (VMV), 2023
Project page
N. Chen, C. Wang, W. Heidrich:
∂H: Differentiable Holography
Laser & Photonics Reviews, 2023
H. Amata, Q. Fu, W. Heidrich:
Additive diffractive optical elements fabrication by PECVD deposition of SiO2 and lift-off process
Proc. SPIE 12624, Digital Optical Technologies, 2023
Project page
M. Qi, W. Heidrich:
Scattering-aware Holographic PIV with Physics-based Motion Priors
ICCP, 2023
Project page
X. Yang, Q. Fu, M. Elhoseiny, W. Heidrich:
Aberration-Aware Depth-from-Focus
ICCP & IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Project page
S. Qiu, H. Amata, W. Heidrich:
MoiréTag: Angular Measurement and Tracking with a Passive Marker
SIGGRAPH, 2023
Project page
J. Zhang, X. Dun, J. Zhu, Z. Zhang, C. Feng, Z. Wang, W. Heidrich, X. Cheng:
Large Numerical Aperture Metalens with High Modulation Transfer Function
ACS Photonics, 2023
Y. Li, Q. Fu, W. Heidrich:
Extended Depth-of-Field Projector using Learned Diffractive Optics
IEEE VR, 2023
Project page
J. Li, Y. Li, C. Wang, X. Ye, W. Heidrich:
BUSIFusion: Blind Unsupervised Single Image Fusion of Hyperspectral and RGB Images
IEEE Transactions on Computational Imaging, 2023


2022
J. Rey Ramirez, P. Rautek, C. Bohak, O. Strnad, Z. Zhang, S. Li, I. Viola, W. Heidrich:
GPU Accelerated 3D Tomographic Reconstruction and Visualization from Noisy Electron Microscopy Tilt-Series
IEEE Transactions on Visualization and Computer Graphics, 2022
Project page
Q. Fu, D. Yan, W. Heidrich:
Diffractive lensless imaging with optimized Voronoi-Fresnel phase
Optics Express, 2022
Project page
C. Wang, N. Chen, W. Heidrich:
dO: A differentiable engine for Deep Lens design of computational imaging systems
IEEE Transactions on Computational Imaging, 2022
Project page
N. Chen, C. Wang, W. Heidrich:
HTRSD: Hybrid Taylor Rayleigh-Sommerfeld diffraction
Optics Express, 2022
Project page
R. Li, D. Rückert, Y. Wang, R. Idoughi, W. Heidrich:
Neural Adaptive Scene Tracing (NAScenT)
VMV, 2022
Project page
G. Qian*, Y. Wang*, J. Gu, C. Dong, W. Heidrich, B. Ghanem,, J. Ren:
Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline
ICCP, 2022
Y. Wang, R. Idoughi, W. Heidrich:
Joint Motion-Correction and Reconstruction in Cryo-EM Tomography
ICIP, 2022
Project page
D. Rückert, Y. Wang, R. Li, R. Idoughi, W. Heidrich:
NeAT-Neural Adaptive Tomography
ACM Transactions on Graphics (Proc. SIGGRAPH), 2022
Project page
Z. Shi, Y. Bahat, S.-H. Baek, Q. Fu, H. Amata, X. Li, P. Chakravarthula, W. Heidrich, F. Heide:
Seeing Through Obstructions With Diffractive Cloaking
ACM Transactions on Graphics (Proc. SIGGRAPH), 2022
X. Yang, Q. Fu, W. Heidrich:
Automatic Lens Design based on Differentiable Ray-tracing
OSA Imaging and Applid Optics Congress - Computational Optical Sensing and Imaging, 2022
Project page
Y. Bokhari, A. Alhareeri, A. Aljouie, A. Alkhaldi, M. Rasheed, M. Alawwad, R. Alhassnan, S. Saad Samargandy, A. Panahi, W. Heidrich, T. Arodz:
ChromoEnhancer: An artificial intelligence-based tool to enhance neoplastic karyograms as an aid for effective analysis
Cells, 2022
N. Chen, C. Wang, W. Heidrich:
Compact Computational Holographic Display (Invited Article)
Frontiers in Photonics, 2022
Project page


2021
Q. Fu, H. Amata, W. Heidrich:
Etch-free additive lithographic fabrication methods for reflective and transmissive micro-optics
Optics Express, 2021
Project page
K. AbuJbara*, R. Idoughi*, W. Heidrich:
Non-Linear Anisotropic Diffusion for Memory-Efficient Computed Tomography Super-Resolution Reconstruction
3DV, 2021
Project page
(oral paper)
Q. Sun:
End-to-end Optics Design for Computational Cameras
Ph.D. Thesis, 2021
M. Qi, C. Wang, W. Heidrich:
Coded Wavefront Sensor and Non-iterative Learning-based Reconstruction
OSA Imaging Congress - COSI, 2021
C. Wang, N. Chen, W. Heidrich:
Towards self-calibrated lens metrology by differentiable refractive deflectometry
Optics Express, 2021
Project page
N. Chen, C. Wang, W. Heidrich:
Space-time optical imaging framework - Holographic particle tracking velocimetry
OSA Imaging Congress - Digital Holography & 3D Imaging, 2021
Project page
C. Wang, N. Chen, W. Heidrich:
Lens design optimization by back-propagation
OSA Optical Design and Fabrication Congress - IODC, 2021
(Best Student Paper Award)
J. Xiong:
Computational Imaging and Its Applications in Fluids
Ph.D. Thesis, 2021
C. Wang:
Computational Wavefront Sensing: Theory, Practice, and Applications
Ph.D. Thesis, 2021
J. Xiong, W. Heidrich:
In-the-Wild Single Camera 3D Reconstruction Through Moving Water Surfaces
ICCV, 2021
Project page
(oral paper)
G. Zang, R. Idoughi, R. Li, P. Wonka, W. Heidrich:
IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction
ICCV, 2021
Project page
Y. Li, Q. Fu, W. Heidrich:
Multispectral illumination estimation using deep unrolling network
ICCV, 2021
Project page
S.-H. Baek, H. Ikoma, D. Jeon, Y. Li, W. Heidrich, G. Wetzstein, M. H. Kim:
Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics
ICCV, 2021
Q. Sun, C. Wang, Q. Fu, X. Dun, W. Heidrich:
End-to-End Complex Lens Design with Differentiable Ray-Tracing
ACM Transactions on Graphics (Proc. SIGGRAPH), 2021
Project page
N. Chen*, C. Wang*, W. Heidrich:
Snapshot space-time holographic three-dimensional particle tracking velocimetry
Laser and Photonics Reviews, 2021
Project page
J. Xiong*, J. Wang*, W. Heidrich, S. Nayar:
Seeing in Extra Darkness Using a Deep-Red Flash
CVPR, 2021
Project page
(oral paper)
I. Chugunov, S.-H. Baek, Q. Fu, W. Heidrich, F. Heide:
Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imaging
CVPR, 2021
S. Qiu, Q. Fu, C. Wang, W. Heidrich:
Linear Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays
Computer Graphics Forum, 2021
Project page
N. Chen, C. Wang, W. Heidrich:
Holographic 3D particle imaging with model-based network
IEEE Transactions on Computational Imaging, 2021
Project page


2020
N. Chen*, Y. Li*, W. Heidrich:
Physics-based HoloNet for three-dimensional imaging
3D Image Acquisition and Display - Technology, Perception and Applications, 2020
Project page
C. Marois, B. Gerard, O. Lardière, A. Anthony, C. Bradley, J. Dunn, Q. Fu, T. Hardy, W. Heidrich, G. Herriot, E. Nielsen, S. Sivanandam, D. Sivransky, S. Thibault, W. Thompson, J.-P. Véran:
Upgrading the Gemini Planet Imager calibration unit with a photon counting focal plane wavefront sensor
SPIE Proceedings Volume 11448, Adaptive Optics Systems VII, 2020
J. Xiong, A. Aguirre-Pablo, R. Idoughi, S. T. Thoroddsen, W. Heidrich:
RainbowPIV with improved depth resolution — design and comparative study with TomoPIV
Measurement Science and Technology, 2020
Project page
Y. Wang, R. Idoughi, W. Heidrich:
Stereo Event-based Particle Tracking Velocimetry for 3D Fluid Flow Reconstruction
ECCV, 2020
Project page
R. Li*, S. Qiu*, G. Zang, W. Heidrich:
Reflection Separation via Multi-bounce Polarization State Tracing
ECCV, 2020
Project page
Q. Sun, E. Tseng, Q. Fu, W. Heidrich, F. Heide:
Learning Rank-1 Diffractive Optics for Single-shot High Dynamic Range Imaging
CVPR, 2020
Project page
(oral paper)
Y. Li, M. Qi, R. Gulve, M. Wei, R. Genov, K. Kutulakos, W. Heidrich:
End-to-End Video Compressive Sensing Using Anderson-Accelerated Unrolled Networks
ICCP, 2020
Project page
G. Zang, R. Idoughi, C. Wang, A. Bennett, J. Du, S. Skeen, W. Roberts, P. Wonka, W. Heidrich:
TomoFluid: Reconstructing Dynamic Fluid from Sparse View Videos
CVPR, 2020
Project page
J. Du*, G. Zang*, B. Mohan, R. Idoughi, J. Sim, T. Fang, P. Wonka, W. Heidrich, W. Roberts:
Study of Spray Structure from Non-flash to Flash Boiling Conditions with Space-time Tomography
Proceedings of the Combustion Institute, 2020
Project page
G. Zang:
Space-Time Tomographic Reconstruction of Deforming Objects
Ph.D. Thesis, 2020
C. Wang, Q. Fu, X. Dun, W. Heidrich:
Modeling Classical Wavefront Sensors
Optics Express, 2020
Project page
Q. Sun, J. Zang, X. Dun, B. Ghanem, Y. Peng, W. Heidrich:
End-to-End Learned, Optically Coded Super-resolution SPAD Camera
ACM Transactions on Graphics, 2020
Project page
I. Alsolami, W. Heidrich:
Imaging with SPADs and DMDs: Seeing through Diffraction-Photons
IEEE Transactions on Image Processing, 2020


2019
C. Wang, Q. Fu, X. Dun, W. Heidrich:
Quantitative Phase and Intensity Microscopy Using Snapshot White Light Wavefront Sensing
Scientific Reports, 2019
Project page
F. Viallefont-Robinet, C. Bacour, M. Bouvet, M. Kheireddine, M. Ouhssain, R. Idoughi, L. Grignon, E. Munesa, F. Lemaitre, T. Riviere:
Contribution to sandy site characterization: spectro-directional signature, grain size distribution and mineralogy extracted from sand samples
Remote Sensing, 2019
Project page
R. Li, W. Heidrich:
Hierarchical and View-invariant Light Field Segmentation by Maximizing Entropy Rate on 4D Ray Graphs
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2019
Project page
Y. Peng*, Q. Sun*, X. Dun*, G. Wetzstein, W. Heidrich, F. Heide:
Learned Large Field-of-View Imaging With Thin-Plate Optics
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2019
Project page
J. Xiong, P. Richtarik, W. Heidrich:
Stochastic Convolutional Sparse Coding
International Symposium on Vision, Modeling and Visualization, 2019
Project page
(Best Paper Award)
S. Qiu, Q. Fu, C. Wang, W. Heidrich:
Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays
International Symposium on Vision, Modeling and Visualization, 2019
Project page
M. Alghamdi, Q. Fu, A. Thabet, W. Heidrich:
Reconfigurable Snapshot HDR Imaging Using Coded Masks and Inception Network
International Symposium on Vision, Modeling and Visualization, 2019
Project page
M. Li*, P. Tu*, W. Heidrich:
Robust Joint Image Reconstruction from Color and Monochrome Cameras
British Machine Vision Conference (BMVC), 2019
G. Zang, R. Idoughi, R. Tao, G. Lubineau, P. Wonka, W. Heidrich:
Warp-and-Project Tomography for Rapidly Deforming Objects
ACM Transactions on Graphics (Proc. SIGGRAPH), 2019
Project page
D. Jeon, S.-H. Baek, S. Yi, Q. Fu, X. Dun, W. Heidrich, M. H. Kim:
Compact Snapshot Hyperspectral Imaging with Diffracted Rotation
ACM Transactions on Graphics (Proc. SIGGRAPH), 2019
Project page
L. Fortunato, M. Li, T. Cheng, ZU. Rehman, W. Heidrich, TO. Leiknes:
Cake layer characterization in Activated Sludge Membrane Bioreactors: Real-time analysis
Journal of Membrane Science, 2019
A. A. Aguirre-Pablo, A. B. Aljedaani, J. Xiong, R. Idoughi, W. Heidrich, S. T. Thoroddsen:
Single-camera 3D PTV using particle intensities and structured light
Experiments in Fluids, 2019
Project page


2018
N. Smith, N. Moehrle, M. Goesele, W. Heidrich:
Aerial Path Planning for Urban Scene Reconstruction -- A Continuous Optimization Method and Benchmark
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2018
Project page
J. Chang, V. Sitzmann, X. Dun, W. Heidrich, G. Wetzstein:
Hybrid Optical-Electronic Convolutional Neural Networks
Scientific Reports, 2018
G. Zang, M. Aly, R. Idoughi, P. Wonka, W. Heidrich:
Super-Resolution and Sparse View CT Reconstruction
ECCV, 2018
Project page
L. Xiao, F. Heide, W. Heidrich, B. Schölkopf, M. Hirsch:
Discriminative Transfer Learning for General Image Restoration
IEEE Transactions on Image Processing, 2018
G. Zang, R. Idoughi, R. Tao, G. Lubineau, P. Wonka, W. Heidrich:
Space-time Tomography for Continuously Deforming Objects
ACM Transactions on Graphics (Proc. SIGGRAPH), 2018
Project page
C. Wang, Q. Fu, X. Dun, W. Heidrich:
Megapixel Adaptive Optics: Towards Correcting Large-scale Distortions in Computational Cameras
ACM Transactions on Graphics (Proc. SIGGRAPH), 2018
Project page
V. Sitzmann, S. Diamond, Y. Peng, X. Dun, S. Boyd, W. Heidrich, F. Heide, G. Wetzstein:
End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging
ACM Transactions on Graphics (Proc. SIGGRAPH), 2018
Project page
T. Auzinger, W. Heidrich, B. Bickel:
Computational Design of Nanostructural Color for Additive Manufacturing
ACM Transactions on Graphics (Proc. SIGGRAPH), 2018
Project page
M.-L. Eckert, W. Heidrich, N. Thuerey:
Coupled Fluid Density and Motion from Single Views
Symposium on Computer Animation, 2018
Project page
(Best Paper Award)
Q. Sun, X. Dun, Y. Peng, W. Heidrich:
Depth and Transient Imaging with Compressive SPAD Array Cameras
CVPR, 2018
Project page
S. Su, F. Heide, G. Wetzstein, W. Heidrich:
Deep End-to-End Time-of-Flight Imaging
CVPR, 2018
Project page
J. Xiong, Q. Fu, R. Idoughi, W. Heidrich:
Reconfigurable Rainbow PIV for 3D Flow Measurement
ICCP, 2018
Project page
Y. Peng, X. Dun, Q. Sun, F. Heide, W. Heidrich:
Focal Sweep Imaging with Multi-focal Diffractive Optics
ICCP, 2018
Project page


2017
Y. Peng, X. Dun, Q. Sun, W. Heidrich:
Mix-and-Match Holography
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2017
Project page
B. Choudhury, R. Swanson, F. Heide, G. Wetzstein, W. Heidrich:
Consensus Convolutional Sparse Coding
ICCV, 2017
Project page
T. Sun, Y. Peng, W. Heidrich:
Revisiting Cross-channel Information Transfer for Chromatic Aberration Correction
ICCV, 2017
Project page
M. Li, R. Idoughi, B. Choudhury, W. Heidrich:
Statistical model for OCT image denoising
Biomedical Optics Express, 2017
Project page
J. Xiong, R. Idoughi, A. Aguirre-Pablo, A. Aljedaani, X. Dun, Q. Fu, S. T. Thoroddsen, W. Heidrich:
Rainbow Particle Imaging Velocimetry for Dense 3D Fluid Velocity Imaging
ACM Transactions on Graphics (Proc. SIGGRAPH), 2017
Project page
S. Su, M. Delbracio, J. Wang, G. Sapiro, W. Heidrich, O. Wang:
Deep Video Deblurring for Hand-held cameras
CVPR, 2017
(spotlight presentation)
C. Wang, X. Dun, Q. Fu, W. Heidrich:
Ultra-High Resolution Coded Wavefront Sensor
Optics Express, 2017
Project page
G. Damberg, R. Boitard, A. Ballestad, W. Heidrich:
Light Steering Projection Systems and Attributes for HDR Displays
SID Digest, 2017
M. Li:
Multiple Scattering Model for Optical Coherence Tomography with Rytov Approximation
KAUST Master Thesis, 2017


2016
W. Heidrich, (ed.):
Proceedings of ACM SIGGRAPH ASIA 2016
ACM Transactions on Graphics, 2016
F. Heide, Q. Fu, Y. Peng, W. Heidrich:
Encoded diffractive optics for full-spectrum computational imaging
Scientific Reports, 2016
L. Xiao, J. Wang, W. Heidrich, M. Hirsch:
Learning High-Order Filters for Efficient Blind Deconvolution of Document Photographs
ECCV, 2016
(spotlight presentation)
Y. Peng, Q. Fu, W. Heidrich:
The Diffractive Achromat -- Full Spectrum Computational Imaging with Diffractive Optics
ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
Project page
S. Shrestha, F. Heide, W. Heidrich, G. Wetzstein:
Computational Imaging with Phased Time-of-Flight Camera Arrays
ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
Project page
F. Heide, S. Diamond, M. Niessner, J. Ragan-Kelley, W. Heidrich, G. Wetzstein:
ProxImaL: Efficient Image Optimization using Proximal Algorithms
ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
S. Su, F. Heide, R. Swanson, J. Klein, C. Callenberg, M. Hullin, W. Heidrich:
Material Classification Using Raw Time-of-Flight Measurements
CVPR, 2016
Project page
O. Cossairt, J. Yu, W. Heidrich, (eds.):
Proceedings of the International Conference of Computational Photography 2016
IEEE, 2016
G. Damberg, J. Gregson, W. Heidrich:
High Brightness HDR Projection Using Dynamic Freeform Lensing
ACM Transactions on Graphics, 2016
G. Zang:
Industrial Computed Tomography using Proximal Algorithm
KAUST Master Thesis, 2016
C. Wang:
Coded Shack-Hartmann Wavefront Sensor
KAUST Master Thesis, 2016


2015
Y. Peng, Q. Fu, H. Amata, S. Su, F. Heide, W. Heidrich:
Computational imaging using lightweight diffractive-refractive optics
Optics Express, 2015
F. Heide, M. Hullin, G. Wetzstein, W. Heidrich:
Doppler Time-of-Flight Imaging
ACM Transactions on Graphics (Proc. SIGGRAPH), 2015
F. Heide, G. Wetzstein, W. Heidrich:
Fast and Flexible Convolutional Sparse Coding
CVPR, 2015
(oral paper)
S. Su, W. Heidrich:
Rolling Shutter Motion Deblurring
CVPR, 2015
L. Xiao, F. Heide, M. O'Toole, A. Kolb, M. Hullin, K. Kutulakos, W. Heidrich:
Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
CVPR, 2015
L. Xiao, J. Gregson, F. Heide, W. Heidrich:
Stochastic Blind Motion Deblurring
IEEE Transactions on Image Processing, 2015
G. Damberg, W. Heidrich:
Efficient freeform lens optimization for computational caustic displays
Optics Express, 2015


2014
F. Heide, M. Steinberger, YT. Tsai, M. Rouf, D. Pająk, D. Reddy, O. Gallo, J. Liu, W. Heidrich, K. Egiazarian, J. Kautz, K. Pulli:
FlexISP: A Flexible Camera Image Processing Framework
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2014
Project page
G. Wetzstein, W. Heidrich, R. Raskar:
Computational Schlieren Photography with Light Field Probes
IJCV, 2014
Project page
F. Heide, L. Xiao, A. Kolb, M. Hullin, W. Heidrich:
Imaging in scattering media using correlation image sensors and sparse convolutional coding
Optics Express, 2014
Project page
J. Gregson, I. Ihrke, N. Thuerey, W. Heidrich:
From Capture to Simulation -- Connecting Forward and Inverse Problems in Fluids
ACM Transactions on Graphics (Proc. SIGGRAPH), 2014
Project page
M. O'Toole, F. Heide, L. Xiao, M. Hullin, W. Heidrich, K. Kutulakos:
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
ACM Transactions on Graphics (Proc. SIGGRAPH), 2014
Project page
F. Heide, J. Gregson, G. Wetzstein, R. Raskar, W. Heidrich:
A Compressive Superresolution Display
Computational Optical Sensing and Imaging COSI, 2014
Project page
F. Heide, L. Xiao, W. Heidrich, M. Hullin:
Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors
CVPR, 2014
Project page
(oral paper)
F. Heide, J. Gregson, G. Wetzstein, R. Raskar, W. Heidrich:
Compressive multi-mode superresolution display
Optics Express, 2014
Project page