Publications

Computational Imaging Group

2024
	X. Yang, M. Souza, K. Wang, P. Chakravarthula, Q. Fu, W. Heidrich: End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Model SIGGRAPH ASIA conference track, 2024 Project page
	X. Yang, Q. Fu, W. Heidrich: Curriculum Learning for ab initio Deep Learned Refractive Optics Nature Communications, 2024 Project page
	Z. Shi, I. Chugunov, M. Bijelic, G. Côté, J. Yeom, Q. Fu, H. Amata, W. Heidrich, F. Heide: Split-Aperture 2-in-1 Computational Cameras ACM Trans. Graphics (Proc. SIGGRAPH), 2024
	E. Tseng, G. Kuo, S.-H. Baek, N. Matsuda, A. Maimone, F. Schiffers, P. Chakravarthula, Q. Fu, W. Heidrich, D. Lanman, F. Heide: Neural étendue expander for ultra-wide-angle high-fidelity holographic display Nature Communications, 2024

2023
	Y. Zheng, Q. Fu, H. Amata, P. Chakravarthula, F. Heide, W. Heidrich: Hexagonal diffractive optical elements Optics Express, 2023 Project page
	H. Amata, Q. Fu, W. Heidrich: Additive fabrication of SiO2-based micro-optics with lag-free depth and reduced roughness Optics Express, 2023 Project page
	Y. Wang, R. Idoughi, W. Heidrich: Learning Adaptive Tensorial Density Fields for Clean Cryo-EM Reconstruction NeurIPS, 2023 Project page
	Y. Wang, R. Idoughi, D. Rückert, R. Li, W. Heidrich: Adaptive Differentiable Grids for Cryo-Electron Tomography Reconstruction and Denoising Bioinformatics Advances, 2023 Project page
	M. Souza, W. Heidrich: MetaISP – Exploiting Global Scene Structure for Accurate Multi-Device Color Rendition Vision, Modeling, and Visualization (VMV), 2023 Project page
	N. Chen, C. Wang, W. Heidrich: ∂H: Differentiable Holography Laser & Photonics Reviews, 2023
	H. Amata, Q. Fu, W. Heidrich: Additive diffractive optical elements fabrication by PECVD deposition of SiO2 and lift-off process Proc. SPIE 12624, Digital Optical Technologies, 2023 Project page
	M. Qi, W. Heidrich: Scattering-aware Holographic PIV with Physics-based Motion Priors ICCP, 2023 Project page
	X. Yang, Q. Fu, M. Elhoseiny, W. Heidrich: Aberration-Aware Depth-from-Focus ICCP & IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Project page
	S. Qiu, H. Amata, W. Heidrich: MoiréTag: Angular Measurement and Tracking with a Passive Marker SIGGRAPH, 2023 Project page
	J. Zhang, X. Dun, J. Zhu, Z. Zhang, C. Feng, Z. Wang, W. Heidrich, X. Cheng: Large Numerical Aperture Metalens with High Modulation Transfer Function ACS Photonics, 2023
	Y. Li, Q. Fu, W. Heidrich: Extended Depth-of-Field Projector using Learned Diffractive Optics IEEE VR, 2023 Project page
	J. Li, Y. Li, C. Wang, X. Ye, W. Heidrich: BUSIFusion: Blind Unsupervised Single Image Fusion of Hyperspectral and RGB Images IEEE Transactions on Computational Imaging, 2023

2022
	J. Rey Ramirez, P. Rautek, C. Bohak, O. Strnad, Z. Zhang, S. Li, I. Viola, W. Heidrich: GPU Accelerated 3D Tomographic Reconstruction and Visualization from Noisy Electron Microscopy Tilt-Series IEEE Transactions on Visualization and Computer Graphics, 2022 Project page
	Q. Fu, D. Yan, W. Heidrich: Diffractive lensless imaging with optimized Voronoi-Fresnel phase Optics Express, 2022 Project page
	C. Wang, N. Chen, W. Heidrich: dO: A differentiable engine for Deep Lens design of computational imaging systems IEEE Transactions on Computational Imaging, 2022 Project page
	N. Chen, C. Wang, W. Heidrich: HTRSD: Hybrid Taylor Rayleigh-Sommerfeld diffraction Optics Express, 2022 Project page
	R. Li, D. Rückert, Y. Wang, R. Idoughi, W. Heidrich: Neural Adaptive Scene Tracing (NAScenT) VMV, 2022 Project page
	G. Qian*, Y. Wang*, J. Gu, C. Dong, W. Heidrich, B. Ghanem,, J. Ren: Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline ICCP, 2022
	Y. Wang, R. Idoughi, W. Heidrich: Joint Motion-Correction and Reconstruction in Cryo-EM Tomography ICIP, 2022 Project page
	D. Rückert, Y. Wang, R. Li, R. Idoughi, W. Heidrich: NeAT-Neural Adaptive Tomography ACM Transactions on Graphics (Proc. SIGGRAPH), 2022 Project page
	Z. Shi, Y. Bahat, S.-H. Baek, Q. Fu, H. Amata, X. Li, P. Chakravarthula, W. Heidrich, F. Heide: Seeing Through Obstructions With Diffractive Cloaking ACM Transactions on Graphics (Proc. SIGGRAPH), 2022
	X. Yang, Q. Fu, W. Heidrich: Automatic Lens Design based on Differentiable Ray-tracing OSA Imaging and Applid Optics Congress - Computational Optical Sensing and Imaging, 2022 Project page
	Y. Bokhari, A. Alhareeri, A. Aljouie, A. Alkhaldi, M. Rasheed, M. Alawwad, R. Alhassnan, S. Saad Samargandy, A. Panahi, W. Heidrich, T. Arodz: ChromoEnhancer: An artificial intelligence-based tool to enhance neoplastic karyograms as an aid for effective analysis Cells, 2022
	N. Chen, C. Wang, W. Heidrich: Compact Computational Holographic Display (Invited Article) Frontiers in Photonics, 2022 Project page

2021
	Q. Fu, H. Amata, W. Heidrich: Etch-free additive lithographic fabrication methods for reflective and transmissive micro-optics Optics Express, 2021 Project page
	K. AbuJbara*, R. Idoughi*, W. Heidrich: Non-Linear Anisotropic Diffusion for Memory-Efficient Computed Tomography Super-Resolution Reconstruction 3DV, 2021 Project page (oral paper)
	Q. Sun: End-to-end Optics Design for Computational Cameras Ph.D. Thesis, 2021
	M. Qi, C. Wang, W. Heidrich: Coded Wavefront Sensor and Non-iterative Learning-based Reconstruction OSA Imaging Congress - COSI, 2021
	C. Wang, N. Chen, W. Heidrich: Towards self-calibrated lens metrology by differentiable refractive deflectometry Optics Express, 2021 Project page
	N. Chen, C. Wang, W. Heidrich: Space-time optical imaging framework - Holographic particle tracking velocimetry OSA Imaging Congress - Digital Holography & 3D Imaging, 2021 Project page
	C. Wang, N. Chen, W. Heidrich: Lens design optimization by back-propagation OSA Optical Design and Fabrication Congress - IODC, 2021 (Best Student Paper Award)
	J. Xiong: Computational Imaging and Its Applications in Fluids Ph.D. Thesis, 2021
	C. Wang: Computational Wavefront Sensing: Theory, Practice, and Applications Ph.D. Thesis, 2021
	J. Xiong, W. Heidrich: In-the-Wild Single Camera 3D Reconstruction Through Moving Water Surfaces ICCV, 2021 Project page (oral paper)
	G. Zang, R. Idoughi, R. Li, P. Wonka, W. Heidrich: IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction ICCV, 2021 Project page
	Y. Li, Q. Fu, W. Heidrich: Multispectral illumination estimation using deep unrolling network ICCV, 2021 Project page
	S.-H. Baek, H. Ikoma, D. Jeon, Y. Li, W. Heidrich, G. Wetzstein, M. H. Kim: Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics ICCV, 2021
	Q. Sun, C. Wang, Q. Fu, X. Dun, W. Heidrich: End-to-End Complex Lens Design with Differentiable Ray-Tracing ACM Transactions on Graphics (Proc. SIGGRAPH), 2021 Project page
	N. Chen*, C. Wang*, W. Heidrich: Snapshot space-time holographic three-dimensional particle tracking velocimetry Laser and Photonics Reviews, 2021 Project page
	J. Xiong*, J. Wang*, W. Heidrich, S. Nayar: Seeing in Extra Darkness Using a Deep-Red Flash CVPR, 2021 Project page (oral paper)
	I. Chugunov, S.-H. Baek, Q. Fu, W. Heidrich, F. Heide: Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imaging CVPR, 2021
	S. Qiu, Q. Fu, C. Wang, W. Heidrich: Linear Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays Computer Graphics Forum, 2021 Project page
	N. Chen, C. Wang, W. Heidrich: Holographic 3D particle imaging with model-based network IEEE Transactions on Computational Imaging, 2021 Project page

2020
	N. Chen*, Y. Li*, W. Heidrich: Physics-based HoloNet for three-dimensional imaging 3D Image Acquisition and Display - Technology, Perception and Applications, 2020 Project page
	C. Marois, B. Gerard, O. Lardière, A. Anthony, C. Bradley, J. Dunn, Q. Fu, T. Hardy, W. Heidrich, G. Herriot, E. Nielsen, S. Sivanandam, D. Sivransky, S. Thibault, W. Thompson, J.-P. Véran: Upgrading the Gemini Planet Imager calibration unit with a photon counting focal plane wavefront sensor SPIE Proceedings Volume 11448, Adaptive Optics Systems VII, 2020
	J. Xiong, A. Aguirre-Pablo, R. Idoughi, S. T. Thoroddsen, W. Heidrich: RainbowPIV with improved depth resolution — design and comparative study with TomoPIV Measurement Science and Technology, 2020 Project page
	Y. Wang, R. Idoughi, W. Heidrich: Stereo Event-based Particle Tracking Velocimetry for 3D Fluid Flow Reconstruction ECCV, 2020 Project page
	R. Li*, S. Qiu*, G. Zang, W. Heidrich: Reflection Separation via Multi-bounce Polarization State Tracing ECCV, 2020 Project page
	Q. Sun, E. Tseng, Q. Fu, W. Heidrich, F. Heide: Learning Rank-1 Diffractive Optics for Single-shot High Dynamic Range Imaging CVPR, 2020 Project page (oral paper)
	Y. Li, M. Qi, R. Gulve, M. Wei, R. Genov, K. Kutulakos, W. Heidrich: End-to-End Video Compressive Sensing Using Anderson-Accelerated Unrolled Networks ICCP, 2020 Project page
	G. Zang, R. Idoughi, C. Wang, A. Bennett, J. Du, S. Skeen, W. Roberts, P. Wonka, W. Heidrich: TomoFluid: Reconstructing Dynamic Fluid from Sparse View Videos CVPR, 2020 Project page
	J. Du*, G. Zang*, B. Mohan, R. Idoughi, J. Sim, T. Fang, P. Wonka, W. Heidrich, W. Roberts: Study of Spray Structure from Non-flash to Flash Boiling Conditions with Space-time Tomography Proceedings of the Combustion Institute, 2020 Project page
	G. Zang: Space-Time Tomographic Reconstruction of Deforming Objects Ph.D. Thesis, 2020
	C. Wang, Q. Fu, X. Dun, W. Heidrich: Modeling Classical Wavefront Sensors Optics Express, 2020 Project page
	Q. Sun, J. Zang, X. Dun, B. Ghanem, Y. Peng, W. Heidrich: End-to-End Learned, Optically Coded Super-resolution SPAD Camera ACM Transactions on Graphics, 2020 Project page
	I. Alsolami, W. Heidrich: Imaging with SPADs and DMDs: Seeing through Diffraction-Photons IEEE Transactions on Image Processing, 2020

2019
	C. Wang, Q. Fu, X. Dun, W. Heidrich: Quantitative Phase and Intensity Microscopy Using Snapshot White Light Wavefront Sensing Scientific Reports, 2019 Project page
	F. Viallefont-Robinet, C. Bacour, M. Bouvet, M. Kheireddine, M. Ouhssain, R. Idoughi, L. Grignon, E. Munesa, F. Lemaitre, T. Riviere: Contribution to sandy site characterization: spectro-directional signature, grain size distribution and mineralogy extracted from sand samples Remote Sensing, 2019 Project page
	R. Li, W. Heidrich: Hierarchical and View-invariant Light Field Segmentation by Maximizing Entropy Rate on 4D Ray Graphs ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2019 Project page
	Y. Peng*, Q. Sun*, X. Dun*, G. Wetzstein, W. Heidrich, F. Heide: Learned Large Field-of-View Imaging With Thin-Plate Optics ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2019 Project page
	J. Xiong, P. Richtarik, W. Heidrich: Stochastic Convolutional Sparse Coding International Symposium on Vision, Modeling and Visualization, 2019 Project page (Best Paper Award)
	S. Qiu, Q. Fu, C. Wang, W. Heidrich: Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays International Symposium on Vision, Modeling and Visualization, 2019 Project page
	M. Alghamdi, Q. Fu, A. Thabet, W. Heidrich: Reconfigurable Snapshot HDR Imaging Using Coded Masks and Inception Network International Symposium on Vision, Modeling and Visualization, 2019 Project page
	M. Li*, P. Tu*, W. Heidrich: Robust Joint Image Reconstruction from Color and Monochrome Cameras British Machine Vision Conference (BMVC), 2019
	G. Zang, R. Idoughi, R. Tao, G. Lubineau, P. Wonka, W. Heidrich: Warp-and-Project Tomography for Rapidly Deforming Objects ACM Transactions on Graphics (Proc. SIGGRAPH), 2019 Project page
	D. Jeon, S.-H. Baek, S. Yi, Q. Fu, X. Dun, W. Heidrich, M. H. Kim: Compact Snapshot Hyperspectral Imaging with Diffracted Rotation ACM Transactions on Graphics (Proc. SIGGRAPH), 2019 Project page
	L. Fortunato, M. Li, T. Cheng, ZU. Rehman, W. Heidrich, TO. Leiknes: Cake layer characterization in Activated Sludge Membrane Bioreactors: Real-time analysis Journal of Membrane Science, 2019
	A. A. Aguirre-Pablo, A. B. Aljedaani, J. Xiong, R. Idoughi, W. Heidrich, S. T. Thoroddsen: Single-camera 3D PTV using particle intensities and structured light Experiments in Fluids, 2019 Project page

2018
	N. Smith, N. Moehrle, M. Goesele, W. Heidrich: Aerial Path Planning for Urban Scene Reconstruction -- A Continuous Optimization Method and Benchmark ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2018 Project page
	J. Chang, V. Sitzmann, X. Dun, W. Heidrich, G. Wetzstein: Hybrid Optical-Electronic Convolutional Neural Networks Scientific Reports, 2018
	G. Zang, M. Aly, R. Idoughi, P. Wonka, W. Heidrich: Super-Resolution and Sparse View CT Reconstruction ECCV, 2018 Project page
	L. Xiao, F. Heide, W. Heidrich, B. Schölkopf, M. Hirsch: Discriminative Transfer Learning for General Image Restoration IEEE Transactions on Image Processing, 2018
	G. Zang, R. Idoughi, R. Tao, G. Lubineau, P. Wonka, W. Heidrich: Space-time Tomography for Continuously Deforming Objects ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	C. Wang, Q. Fu, X. Dun, W. Heidrich: Megapixel Adaptive Optics: Towards Correcting Large-scale Distortions in Computational Cameras ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	V. Sitzmann, S. Diamond, Y. Peng, X. Dun, S. Boyd, W. Heidrich, F. Heide, G. Wetzstein: End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	T. Auzinger, W. Heidrich, B. Bickel: Computational Design of Nanostructural Color for Additive Manufacturing ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	M.-L. Eckert, W. Heidrich, N. Thuerey: Coupled Fluid Density and Motion from Single Views Symposium on Computer Animation, 2018 Project page (Best Paper Award)
	Q. Sun, X. Dun, Y. Peng, W. Heidrich: Depth and Transient Imaging with Compressive SPAD Array Cameras CVPR, 2018 Project page
	S. Su, F. Heide, G. Wetzstein, W. Heidrich: Deep End-to-End Time-of-Flight Imaging CVPR, 2018 Project page
	J. Xiong, Q. Fu, R. Idoughi, W. Heidrich: Reconfigurable Rainbow PIV for 3D Flow Measurement ICCP, 2018 Project page
	Y. Peng, X. Dun, Q. Sun, F. Heide, W. Heidrich: Focal Sweep Imaging with Multi-focal Diffractive Optics ICCP, 2018 Project page

2017
	Y. Peng, X. Dun, Q. Sun, W. Heidrich: Mix-and-Match Holography ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2017 Project page
	B. Choudhury, R. Swanson, F. Heide, G. Wetzstein, W. Heidrich: Consensus Convolutional Sparse Coding ICCV, 2017 Project page
	T. Sun, Y. Peng, W. Heidrich: Revisiting Cross-channel Information Transfer for Chromatic Aberration Correction ICCV, 2017 Project page
	M. Li, R. Idoughi, B. Choudhury, W. Heidrich: Statistical model for OCT image denoising Biomedical Optics Express, 2017 Project page
	J. Xiong, R. Idoughi, A. Aguirre-Pablo, A. Aljedaani, X. Dun, Q. Fu, S. T. Thoroddsen, W. Heidrich: Rainbow Particle Imaging Velocimetry for Dense 3D Fluid Velocity Imaging ACM Transactions on Graphics (Proc. SIGGRAPH), 2017 Project page
	S. Su, M. Delbracio, J. Wang, G. Sapiro, W. Heidrich, O. Wang: Deep Video Deblurring for Hand-held cameras CVPR, 2017 (spotlight presentation)
	C. Wang, X. Dun, Q. Fu, W. Heidrich: Ultra-High Resolution Coded Wavefront Sensor Optics Express, 2017 Project page
	G. Damberg, R. Boitard, A. Ballestad, W. Heidrich: Light Steering Projection Systems and Attributes for HDR Displays SID Digest, 2017
	M. Li: Multiple Scattering Model for Optical Coherence Tomography with Rytov Approximation KAUST Master Thesis, 2017

2016
	W. Heidrich, (ed.): Proceedings of ACM SIGGRAPH ASIA 2016 ACM Transactions on Graphics, 2016
	F. Heide, Q. Fu, Y. Peng, W. Heidrich: Encoded diffractive optics for full-spectrum computational imaging Scientific Reports, 2016
	L. Xiao, J. Wang, W. Heidrich, M. Hirsch: Learning High-Order Filters for Efficient Blind Deconvolution of Document Photographs ECCV, 2016 (spotlight presentation)
	Y. Peng, Q. Fu, W. Heidrich: The Diffractive Achromat -- Full Spectrum Computational Imaging with Diffractive Optics ACM Transactions on Graphics (Proc. SIGGRAPH), 2016 Project page
	S. Shrestha, F. Heide, W. Heidrich, G. Wetzstein: Computational Imaging with Phased Time-of-Flight Camera Arrays ACM Transactions on Graphics (Proc. SIGGRAPH), 2016 Project page
	F. Heide, S. Diamond, M. Niessner, J. Ragan-Kelley, W. Heidrich, G. Wetzstein: ProxImaL: Efficient Image Optimization using Proximal Algorithms ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
	S. Su, F. Heide, R. Swanson, J. Klein, C. Callenberg, M. Hullin, W. Heidrich: Material Classification Using Raw Time-of-Flight Measurements CVPR, 2016 Project page
	O. Cossairt, J. Yu, W. Heidrich, (eds.): Proceedings of the International Conference of Computational Photography 2016 IEEE, 2016
	G. Damberg, J. Gregson, W. Heidrich: High Brightness HDR Projection Using Dynamic Freeform Lensing ACM Transactions on Graphics, 2016
	G. Zang: Industrial Computed Tomography using Proximal Algorithm KAUST Master Thesis, 2016
	C. Wang: Coded Shack-Hartmann Wavefront Sensor KAUST Master Thesis, 2016

2015
	Y. Peng, Q. Fu, H. Amata, S. Su, F. Heide, W. Heidrich: Computational imaging using lightweight diffractive-refractive optics Optics Express, 2015
	F. Heide, M. Hullin, G. Wetzstein, W. Heidrich: Doppler Time-of-Flight Imaging ACM Transactions on Graphics (Proc. SIGGRAPH), 2015
	F. Heide, G. Wetzstein, W. Heidrich: Fast and Flexible Convolutional Sparse Coding CVPR, 2015 (oral paper)
	S. Su, W. Heidrich: Rolling Shutter Motion Deblurring CVPR, 2015
	L. Xiao, F. Heide, M. O'Toole, A. Kolb, M. Hullin, K. Kutulakos, W. Heidrich: Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras CVPR, 2015
	L. Xiao, J. Gregson, F. Heide, W. Heidrich: Stochastic Blind Motion Deblurring IEEE Transactions on Image Processing, 2015
	G. Damberg, W. Heidrich: Efficient freeform lens optimization for computational caustic displays Optics Express, 2015

2014
	F. Heide, M. Steinberger, YT. Tsai, M. Rouf, D. Pająk, D. Reddy, O. Gallo, J. Liu, W. Heidrich, K. Egiazarian, J. Kautz, K. Pulli: FlexISP: A Flexible Camera Image Processing Framework ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2014 Project page
	G. Wetzstein, W. Heidrich, R. Raskar: Computational Schlieren Photography with Light Field Probes IJCV, 2014 Project page
	F. Heide, L. Xiao, A. Kolb, M. Hullin, W. Heidrich: Imaging in scattering media using correlation image sensors and sparse convolutional coding Optics Express, 2014 Project page
	J. Gregson, I. Ihrke, N. Thuerey, W. Heidrich: From Capture to Simulation -- Connecting Forward and Inverse Problems in Fluids ACM Transactions on Graphics (Proc. SIGGRAPH), 2014 Project page
	M. O'Toole, F. Heide, L. Xiao, M. Hullin, W. Heidrich, K. Kutulakos: Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport ACM Transactions on Graphics (Proc. SIGGRAPH), 2014 Project page
	F. Heide, J. Gregson, G. Wetzstein, R. Raskar, W. Heidrich: A Compressive Superresolution Display Computational Optical Sensing and Imaging COSI, 2014 Project page
	F. Heide, L. Xiao, W. Heidrich, M. Hullin: Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors CVPR, 2014 Project page (oral paper)
	F. Heide, J. Gregson, G. Wetzstein, R. Raskar, W. Heidrich: Compressive multi-mode superresolution display Optics Express, 2014 Project page