Wolfgang Heidrich

Professor of Computer Science and Elecrical & Computer Engineering
KAUST Visual Computing Center

Degrees and Employment History: Diplom Informatiker, University of Erlangen (1995); M.Math (Computer Science), University of Waterloo (1996); PhD (with honours), University of Erlangen (1999); Research Associate, Max-Planck-Institute for Computer Science (1999-2000); Assistant Professor, UBC (2000-2004); Associate Professor, UBC (2004-2010); Dolby Research Chair in Computer Science, UBC (2008-2013); Full Professor, UBC (2010-2018); Director, KAUST Visual Computing Center (2014-2021); Professor of CS and ECE, KAUST (since 2014).

Selected Awards and Distinctions: NAI Fellow (2024); ACM SIGGRAPH Computer Graphics Achievement Award (2023); ACM SIGGRAPH Test-of-Time Award (2023); IEEE Fellow (2021); Humboldt Research Award (2014); Eurographics Fellow (2013); Charles A. McDowell Award for Excellence in Research (2011).

Research Interests: my core research interests are in computational imaging and display, an emerging research area within visual computing, which combines methods from computer graphics, machine vision, imaging, inverse methods, optics and perception to develop new sensing and display technologies. Computational imaging is the hardware-software co-design of imaging devices, which aims to optically encode information about the real world in such a way that it can be captured by image sensors. The resulting images represent detailed information such as scene geometry, motion of solids and liquids, multi-spectral information, or high contrast (high dynamic range), which can then be computationally decoded using inverse methods, machine learning, and numerical optimization.

Additional details: Bio, Google Scholar, ORCID: 0000-0002-4227-8508

Recent Publications (Full List):

2016-
	X. Yang, M. Souza, K. Wang, P. Chakravarthula, Q. Fu, W. Heidrich: End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Model SIGGRAPH ASIA conference track, 2024 Project page
	X. Yang, Q. Fu, W. Heidrich: Curriculum Learning for ab initio Deep Learned Refractive Optics Nature Communications, 2024 Project page
	Z. Shi, I. Chugunov, M. Bijelic, G. Côté, J. Yeom, Q. Fu, H. Amata, W. Heidrich, F. Heide: Split-Aperture 2-in-1 Computational Cameras ACM Trans. Graphics (Proc. SIGGRAPH), 2024
	E. Tseng, G. Kuo, S.-H. Baek, N. Matsuda, A. Maimone, F. Schiffers, P. Chakravarthula, Q. Fu, W. Heidrich, D. Lanman, F. Heide: Neural étendue expander for ultra-wide-angle high-fidelity holographic display Nature Communications, 2024
	Y. Zheng, Q. Fu, H. Amata, P. Chakravarthula, F. Heide, W. Heidrich: Hexagonal diffractive optical elements Optics Express, 2023 Project page
	H. Amata, Q. Fu, W. Heidrich: Additive fabrication of SiO2-based micro-optics with lag-free depth and reduced roughness Optics Express, 2023 Project page
	Y. Wang, R. Idoughi, W. Heidrich: Learning Adaptive Tensorial Density Fields for Clean Cryo-EM Reconstruction NeurIPS, 2023 Project page
	Y. Wang, R. Idoughi, D. Rückert, R. Li, W. Heidrich: Adaptive Differentiable Grids for Cryo-Electron Tomography Reconstruction and Denoising Bioinformatics Advances, 2023 Project page
	M. Souza, W. Heidrich: MetaISP – Exploiting Global Scene Structure for Accurate Multi-Device Color Rendition Vision, Modeling, and Visualization (VMV), 2023 Project page
	N. Chen, C. Wang, W. Heidrich: ∂H: Differentiable Holography Laser & Photonics Reviews, 2023
	H. Amata, Q. Fu, W. Heidrich: Additive diffractive optical elements fabrication by PECVD deposition of SiO2 and lift-off process Proc. SPIE 12624, Digital Optical Technologies, 2023 Project page
	M. Qi, W. Heidrich: Scattering-aware Holographic PIV with Physics-based Motion Priors ICCP, 2023 Project page
	X. Yang, Q. Fu, M. Elhoseiny, W. Heidrich: Aberration-Aware Depth-from-Focus ICCP & IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Project page
	S. Qiu, H. Amata, W. Heidrich: MoiréTag: Angular Measurement and Tracking with a Passive Marker SIGGRAPH, 2023 Project page
	J. Zhang, X. Dun, J. Zhu, Z. Zhang, C. Feng, Z. Wang, W. Heidrich, X. Cheng: Large Numerical Aperture Metalens with High Modulation Transfer Function ACS Photonics, 2023
	Y. Li, Q. Fu, W. Heidrich: Extended Depth-of-Field Projector using Learned Diffractive Optics IEEE VR, 2023 Project page
	J. Li, Y. Li, C. Wang, X. Ye, W. Heidrich: BUSIFusion: Blind Unsupervised Single Image Fusion of Hyperspectral and RGB Images IEEE Transactions on Computational Imaging, 2023
	J. Rey Ramirez, P. Rautek, C. Bohak, O. Strnad, Z. Zhang, S. Li, I. Viola, W. Heidrich: GPU Accelerated 3D Tomographic Reconstruction and Visualization from Noisy Electron Microscopy Tilt-Series IEEE Transactions on Visualization and Computer Graphics, 2022 Project page
	Q. Fu, D. Yan, W. Heidrich: Diffractive lensless imaging with optimized Voronoi-Fresnel phase Optics Express, 2022 Project page
	C. Wang, N. Chen, W. Heidrich: dO: A differentiable engine for Deep Lens design of computational imaging systems IEEE Transactions on Computational Imaging, 2022 Project page
	N. Chen, C. Wang, W. Heidrich: HTRSD: Hybrid Taylor Rayleigh-Sommerfeld diffraction Optics Express, 2022 Project page
	R. Li, D. Rückert, Y. Wang, R. Idoughi, W. Heidrich: Neural Adaptive Scene Tracing (NAScenT) VMV, 2022 Project page
	G. Qian*, Y. Wang*, J. Gu, C. Dong, W. Heidrich, B. Ghanem,, J. Ren: Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline ICCP, 2022
	Y. Wang, R. Idoughi, W. Heidrich: Joint Motion-Correction and Reconstruction in Cryo-EM Tomography ICIP, 2022 Project page
	D. Rückert, Y. Wang, R. Li, R. Idoughi, W. Heidrich: NeAT-Neural Adaptive Tomography ACM Transactions on Graphics (Proc. SIGGRAPH), 2022 Project page
	Z. Shi, Y. Bahat, S.-H. Baek, Q. Fu, H. Amata, X. Li, P. Chakravarthula, W. Heidrich, F. Heide: Seeing Through Obstructions With Diffractive Cloaking ACM Transactions on Graphics (Proc. SIGGRAPH), 2022
	X. Yang, Q. Fu, W. Heidrich: Automatic Lens Design based on Differentiable Ray-tracing OSA Imaging and Applid Optics Congress - Computational Optical Sensing and Imaging, 2022 Project page
	Y. Bokhari, A. Alhareeri, A. Aljouie, A. Alkhaldi, M. Rasheed, M. Alawwad, R. Alhassnan, S. Saad Samargandy, A. Panahi, W. Heidrich, T. Arodz: ChromoEnhancer: An artificial intelligence-based tool to enhance neoplastic karyograms as an aid for effective analysis Cells, 2022
	N. Chen, C. Wang, W. Heidrich: Compact Computational Holographic Display (Invited Article) Frontiers in Photonics, 2022 Project page
	Q. Fu, H. Amata, W. Heidrich: Etch-free additive lithographic fabrication methods for reflective and transmissive micro-optics Optics Express, 2021 Project page
	K. AbuJbara*, R. Idoughi*, W. Heidrich: Non-Linear Anisotropic Diffusion for Memory-Efficient Computed Tomography Super-Resolution Reconstruction 3DV, 2021 Project page (oral paper)
	M. Qi, C. Wang, W. Heidrich: Coded Wavefront Sensor and Non-iterative Learning-based Reconstruction OSA Imaging Congress - COSI, 2021
	C. Wang, N. Chen, W. Heidrich: Towards self-calibrated lens metrology by differentiable refractive deflectometry Optics Express, 2021 Project page
	N. Chen, C. Wang, W. Heidrich: Space-time optical imaging framework - Holographic particle tracking velocimetry OSA Imaging Congress - Digital Holography & 3D Imaging, 2021 Project page
	C. Wang, N. Chen, W. Heidrich: Lens design optimization by back-propagation OSA Optical Design and Fabrication Congress - IODC, 2021 (Best Student Paper Award)
	J. Xiong, W. Heidrich: In-the-Wild Single Camera 3D Reconstruction Through Moving Water Surfaces ICCV, 2021 Project page (oral paper)
	G. Zang, R. Idoughi, R. Li, P. Wonka, W. Heidrich: IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction ICCV, 2021 Project page
	Y. Li, Q. Fu, W. Heidrich: Multispectral illumination estimation using deep unrolling network ICCV, 2021 Project page
	S.-H. Baek, H. Ikoma, D. Jeon, Y. Li, W. Heidrich, G. Wetzstein, M. H. Kim: Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics ICCV, 2021
	Q. Sun, C. Wang, Q. Fu, X. Dun, W. Heidrich: End-to-End Complex Lens Design with Differentiable Ray-Tracing ACM Transactions on Graphics (Proc. SIGGRAPH), 2021 Project page
	N. Chen*, C. Wang*, W. Heidrich: Snapshot space-time holographic three-dimensional particle tracking velocimetry Laser and Photonics Reviews, 2021 Project page
	J. Xiong*, J. Wang*, W. Heidrich, S. Nayar: Seeing in Extra Darkness Using a Deep-Red Flash CVPR, 2021 Project page (oral paper)
	I. Chugunov, S.-H. Baek, Q. Fu, W. Heidrich, F. Heide: Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imaging CVPR, 2021
	S. Qiu, Q. Fu, C. Wang, W. Heidrich: Linear Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays Computer Graphics Forum, 2021 Project page
	N. Chen, C. Wang, W. Heidrich: Holographic 3D particle imaging with model-based network IEEE Transactions on Computational Imaging, 2021 Project page
	N. Chen*, Y. Li*, W. Heidrich: Physics-based HoloNet for three-dimensional imaging 3D Image Acquisition and Display - Technology, Perception and Applications, 2020 Project page
	C. Marois, B. Gerard, O. Lardière, A. Anthony, C. Bradley, J. Dunn, Q. Fu, T. Hardy, W. Heidrich, G. Herriot, E. Nielsen, S. Sivanandam, D. Sivransky, S. Thibault, W. Thompson, J.-P. Véran: Upgrading the Gemini Planet Imager calibration unit with a photon counting focal plane wavefront sensor SPIE Proceedings Volume 11448, Adaptive Optics Systems VII, 2020
	J. Xiong, A. Aguirre-Pablo, R. Idoughi, S. T. Thoroddsen, W. Heidrich: RainbowPIV with improved depth resolution — design and comparative study with TomoPIV Measurement Science and Technology, 2020 Project page
	Y. Wang, R. Idoughi, W. Heidrich: Stereo Event-based Particle Tracking Velocimetry for 3D Fluid Flow Reconstruction ECCV, 2020 Project page
	R. Li*, S. Qiu*, G. Zang, W. Heidrich: Reflection Separation via Multi-bounce Polarization State Tracing ECCV, 2020 Project page
	Q. Sun, E. Tseng, Q. Fu, W. Heidrich, F. Heide: Learning Rank-1 Diffractive Optics for Single-shot High Dynamic Range Imaging CVPR, 2020 Project page (oral paper)
	Y. Li, M. Qi, R. Gulve, M. Wei, R. Genov, K. Kutulakos, W. Heidrich: End-to-End Video Compressive Sensing Using Anderson-Accelerated Unrolled Networks ICCP, 2020 Project page
	G. Zang, R. Idoughi, C. Wang, A. Bennett, J. Du, S. Skeen, W. Roberts, P. Wonka, W. Heidrich: TomoFluid: Reconstructing Dynamic Fluid from Sparse View Videos CVPR, 2020 Project page
	J. Du*, G. Zang*, B. Mohan, R. Idoughi, J. Sim, T. Fang, P. Wonka, W. Heidrich, W. Roberts: Study of Spray Structure from Non-flash to Flash Boiling Conditions with Space-time Tomography Proceedings of the Combustion Institute, 2020 Project page
	C. Wang, Q. Fu, X. Dun, W. Heidrich: Modeling Classical Wavefront Sensors Optics Express, 2020 Project page
	Q. Sun, J. Zang, X. Dun, B. Ghanem, Y. Peng, W. Heidrich: End-to-End Learned, Optically Coded Super-resolution SPAD Camera ACM Transactions on Graphics, 2020 Project page
	I. Alsolami, W. Heidrich: Imaging with SPADs and DMDs: Seeing through Diffraction-Photons IEEE Transactions on Image Processing, 2020
	C. Wang, Q. Fu, X. Dun, W. Heidrich: Quantitative Phase and Intensity Microscopy Using Snapshot White Light Wavefront Sensing Scientific Reports, 2019 Project page
	R. Li, W. Heidrich: Hierarchical and View-invariant Light Field Segmentation by Maximizing Entropy Rate on 4D Ray Graphs ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2019 Project page
	Y. Peng*, Q. Sun*, X. Dun*, G. Wetzstein, W. Heidrich, F. Heide: Learned Large Field-of-View Imaging With Thin-Plate Optics ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2019 Project page
	J. Xiong, P. Richtarik, W. Heidrich: Stochastic Convolutional Sparse Coding International Symposium on Vision, Modeling and Visualization, 2019 Project page (Best Paper Award)
	S. Qiu, Q. Fu, C. Wang, W. Heidrich: Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays International Symposium on Vision, Modeling and Visualization, 2019 Project page
	M. Alghamdi, Q. Fu, A. Thabet, W. Heidrich: Reconfigurable Snapshot HDR Imaging Using Coded Masks and Inception Network International Symposium on Vision, Modeling and Visualization, 2019 Project page
	M. Li*, P. Tu*, W. Heidrich: Robust Joint Image Reconstruction from Color and Monochrome Cameras British Machine Vision Conference (BMVC), 2019
	G. Zang, R. Idoughi, R. Tao, G. Lubineau, P. Wonka, W. Heidrich: Warp-and-Project Tomography for Rapidly Deforming Objects ACM Transactions on Graphics (Proc. SIGGRAPH), 2019 Project page
	D. Jeon, S.-H. Baek, S. Yi, Q. Fu, X. Dun, W. Heidrich, M. H. Kim: Compact Snapshot Hyperspectral Imaging with Diffracted Rotation ACM Transactions on Graphics (Proc. SIGGRAPH), 2019 Project page
	L. Fortunato, M. Li, T. Cheng, ZU. Rehman, W. Heidrich, TO. Leiknes: Cake layer characterization in Activated Sludge Membrane Bioreactors: Real-time analysis Journal of Membrane Science, 2019
	A. A. Aguirre-Pablo, A. B. Aljedaani, J. Xiong, R. Idoughi, W. Heidrich, S. T. Thoroddsen: Single-camera 3D PTV using particle intensities and structured light Experiments in Fluids, 2019 Project page
	N. Smith, N. Moehrle, M. Goesele, W. Heidrich: Aerial Path Planning for Urban Scene Reconstruction -- A Continuous Optimization Method and Benchmark ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2018 Project page
	J. Chang, V. Sitzmann, X. Dun, W. Heidrich, G. Wetzstein: Hybrid Optical-Electronic Convolutional Neural Networks Scientific Reports, 2018
	G. Zang, M. Aly, R. Idoughi, P. Wonka, W. Heidrich: Super-Resolution and Sparse View CT Reconstruction ECCV, 2018 Project page
	L. Xiao, F. Heide, W. Heidrich, B. Schölkopf, M. Hirsch: Discriminative Transfer Learning for General Image Restoration IEEE Transactions on Image Processing, 2018
	G. Zang, R. Idoughi, R. Tao, G. Lubineau, P. Wonka, W. Heidrich: Space-time Tomography for Continuously Deforming Objects ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	C. Wang, Q. Fu, X. Dun, W. Heidrich: Megapixel Adaptive Optics: Towards Correcting Large-scale Distortions in Computational Cameras ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	V. Sitzmann, S. Diamond, Y. Peng, X. Dun, S. Boyd, W. Heidrich, F. Heide, G. Wetzstein: End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	T. Auzinger, W. Heidrich, B. Bickel: Computational Design of Nanostructural Color for Additive Manufacturing ACM Transactions on Graphics (Proc. SIGGRAPH), 2018 Project page
	M.-L. Eckert, W. Heidrich, N. Thuerey: Coupled Fluid Density and Motion from Single Views Symposium on Computer Animation, 2018 Project page (Best Paper Award)
	Q. Sun, X. Dun, Y. Peng, W. Heidrich: Depth and Transient Imaging with Compressive SPAD Array Cameras CVPR, 2018 Project page
	S. Su, F. Heide, G. Wetzstein, W. Heidrich: Deep End-to-End Time-of-Flight Imaging CVPR, 2018 Project page
	J. Xiong, Q. Fu, R. Idoughi, W. Heidrich: Reconfigurable Rainbow PIV for 3D Flow Measurement ICCP, 2018 Project page
	Y. Peng, X. Dun, Q. Sun, F. Heide, W. Heidrich: Focal Sweep Imaging with Multi-focal Diffractive Optics ICCP, 2018 Project page
	Y. Peng, X. Dun, Q. Sun, W. Heidrich: Mix-and-Match Holography ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2017 Project page
	B. Choudhury, R. Swanson, F. Heide, G. Wetzstein, W. Heidrich: Consensus Convolutional Sparse Coding ICCV, 2017 Project page
	T. Sun, Y. Peng, W. Heidrich: Revisiting Cross-channel Information Transfer for Chromatic Aberration Correction ICCV, 2017 Project page
	M. Li, R. Idoughi, B. Choudhury, W. Heidrich: Statistical model for OCT image denoising Biomedical Optics Express, 2017 Project page
	J. Xiong, R. Idoughi, A. Aguirre-Pablo, A. Aljedaani, X. Dun, Q. Fu, S. T. Thoroddsen, W. Heidrich: Rainbow Particle Imaging Velocimetry for Dense 3D Fluid Velocity Imaging ACM Transactions on Graphics (Proc. SIGGRAPH), 2017 Project page
	S. Su, M. Delbracio, J. Wang, G. Sapiro, W. Heidrich, O. Wang: Deep Video Deblurring for Hand-held cameras CVPR, 2017 (spotlight presentation)
	C. Wang, X. Dun, Q. Fu, W. Heidrich: Ultra-High Resolution Coded Wavefront Sensor Optics Express, 2017 Project page
	G. Damberg, R. Boitard, A. Ballestad, W. Heidrich: Light Steering Projection Systems and Attributes for HDR Displays SID Digest, 2017
	W. Heidrich, (ed.): Proceedings of ACM SIGGRAPH ASIA 2016 ACM Transactions on Graphics, 2016
	F. Heide, Q. Fu, Y. Peng, W. Heidrich: Encoded diffractive optics for full-spectrum computational imaging Scientific Reports, 2016
	L. Xiao, J. Wang, W. Heidrich, M. Hirsch: Learning High-Order Filters for Efficient Blind Deconvolution of Document Photographs ECCV, 2016 (spotlight presentation)
	Y. Peng, Q. Fu, W. Heidrich: The Diffractive Achromat -- Full Spectrum Computational Imaging with Diffractive Optics ACM Transactions on Graphics (Proc. SIGGRAPH), 2016 Project page
	S. Shrestha, F. Heide, W. Heidrich, G. Wetzstein: Computational Imaging with Phased Time-of-Flight Camera Arrays ACM Transactions on Graphics (Proc. SIGGRAPH), 2016 Project page
	F. Heide, S. Diamond, M. Niessner, J. Ragan-Kelley, W. Heidrich, G. Wetzstein: ProxImaL: Efficient Image Optimization using Proximal Algorithms ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
	S. Su, F. Heide, R. Swanson, J. Klein, C. Callenberg, M. Hullin, W. Heidrich: Material Classification Using Raw Time-of-Flight Measurements CVPR, 2016 Project page
	O. Cossairt, J. Yu, W. Heidrich, (eds.): Proceedings of the International Conference of Computational Photography 2016 IEEE, 2016
	G. Damberg, J. Gregson, W. Heidrich: High Brightness HDR Projection Using Dynamic Freeform Lensing ACM Transactions on Graphics, 2016