GPU Accelerated 3D Tomographic Reconstruction and Visualization from Noisy Electron Microscopy Tilt-Series

Julio Rey Ramirez, Peter Rautek, Ciril Bohak, Ondrej Strnad, Zheyuan Zhang, Sai Li, Ivan Viola, Wolfgang Heidrich
IEEE Transactions on Visualization and Computer Graphics 2022



Reconstruction of COVID-19 tilt-series using our framework. From left to right, the result after a given number of iterations. The achieved level of denoising allows for direct 3D visualization (volume rendering) of the final volume.

Abstract

We present a novel framework for 3D tomographic reconstruction and visualization of tomograms from noisy electron microscopy tilt-series. Our technique takes as an input aligned tilt-series from cryogenic electron microscopy and creates denoised 3D tomograms using a proximal jointly-optimized approach that iteratively performs reconstruction and denoising, relieving the users of the need to select appropriate denoising algorithms in the pre-reconstruction or post-reconstruction steps. The whole process is accelerated by exploiting parallelism on modern GPUs, and the results can be visualized immediately after the reconstruction using volume rendering tools incorporated in the framework. We show that our technique can be used with multiple combinations of reconstruction algorithms and regularizers, thanks to the flexibility provided by proximal algorithms. Additionally, the reconstruction framework is open-source and can be easily extended with additional reconstruction and denoising methods. Furthermore, our approach enables visualization of reconstruction error throughout the iterative process within the reconstructed tomogram and on projection planes of the input tilt-series. We evaluate our approach in comparison with state-of-the-art approaches and additionally show how our error visualization can be used for reconstruction evaluation.



Overview video

Papers

Paper [ReyRamirez2022TVCG.pdf (33.5MB)]
Link [IEEE Transactions on Visualization and Computer Graphics]

Supplemental Document [ReyRamirez2022TVCG_sup.pdf (9.5MB)]
Code [Github]

Citation

@ARTICLE{9992117,
  author={Ramirez, Julio Rey and Rautek, Peter and Bohak, Ciril and Strnad, Ondřej and Zhang, Zheyuan and Li, Sai and Viola, Ivan and Heidrich, Wolfgang},
  journal={IEEE Transactions on Visualization and Computer Graphics}, 
  title={GPU Accelerated 3D Tomographic Reconstruction and Visualization from Noisy Electron Microscopy Tilt-Series}, 
  year={2022},
  pages={1-15},
  doi={10.1109/TVCG.2022.3230445}}