Related Experiment Video
Updated: Aug 18, 2025

10:25
Deep Learning-Based Segmentation of Cryo-Electron Tomograms
Published on: November 11, 2022
9.1K
Deep learning tomographic reconstruction through hierarchical decomposition of domain transforms
1GE Research, NY 12309, Niskayuna, USA.
Visual Computing for Industry, Biomedicine, and Art
|December 9, 2022
Summary
Deep learning (DL) now offers a novel framework for solving large-scale inverse problems, like computed tomography (CT) reconstruction. This hierarchical DL approach efficiently handles complex transformations for scalable image reconstruction.
Area of Science:
- Medical Imaging
- Computational Science
- Artificial Intelligence
Background:
- Deep learning (DL) excels at image analysis but struggles with large-scale inverse problems like tomographic reconstruction due to complex integral transforms.
- Existing DL models lack efficiency for non-local and space-variant transforms, limiting practical applications to smaller datasets.
- Prior attempts using fully connected networks were computationally prohibitive for realistic 3D datasets (e.g., 512^6).
Purpose of the Study:
- To develop a novel DL framework for efficient, large-scale tomographic reconstruction.
- To address the limitations of existing DL models in handling complex integral transforms inherent in inverse problems.
- To demonstrate a scalable and data-driven approach for full-size computed tomography (CT) reconstruction.
Main Methods:
- A novel framework casting tomographic reconstruction as a continuum of intermediate representations.
- Breaking down the problem into a sequence of simpler transformations mapped onto an efficient hierarchical network architecture.
- Applying the hierarchical DL approach to computed tomography (CT) image reconstruction with a 512^4 system matrix size.
Main Results:
- The proposed hierarchical DL framework enables efficient reconstruction for large-scale problems, overcoming limitations of previous methods.
- Demonstrated feasibility of full-scale CT reconstruction using a data-driven DL solver, independent of traditional inversion techniques.
- The approach requires exponentially fewer parameters compared to fully connected networks for similar problem sizes.
Conclusions:
- This work introduces a new class of DL solvers for general inverse problems, applicable beyond CT to other imaging modalities.
- The hierarchical DL approach offers potential improvements in signal-to-noise ratio, spatial resolution, and computational efficiency.
- Further development is needed to establish superiority over traditional reconstruction methods, but the feasibility of full-scale learnt reconstruction is shown.
More Related Videos
Related Concept Videos
Electron Microscope Tomography and Single-particle Reconstruction
2.5K
Transmission electron microscopy (TEM) can be used to determine the 3D structure of biological samples with the help of techniques such as electron microscope tomography and single-particle reconstruction. While single-particle reconstruction can examine macromolecules and macromolecular complexes in vitro conditions only, tomography permits the study of cell components or small cells in vivo.
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
2.5K
Computed Tomography
4.8K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.8K
Imaging Studies III: Computed Tomography
35
DefinitionComputed Tomography (CT) of the genitourinary (GU) tract is a non-invasive imaging modality that utilizes X-rays and computer processing to generate detailed cross-sectional images of the urinary system, encompassing the kidneys, ureters, bladder, and adjacent structures such as the adrenal glands.PurposeCT scans of the GU tract serve several diagnostic and therapeutic purposes, including:Diagnosis of Urinary Tract Diseases: Detects kidney stones, tumors, cysts, and congenital...
35

