Multi-branch attention prior based parameterized generative adversarial network for fast and accurate

Peng Zhang1,2, Chenbin Ma1,3,2, Fan Song1

  • 1Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.

Biomedical Optics Express
|November 25, 2022
PubMed

Insights

We developed a new AI method, MAP-PGAN, for faster and more accurate 3D imaging using limited-projection fluorescence molecular tomography (FMT). This approach significantly improves reconstruction speed and precision for biological and medical applications.

Area of Science:

  • Biomedical imaging
  • Medical physics
  • Artificial intelligence in medicine

Background:

  • Limited-projection fluorescence molecular tomography (FMT) enables rapid 3D imaging but suffers from ill-posedness due to limited data and photon scattering in tissues.
  • Traditional regularization methods struggle with complex computations, slow reconstruction, and unstable results for limited-projection FMT.

Purpose of the Study:

  • To develop a fast and accurate reconstruction method for limited-projection FMT.
  • To overcome the limitations of conventional iterative algorithms in terms of speed and stability.

Main Methods:

  • Proposed a novel multi-branch attention prior based parameterized generative adversarial network (MAP-PGAN).
  • Employed an end-to-end direct reconstruction strategy, eliminating complex iterative computations.
  • Utilized multi-branch attention to provide weighted sparse prior information for fluorescent sources.

Main Results:

  • MAP-PGAN significantly improved reconstruction accuracy, localization, and morphological recovery compared to state-of-the-art methods.
  • Achieved reconstruction times of approximately 0.18s, representing a 100-1000x speedup over iterative algorithms.
  • Demonstrated feasibility and practicality through numerical simulations, physical phantoms, and in vivo experiments.

Conclusions:

  • MAP-PGAN offers a highly effective solution for fast and accurate limited-projection FMT reconstruction.
  • The AI-driven approach overcomes the inherent challenges of limited-projection FMT, enabling accelerated 3D visualization.
  • This method holds significant potential for advancing biomedical research and clinical diagnostics.

Related Concept Videos

Electron Microscope Tomography and Single-particle Reconstruction01:07

Electron Microscope Tomography and Single-particle Reconstruction

Transmission electron microscopy (TEM) can be used to determine the 3D structure of biological samples with the help of techniques such as electron microscope tomography and single-particle reconstruction. While single-particle reconstruction can examine macromolecules and macromolecular complexes in vitro conditions only, tomography permits the study of cell components or small cells in vivo.
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
2.5K
Super-resolution Fluorescence Microscopy01:37

Super-resolution Fluorescence Microscopy

Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.1K
Confocal Fluorescence Microscopy01:16

Confocal Fluorescence Microscopy

Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
13.5K