3D Multi-Modality Medical Imaging: Combining Anatomical and Infrared Thermal Images for 3D Reconstruction.

Area of Science:

• Biomedical Engineering
• Medical Imaging
• Computational Anatomy

Background:

• Two-dimensional (2D) medical thermography offers surface temperature distribution but lacks spatial depth.
• Integrating multiple images or three-dimensional (3D) systems can enhance depth information.

Purpose of the Study:

• To develop a 3D thermal anatomy model of the neck/bust region.
• To combine functional (thermal) and anatomical (CT-based) data for improved visualization.
• To enhance pathological assessments through detailed 3D anatomical and thermal correlation.

Main Methods:

• Generation of a 3D point cloud from thermal infrared images.
• Creation of a 3D geometry model from CT images, including segmented inner structures (thyroid, trachea, veins, arteries).
• Computational processing including Structure from Motion (SfM), image registration, and affine transformation for model unification.

Main Results:

• Successful 3D reconstruction and visualization of neck/bust geometry and inner anatomical structures.
• Presentation of 3D thermal geometry across coronal, sagittal, and axial planes.
• Combined visualization of functional and anatomical images of the neck region.

Conclusions:

• The generated 3D thermal anatomy models provide a fused view of inner and outer regions.
• This methodology shows encouraging results for correlating anatomical and thermal data.
• The approach has the potential to improve biomedical applications and future diagnostic capabilities.