Related Experiment Video
Updated: Jun 25, 2025
06:08
Quantitative Visualization and Detection of Skin Cancer Using Dynamic Thermal Imaging
Published on: May 5, 2011
16.8K
Design and evaluation of an AR-based thermal imaging system for planning reconstructive surgeries
Michael Unger1, Annika Hänel2, Claire Chalopin2,3
1Innovation Center Computer Assisted Surgery, Leipzig, Germany. Michael.unger@medizin.uni-leipzig.de.
Summary
This study developed an augmented reality (AR) system for overlaying thermal imaging onto patients, improving visualization for reconstructive surgery. While the system streams real-time thermal data, its current accuracy limits clinical application.
Area of Science:
- Medical Imaging
- Augmented Reality
- Surgical Planning
Background:
- Thermal imaging offers non-invasive detection of skin vasculature.
- Current methods for mapping thermal data to patients lack user-friendliness.
- Augmented reality (AR) presents a potential solution for superimposing thermal information.
Purpose of the Study:
- To develop and evaluate an AR system for reconstructive surgery planning.
- To integrate thermal imaging data with AR visualization.
- To assess the accuracy of AR projection for clinical applications.
Main Methods:
- Designed an AR system using a thermal camera and Microsoft HoloLens.
- Combined RGB, depth, and thermal cameras for real-time 3D scene reconstruction.
- Developed and evaluated an active calibration target for camera and AR device registration.
- Utilized a Vuforia marker for hologram registration in virtual space.
Main Results:
- The AR system was evaluated by 21 participants.
- Mean projection error was 10.3 ± 9.4 mm.
- The system achieved real-time streaming of 3D scenes with augmented thermal data at 5 fps.
- The active calibration target demonstrated environmental independence.
Conclusions:
- The calibration target facilitates easy registration of cameras across visible to long-infrared spectra.
- Current AR tracking (HoloLens inside-out tracking with Vuforia marker) lacks sufficient accuracy for clinical use.
- Further development is needed to enhance the precision of AR systems in medical applications.
