Related Experiment Video
Updated: Aug 29, 2025
09:24
Micro 3D Printing Using a Digital Projector and its Application in the Study of Soft Materials Mechanics
Published on: November 27, 2012
25.5K
3D endoscope system with AR display superimposing dense and wide-angle-of-view 3D points obtained by using micro
Summary
This study introduces an augmented reality (AR) system for endoscopy, reconstructing 3D shapes from endoscopic images. The system superimposes these 3D models onto the real-time view, aiding doctors during procedures.
Area of Science:
- Medical Imaging
- Computer Vision
- Augmented Reality
Background:
- Augmented reality (AR) systems enhance tasks by overlaying information onto real-world views.
- AR can assist endoscopists by providing crucial information during procedures.
Purpose of the Study:
- To propose an AR system for superimposing 3D shapes reconstructed from endoscopic images onto the endoscopist's field of view.
- To enhance internal body observation for doctors during endoscopic procedures.
Main Methods:
- Developed a system with a reconstruction module (active stereo, novel projection pattern for wide-area 3D shape acquisition) and a display module.
- Reconstructed 3D shapes from endoscopic images and superimposed them onto the live view.
Main Results:
- Demonstrated wide-area dense 3D reconstruction capabilities using the novel projection patterns.
- Confirmed the practical usefulness of the proposed AR system through medical doctor interviews.
Conclusions:
- The developed AR system effectively reconstructs and displays 3D shapes from endoscopic views.
- The system offers valuable assistance to endoscopists by providing superimposed anatomical information.
