Related Experiment Video
Updated: Aug 7, 2026
05:12
Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
Published on: August 12, 2021
2-D Endoscope Video Feed Becomes 3-D With NeRF-Enabled Surgical Tracking System
IEEE Pulse
|August 5, 2026
Summary
A new surgical tracking system called VISTA uses neural radiance fields (NeRFs) to create real-time 3-D surgical views from CT scans and endoscopic video. This aims to improve sinus surgery precision and reduce repeat procedures.
Area of Science:
- Medical technology
- Computer vision
- Surgical navigation
Background:
- Standard sinus surgery relies on pre-operative imaging, which may not reflect intraoperative changes.
- Lack of real-time 3-D visualization can limit surgical precision and effectiveness.
Purpose of the Study:
- To develop a vision-integrated surgical tracking assistance (VISTA) system.
- To enhance sinus surgery by providing a dynamic 3-D surgical field view.
- To improve surgical precision and reduce the need for revision surgeries.
Main Methods:
- Utilizing neural radiance fields (NeRFs) for 3-D scene reconstruction.
- Integrating pre-operative computed tomography (CT) scans with intraoperative 2-D endoscopic video.
- Developing a system for rapid updates of the 3-D surgical view during tissue removal.
Main Results:
- Successfully generated updated 3-D views of the sinus surgery field.
- Demonstrated potential for real-time visualization during surgical procedures.
Conclusions:
- The VISTA system shows promise for enhancing standard sinus surgery.
- Real-time 3-D visualization using NeRFs can improve surgical outcomes and patient care.
