Related Experiment Video
Updated: Aug 12, 2026

Pioneering Patient-Specific Approaches for Precision Surgery Using Imaging and Virtual Reality
Published on: April 5, 2024
Surgery with computerized virtual reality for the automatic detection of tumors
Fernández Fernández de Santo1, S Nieto Llanos, M Ortiz Aguilar
1Servicio de Cirugía General y Aparato Digestivo, Hospital Universitario de "La Princesa", Universidad Autónoma de Madrid, Madrid, España.
Abstract:
We present a novel and highly accurate system based on informatics engineering capable of automatic detection of tumors directly in the operating field. The system can identify the outlines of the tumor, determine whether it is malignant or not, detect lymphadenopathy and determine whether nodes are metastasized or not. The highly elaborate system, based on artificial vision, has been used in 30 gastric and 5 pancreatic neoplasms, among other tumor types. Images of the surgical field were recorded with a video camera connected to a computer, which was operated by the engineer. Questions asked by the surgeon during the procedure were processed immediately and sent to the virtual reality helmet worn by the surgeon, to the TV monitor in the operating room, or to both. The system is based on purely physical and mathematical processes that work reliably; in this sense it is free from errors and is self-consistent, operator errors or hardware failure excepted. In all cases tested here the system correctly identified the tumor as benign or malignant, revealed the extension of the tumor, and detected lymph node metastases. In every case these results were confirmed by histological examination.

