Development of a software system for surgical robots based on multimodal image fusion: study protocol

Area of Science:

• Medical Robotics
• Image Processing
• Spine Surgery

Background:

• Current surgical robots use unimodal CT images, limiting visualization to bone structures.
• This exclusion of soft tissues like discs and nerves restricts robot applicability and safety.
• A multimodal image fusion approach is needed to overcome these limitations.

Purpose of the Study:

• Develop a multimodal image fusion software system for surgical robots.
• Enhance the safety and accuracy of robot-assisted pedicle screw placement.
• Expand the application range of surgical robots for procedures beyond screw placement.

Main Methods:

• Collect patient imaging data (CT and MR).
• Develop and validate segmentation algorithms for vertebrae, discs, and nerves.
• Implement multimodal image registration and fusion.
• Construct a spine application model and design the software system.
• Clinically validate the developed software system.

Main Results:

• A software system for surgical robots based on multimodal image fusion will be developed.
• The system will enable visualization of both bone and soft tissue structures.
• Clinical validation will confirm the system's efficacy.

Conclusions:

• The developed software system enhances surgical robot capabilities by integrating multimodal imaging.
• This improves accuracy in pedicle screw placement and enables new applications like nerve decompression.
• The system promises reduced complications, shorter operation times, and expanded surgical robot utility.