Development of anatomically accurate digital organ models for surgical simulation and training

Advancements in robotics and other technological innovations have accelerated the development of surgical procedures, increasing the demand for training environments that accurately replicate human anatomy. This study developed a system that utilizes the AutoSegmentator extension of 3D Slicer, based on nnU-Net, a state-of-the-art deep learning framework for automatic organ extraction, to import automatically extracted organ surface data into CAD software along with original DICOM-derived images. This system allows medical experts to manually refine the automatically extracted data, making it more accurate and closer to the ideal dataset. First, Python programming is used to automatically generate and save JPEG-format image data from DICOM data for display in Blender. Next, DICOM data imported into 3D Slicer is processed by AutoSegmentator to extract surface data of 104 organs in bulk, which is then exported in STL format. In Blender, a custom-developed Python script aligns the image data and organ surface data within the same 3D space, ensuring accurate spatial coordinates. By using Blender's CAD functionality within this space, the automatically extracted organ boundaries can be manually adjusted based on the image data, resulting in more precise organ surface data. Additionally, organs and blood vessels that cannot be automatically extracted can be newly created and added by referencing the image data. Through this process, a comprehensive anatomical dataset encompassing all required organs and blood vessels can be constructed. The dataset created with this system is easily customizable and can be applied to various surgical simulations, including 3D-printed simulators, hybrid simulators that incorporate animal organs, and surgical simulators utilizing augmented reality (AR). Furthermore, this system is built entirely using open-source, free software, providing high reproducibility, flexibility, and accessibility. By using this system, medical professionals can actively participate in the design and data processing of surgical simulation systems, leading to shorter development times and reduced costs.