SeamXSim:通过未配对的长期视频翻译无纹理的虚拟结肠镜模拟器
Seunghyun Jang1, Dongheon Lee2, Yisak Kim1
1Interdisciplinary Program in Bioengineering, Seoul National University Graduate School, Seoul, South Korea; Integrated Major in Innovative Medical Science, Seoul National University Graduate School, Seoul, South Korea; Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, South Korea.
这项研究介绍了SeamXSim,这是一款新的虚拟结肠镜模拟器,它使用真实结肠图像来实现现实的纹理. 它通过提高模拟准确性和教育价值,显著改善了初学者内镜师的培训.
科学领域:
- 医疗模拟 医疗模拟
- 胃肠病学 胃肠病学
- 计算机图形 计算机图形
背景情况:
- 结肠镜对于诊断胃肠道疾病至关重要,但需要广泛的培训.
- 新手内镜医生面临更高的并发症率和更长的手术时间.
- 目前的虚拟结肠镜模拟器由于人工纹理而缺乏现实性,限制了它们的教育实用性.
研究的目的:
- 开发一个具有现实的纹理的高保真度虚拟结肠镜模拟器.
- 提高虚拟结肠镜训练工具的沉浸性和实用性.
- 为了提高模拟结肠镜视频的空间和时间一致性.
主要方法:
- SeamXSim合成真实结肠图像,以创建无的高保真纹理.
- SeamXSim-T使用视频翻译方法扩展了框架,具有新的流程扭曲损失,用于生成时间一致的视频.
- 用3D重建和深度估计任务来评估SeamXSim的性能.
- 在视频翻译中评估空间一致性,以评估SeamXSim-T.
主要成果:
- 与现有模型 (5.584毫米) 相比,SeamXSim在3D重建中实现了较低的网格到云错误 (3.629毫米).
- 在深度估计中,SeamXSim显示出较低的错误率 (0.123).
- SeamXSim-T在视频翻译任务中提高了16%的空间一致性.
- 新手内镜医生更喜欢SeamXSim,因为它提高了现实性和教育价值.
结论:
- SeamXSim显著提高了虚拟结肠镜模拟的现实性和真实性.
- 拟议的模拟器为改善临床教育和初学者内镜师技能提供了一个有前途的工具.
- 先进的纹理合成和视频翻译有助于更有效的医疗培训.
更多相关视频
05:12Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
Published on: August 12, 2021
07:46Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
相关概念视频
Imaging Studies III: Gastrointestinal Motility Studies and Virtual Colonoscopy
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
Endoscopic Procedures III: Video Capsule Endoscopy
Endoscopic Procedures II: Colonoscopy
Translation
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of...
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Improving Translational Accuracy
