ChatIOS:通过GPT-4V和多模式预训练来改进自动三维牙细分
Yongjia Wu1, Yun Zhang1, Yange Wu1
1Department of Orthodontics, Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, PR China.
Journal of dentistry
|April 14, 2025
概括
通过使用GPT-4V和多模式预训练,ChatIOS框架增强了3D牙细分,提高了牙科治疗的准确性和效率. 这种方法开创了数字牙科应用的多式联络预培训.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 数字牙科数字牙科
背景情况:
- 从口腔内扫描 (IOSs) 中精确的3D牙细分对于牙科治疗,如正牙科和假牙至关重要.
- 目前的深度学习方法需要改进,以便精确有效地对3D IOS数据进行细分.
研究的目的:
- 提出和评估ChatIOS框架,整合GPT-4V和多式联络预培训,以改善3D牙细分.
- 在IOS数据中增强深度学习算法用于3D牙细分.
主要方法:
- 从Teeth3DS数据集中使用1800个3D IOS扫描开发了ChatIOS框架.
- 预处理3D IOS数据到点云中,并使用GPT-4V进行2D图像描述.
- 采用多式联网预培训,使用点云,二维图像和文本描述作为输入三胞胎.
主要成果:
- 在细分质量指标 (mIoU,准确度,DSC) 上,ChatIOS显著超过了现有的基准标准,如PointNet ++ .
- 实现了高细分精度 (例如,上98.0%,下97.9%).
- 证明了高效的处理 (大约. 每次扫描2秒) 和临床适用性.
结论:
- 聊天IOS框架提高了临床牙科手术3D牙细分的有效性和效率.
- 这项研究开创了用于3D牙细分的多式预培训,并探索了GPT-4V在数字牙科中的应用.
相关概念视频
02:07Improving Translational Accuracy
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
02:07Improving Translational Accuracy
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...