大规模的自我监督视频基础模型用于智能手术
Shu Yang1, Fengtao Zhou1, Leon Mayer2,3
1Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China.
NPJ digital medicine
|February 4, 2026
概括
这项研究介绍了SurgVISTA,这是一种用于外科视频分析的新型AI框架. 它通过学习空间和时间信息来提高对外科手术程序的理解,优于现有的方法.
科学领域:
- 人工智能在医学中的应用
- 计算机视觉 计算机视觉
- 手术机器人手术机器人手术机器人手术机器人
背景情况:
- 计算机辅助干预 (CAI) 依赖于手术场景的理解,以支持决策和有效性.
- 目前用于手术场景理解的人工智能方法缺乏明确的时间建模,限制了时空理解.
- 现有的自我监督学习方法专注于空间表征,忽视了关键的动态外科手术背景.
研究的目的:
- 开发第一个视频级手术预培训框架,用于共同的时空表现学习.
- 解决现有人工智能模型在捕捉动态手术环境中的局限性.
- 提高计算机辅助干预的决策能力和程序效率.
主要方法:
- 建立一个大规模的手术视频数据集 (3650个视频,355万),涵盖各种程序和解剖结构.
- 关于SurgVISTA (外科视频级空间时空架构) 的建议,这是一种基于重建的预训练方法,用于联合的空间时空学习.
- 整合图像级知识蒸,使用特定于手术的专家模型来完善解剖学和语义特征学习.
主要成果:
- 在手术视频中学习的关节时空表征中,SurgVISTA表现出卓越的性能.
- 该框架有效地捕捉了手术过程中的复杂的空间结构和时间动态.
- 对13个视频级数据集的基准实验表明SurgVISTA的表现优于自然和外科领域预先训练的模型.
结论:
- 在手术视频分析的预培训中,SurgVISTA代表了显著的进步.
- 该模型学习时空特征的能力具有强大的潜力,可以改进智能手术系统.
- 这种方法为更有效的计算机辅助干预铺平了道路,通过提高手术场景的理解.
相关概念视频
01:20Social Foundations of Self II: The Generalized Other
266
According to George Herbert Mead, as children progress beyond the game stage, they develop a more comprehensive understanding of societal rules and norms. This cognitive and social development enables them to internalize the expectations of the broader community, refining their ability to regulate behavior.Consistent participation in organized activities is crucial in helping children recognize that their actions are not isolated but contribute to a more significant, interconnected group...
266
01:24Physiological Foundation of Stress
681
Stress triggers a coordinated physiological response involving the sympathetic nervous system (SNS) and the hypothalamic-pituitary-adrenal (HPA) axis. This dual activation ensures that the body is prepared for both immediate and prolonged stress management. The process begins with the perception of a stressor. This initial phase activates the SNS, leading to the rapid release of adrenaline (epinephrine) from the adrenal glands.
Role of the Sympathetic Nervous System
Adrenaline triggers the...
Role of the Sympathetic Nervous System
Adrenaline triggers the...
681
01:27Intelligence
8.7K
The term "intelligence" is complex because it refers to both behavior and individuals, and its interpretation varies across cultures. European Americans tend to link intelligence with reasoning and cognitive skills, while in Kenya, it is tied to responsible participation in family and social life. In Uganda, intelligence is seen as the ability to know the right actions and carry them out effectively, while the Iatmul people of Papua New Guinea associate it with the capacity to remember...
8.7K
01:30Theoretical Foundations of Nursing Practice
17.5K
Theories play an essential role in organizing patient care. Theories refer to a proposed or followed belief, policy, or procedure that is the basis for action. Nursing theories are knowledge-based concepts that guide nurses' actions, influence nursing education and practice, and allow nurses to care for their patients.
Theories provide a perspective to assess patients' conditions and organize data and methods. They also assist in analyzing and interpreting information. They represent a...
Theories provide a perspective to assess patients' conditions and organize data and methods. They also assist in analyzing and interpreting information. They represent a...
17.5K
02:41pH Scale
80.0K
Hydronium and hydroxide ions are present both in pure water and in all aqueous solutions, and their concentrations are inversely proportional as determined by the ion product of water (Kw). The concentrations of these ions in a solution are often critical determinants of the solution’s properties and the chemical behaviors of its other solutes. Two different solutions can differ in their hydronium or hydroxide ion concentrations by a million, billion, or even trillion times. A common means of...
80.0K
01:24Social Foundations of Self I: Play and Game
220
The development of self in children is deeply rooted in social interactions, mainly through stages of play and structured games. These stages, outlined by sociologist George Herbert Mead, illustrate how children progressively learn to understand and adopt social roles, forming a cohesive sense of self.The Play Stage: Imitation and Simple Role-TakingIn the early years of childhood, the play stage is characterized by imitative behavior, where children engage in role-playing based on familiar...
220