从组织到声音:医疗声波交互设计的新范式
Sasan Matinfar1, Shervin Dehghani1, Mehrdad Salehi1
1Computer Aided Medical Procedures (CAMP), Technical University of Munich, Munich, Germany.
Medical image analysis
|April 13, 2025
概括
这项研究介绍了"从组织到声音",这是一个新的框架,将医学成像数据映射到声音. 这可以通过组织特征创建直观的听觉显示来增强感知和外科指导.
科学领域:
- 医学成像和人机交互的人机交互
- 听觉显示器和声化设备
- 医疗保健中的多模式感知
背景情况:
- 医学成像数据至关重要,但难以解释,特别是在手术期间.
- 当前的多式联络方法不能充分利用成像数据来增强感知.
- 错误解释复杂的医学成像数据可能会产生高风险的后果.
研究的目的:
- 为了引入一个新的范式",从组织到声音",用于医疗声波交互设计.
- 建立一个用于将组织特征映射到听觉显示的框架,以补充视觉医疗数据.
- 为了增强多式联络感知,并提供直观访问医疗成像信息.
主要方法:
- 使用振荡器网络开发了一种基于物理的声音模型.
- 从成像数据到声音模型的机械性质 (摩擦,刚性) 的映射组织特性.
- 采用基于模型的无监督映射,用于高维数据处理和交互式声化.
主要成果:
- 生成可感知声学信号,代表各种组织特征 (从刚性到柔软,密度到稀疏).
- 通过可行性实验证明了框架的多功能性,包括用于视网膜手术的新型应用.
- 能够在最少的预处理下直观地探索解剖结构和数据模式.
结论:
- "从组织到声音"模式为多式联络医疗成像数据的交互式声化提供了一个先进的框架.
- 这种方法通过为医疗图像提供动态,直观的听觉访问来增强多式联络感知.
- 打开了在医疗保健中的多感官应用和交互式 sonification 模型的可能性.
相关概念视频
01:23Design Example
309
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
309
01:17Ultrasonography
4.2K
Ultrasonography is an imaging technique that uses high-frequency sound waves to visualize the body's internal structures. It is a non-invasive and safe procedure that does not involve the use of ionizing radiation, making it widely used in various medical fields. Ultrasonography is used to study heart function, blood flow in the neck or extremities, certain conditions such as gallbladder disease, and fetal growth and development.
During an ultrasonography procedure, a handheld device called...
During an ultrasonography procedure, a handheld device called...
4.2K
01:01Perception of Sound Waves
4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K
01:13The Cochlea
44.0K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
44.0K
01:16Anatomy of the Ear
7.1K
Auditory sensation, commonly called hearing, involves the transformation of sonic waves into neural impulses facilitated by the structures of the auditory organ. The prominent, flesh-like structure on the side of the head, called the auricle, directs sound waves towards the auditory canal. The auricle is often mislabeled as the pinna, a term more aligned with mobile structures like a feline's external ear. The auditory canal penetrates the cranium via the external auditory meatus of the...
7.1K
00:53Sound Waves: Interference
3.7K
Sound waves can be modeled either as longitudinal waves, wherein the molecules of the medium oscillate around an equilibrium position, or as pressure waves. When two identical waves from the same source superimpose on each other, the combination of two crests or two troughs results in amplitude reinforcement known as constructive interference. If two identical waves, that are initially in phase, become out of phase because of different path lengths, the combination of crests with troughs...
3.7K