对视障人士的音频控制边缘语义细分系统的研究
概括
本研究引入了一种音频控制的边缘语义细分系统,以改善视力受损人群的辅助技术. 语音命令动态过视觉数据,增强环境意识,减少认知负载.
科学领域:
- 计算机视觉 计算机视觉
- 辅助技术 辅助技术 辅助技术
- 人与计算机的交互
背景情况:
- 视障人士面临着在环境中导航的挑战.
- 现有的辅助技术往往缺乏动态环境信息过.
- 边缘计算为实时辅助解决方案提供了潜力.
研究的目的:
- 开发一个音频控制的边缘语义细分系统,用于增强辅助技术.
- 为了使用户能够通过语音命令来选择对象类别,以便进行动态视觉过.
- 为了优化显示重要的环境细节,并减少认知负载.
主要方法:
- 一个多式系统,结合了视觉语义细分和音频关键字发现,使用单独的卷积网络.
- 基于用户语音命令的视觉信息的动态过.
- 在不同分辨率下分析细分精度与计算效率.
- 在Nvidia Jetson AGX Orin平台上实现边缘部署.
主要成果:
- 一个音频控制的边缘语义细分系统的可行性.
- 展示了通过语音命令对视觉信息的动态过.
- 提供了对准确性和效率之间的权衡的分析.
- 在边缘硬件上验证了系统性能.
结论:
- 拟议的系统通过音频控制有效地增强了视障人士的辅助技术.
- 边缘部署是可行的,提供实时环境感知.
- 动态过可以减少认知负载,改善用户体验.
更多相关视频
08:25Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
Published on: May 7, 2019
9.5K
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
2.5K
相关概念视频
01:24Frequency-Domain Interpretation of PD Control
Proportional-Derivative (PD) controllers are widely used in fan control systems to improve stability and performance. A fan control system can be effectively represented using a Bode plot to illustrate the impact of a PD controller through its transfer function. The Bode plot visually conveys how PD control modifies the fan's response across various frequencies, providing a frequency domain interpretation of the controller's behavior.
The proportional control gain, combined with the system's...
The proportional control gain, combined with the system's...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...