相关实验视频

Updated: Jan 10, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

通过手势控制重新想象感官替代:讲点2

Ligao Ruan¹, Giles Hamilton-Fletcher^2,3, Mahya Beheshti^1,2

¹Department of Mechanical and Aerospace Engineering, NYU Tandon School of Engineering, Brooklyn, NY, USA.

Disability and rehabilitation. Assistive technology

|November 20, 2025

概括

这种新的手势控制感官替代装置 (SSD) 帮助盲人或视力低下者选择和理解环境信息,减少认知过载.

科学领域:

人与计算机的交互
辅助技术辅助技术辅助技术
计算机视觉计算机视觉

背景情况:

感官替代装置 (SSD) 转换环境数据,用于盲人或视力低下者 (pBLV).
现有的SSD经常提供不加区分的信息,可能导致认知过载并限制用户控制.
对于pBLV来说,需要更直观和选择性的辅助技术.

研究的目的:

引入和技术验证Point-To-Tell 2,一种针对pBLV的选择性手势控制系统.
提高信息相关性,减少辅助设备的认知过载.
通过手势控制和自身感知来连接物体的空间位置和身份.

主要方法:

将单眼相机与人工智能管道集成,用于深度估计,手姿势跟踪和物体检测/细分.
开发一种能够识别3D指向方向并宣布物体名称和距离的系统.
使用基于指针的手势控制来进行私密和高效的信息选择.

主要成果:

高手姿势跟踪精度在受控的室内环境中得到证明.
实现了可靠的射线投射和对象选择,即使在远距离对象识别方面存在挑战.
稳定的距离估计在近距离,并指出有系统的偏差.

结论:

在技术上,Point-To-Tell 2系统验证了一种改进的辅助技术方法.
专注于系统反和利用并发的手亲感可以减少认知负载并增强空间理解.
未来的工作包括对各种场景进行用户测试和功能扩展.

关键词:

辅助技术是指辅助技术的使用.人与计算机的互动.对象检测检测对象检测对象检测感官替换是一种感官替代.视力受损视力受损视力受损

更多相关视频

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

Published on: January 7, 2019

相关概念视频

Sensory Modalities

Sensory Modalities

Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...

Tactile and Chemical Senses

Tactile and Chemical Senses

Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.