TexSenseGAN:一个用户引导的系统,用于优化与纹理相关的振动动感反,使用生成对抗网络
IEEE transactions on haptics
|March 4, 2025
概括
这项研究引入了一种新的人在循环中振动生成模型. 它使用差分子空间搜索 (DSS) 和生成对抗网络 (GAN) 来创建虚拟交互的现实触觉振动.
科学领域:
- 触觉和人机交互的人机交互
- 虚拟现实和增强现实
- 机器人和触觉传感技术
背景情况:
- 现实的触觉反对于游戏和VR中的沉浸式虚拟体验至关重要.
- 由于参数空间大,目前的方法难以为复杂的材料纹理产生多样化的振动.
- 用户偏好集成是对直观控制振动生成的关键.
研究的目的:
- 开发一个人类在循环中的系统,以产生任意的触觉振动.
- 为了实现对高维振动参数空间的直观控制.
- 创建符合目标材料纹理的真实可辨别的振动样本.
主要方法:
- 提出了一个新的振动生成模型,集成用户偏好.
- 利用差分子空间搜索 (DSS) 来直观地控制潜在空间.
- 使用生成对抗网络 (GAN) 合成振动样本.
- 在触觉振动数据的开放数据集上训练模型.
主要成果:
- 该系统成功生成了与目标特征相匹配的可分辨的振动样本.
- 用户实验证实了模型能够复制所需的触觉感觉的能力.
- 在用户区分真实样本和生成样本的能力之间发现了相关性.
结论:
- 拟议的DSS-GAN模型提供了一种有效的方法来产生现实的触觉振动.
- 人在循环控制提高了振动生成系统的可用性和可控性.
- 这项研究推动了创造更具身临其境和可信度的虚拟触觉体验.
相关概念视频
Somatosensation
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
Design Example: Resistive Touchscreen
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
Tactile and Chemical Senses
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex. This...


