相关实验视频
Updated: Jan 29, 2026

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.5K
视觉到触觉交叉模式生成使用具有多尺度歧视器和混合损失的类条件GAN
Nikolay Neshov1, Krasimir Tonchev1, Agata Manolova1
1Faculty of Telecommunications, Technical University of Sofia, 8 Kliment Ohridski Blvd., 1000 Sofia, Bulgaria.
Sensors (Basel, Switzerland)
|January 28, 2026
概括
本研究介绍了一个类条件的生成对抗网络 (cGAN),用于将视觉纹理信息转换为触觉谱图,以获得现实的触觉反. 这种新的方法显著提高了虚拟现实应用的跨模式翻译精度.
科学领域:
- 计算机视觉 计算机视觉
- 触觉学是指触觉学是指触觉学.
- 机器学习 机器学习
背景情况:
- 视觉纹理感知对于触觉染和虚拟现实至关重要.
- 将视觉纹理数据翻译为触觉反带来了重大挑战.
研究的目的:
- 开发一个类条件的生成对抗网络 (cGAN) 来实现从纹理图像到振动感光谱的跨模转换.
- 在翻译过程中增强纹理类语义,以提高触觉现实性.
主要方法:
- 使用了一个适应pix2pix的生成器,具有条件批量规范化 (CBN) 和一个DenseNet-201标签预测器.
- 采用多尺度歧视器架构 (源自pix2pixHD) 实现最佳的感知相似性.
- 实现了混合损失函数,将对抗性,L1和特征匹配损失结合起来.
主要成果:
- 通过学习感知图像补丁相似性 (LPIPS) 和弗雷切开始距离 (FID) 度量来实现卓越的感知相似性.
- 与像pix2pix和pix2pixHD这样的现有模型相比,表现出更好的性能.
- GradCAM可视化证实了类调节的有效性.
结论:
- 拟议的cGAN模型有效地将视觉纹理信息转化为振动触觉谱图.
- 生成的光谱图可以转换为触觉信号,从而实现先进的触觉反和虚拟材料模拟.
- 这项工作推进了用于沉浸式虚拟体验的跨模式翻译领域.
相关概念视频
Stereotypes, Prejudice, and Discrimination
95.4K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
95.4K
Hybrid Zones
21.8K
Hybrid zones are narrow regions where two closely related species interact, mate, and produce hybrids. Relative to either parent species, hybrids may possess distinct phenotypic or genetic differences that impact their survival and reproductive success. The genetic variances introduced by hybridization influence species diversity and speciation processes within the hybrid zone.
21.8K
Monohybrid Crosses
239.4K
Overview
239.4K
Crossing Over
171.7K
Unlike mitosis, meiosis aims for genetic diversity in its creation of haploid gametes. Dividing germ cells first begin this process in prophase I, where each chromosome—replicated in S phase—is now composed of two sister chromatids (identical copies) joined centrally.
The homologous pairs of sister chromosomes—one from the maternal and one from the paternal genome—then begin to align alongside each other lengthwise, matching corresponding DNA positions in a process...
The homologous pairs of sister chromosomes—one from the maternal and one from the paternal genome—then begin to align alongside each other lengthwise, matching corresponding DNA positions in a process...
171.7K
Tactile and Chemical Senses
791
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
791
Sensory Modalities
3.9K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.9K

