图像2大脑:盲人立体图像质量排名的交叉模式模型
Lili Shen1, Xintong Li1, Zhaoqing Pan1
1School of Electrical and Information Engineering, Tianjin University, Tianjin, People's Republic of China.
Journal of neural engineering
|August 22, 2023
概括
这项研究引入了一个图像到大脑模型,通过使用电脑电图 (EEG) 信号复制人类感知来评估立体图像质量. 这种新的方法达到95.95%的准确性,优于传统方法.
科学领域:
- 计算机视觉 计算机视觉
- 神经科学是一个神经科学.
- 信号处理 信号处理
背景情况:
- 人类对立体图像质量的感知是复杂的,涉及大脑视觉皮层.
- 传统的立体图像质量评估方法主要集中在图像特征上,忽视了人类感知机制.
- 开发基于机器的方法,从电脑电图 (EEG) 信号中复制人类的感知,提供了更准确的方法.
研究的目的:
- 提出一个新的图像到大脑 (I2B) 交叉模式模型,用于准确的立体图像质量评估.
- 开发一个系统,以EEG信号模拟人类视觉感知机制.
- 通过将图像特征转换为大脑表示,使图像感知质量的预测成为可能.
主要方法:
- 一个时空EEG编码器 (STEE) 被开发来学习EEG表示.
- 使用了一个I2B深度卷积生成对抗网络 (I2B-DCGAN),结合了一个语义引导图像编码器.
- 该模型为立体图像生成相应的EEG特征,然后对这些图像进行分类以预测感知质量.
主要成果:
- 拟议的I2B交叉模式模型在模拟人类大脑视觉感知方面表现出卓越的性能.
- 该方法在脑视觉多模态立体图像质量排名数据库上实现了95.95%的平均准确性.
- 实验结果表明,该模型的性能优于现有的立体图像质量评估方法.
结论:
- 开发的方法有效地将学习的立体图像特征转换为大脑表示,而不需要在测试期间使用EEG信号.
- 拟议的模型在新数据集中表现出良好的概括能力.
- 这项研究突出了立体图像质量评估中的实际应用潜力.
更多相关视频
06:19Comparison of Three Clinical Stereoscopic Methods for Measuring Binocular Visual Function During Amblyopic Treatment in Unilateral Amblyopia
Published on: September 27, 2024
257
07:45Assessing Binocular Central Visual Field and Binocular Eye Movements in a Dichoptic Viewing Condition
Published on: July 21, 2020
4.5K
相关概念视频
Depth Perception and Spatial Vision
718
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
718
Perceptual Constancy
440
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
440
