在眼睛中反映的任务:自我中心的凝视意识:虚拟现实中的视觉任务类型识别
IEEE transactions on visualization and computer graphics
|September 10, 2024
概括
本研究介绍了用于增强现实和虚拟现实 (AR/VR) 耳机的场景无关视觉任务识别. 提出的方法,TRCLP,通过在不同环境中识别用户任务来增强头显智能.
科学领域:
- 人与计算机的交互
- 计算机视觉 计算机视觉
- 虚拟现实 虚拟现实 虚拟现实
背景情况:
- 在AR/VR耳机中的眼睛跟踪能够通过识别用户视觉任务来实现自适应性内容显示.
- 现有的视觉任务识别方法通常是特定于场景的,这限制了它们在博物馆等不同环境中的适用性.
- 需要场景不可知的方法来在各种场景中概括任务识别.
研究的目的:
- 为了在视觉任务识别中更广泛的应用,提出四种场景不可知任务类型.
- 开发和评估一个自我中心的眼神意识方法,用于任务类型的识别.
- 创建一个新的数据集,用于培训和验证无现场的任务识别模型.
主要方法:
- 在15个VR视频中从20名参与者收集了一组新的眼睛和头部运动数据.
- 定义了四种无视场景的任务类型,以促进通用识别.
- 开发并实施了自我中心的目光意识任务类型识别方法 (TRCLP).
主要成果:
- 拟议的TRCLP方法在识别视觉任务类型方面取得了有希望的结果.
- 新的数据集支持在VR中对场景无关的视觉任务识别研究.
- 用三个例子展示了任务识别方法的实际应用.
结论:
- 对智能AR/VR应用程序来说,场景无关的任务类型识别是可行的,也是有益的.
- TRCLP方法及其附带的数据集推进了基于视线的互动领域.
- 调查结果为内容开发人员创造任务意识的智能应用程序提供了宝贵的见解.
相关概念视频
01:24Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
01:19High-Level and Low-Level Awareness
Controlled processes in human consciousness represent high-alert mental states where individuals deliberately focus their attention on achieving specific goals. Controlled processes can be seen in situations like mastering new technology, where a person might become so absorbed that they ignore surrounding distractions. Such processes involve selective attention, requiring one to concentrate on particular elements of experience while disregarding others. These are governed by executive...
01:28The Looking Glass Self
The concept of the looking-glass self describes how an individual's self-concept is shaped by their perception of how others see them. This psychological theory, first introduced by sociologist Charles Horton Cooley in 1902, posits that self-identity emerges in a social context and is influenced by the judgments—real or imagined—of others.Research suggests that individuals frequently overestimate how positively others perceive them. This is particularly evident in physical self-perception,...
01:21Self-Awareness and Its Effects
Self-awareness is a psychological state in which the individual becomes the focal point of their attention. This inward focus transforms the self into an object of contemplation and assessment, influencing how individuals perceive their actions and their alignment with personal and societal standards.Triggers and Contexts for Self-AwarenessSelf-awareness can be activated by external stimuli that make individuals visually or audibly aware of themselves, such as mirrors, cameras, or recordings.