无监督的目光表现通过切换特征来学习
IEEE transactions on pattern analysis and machine intelligence
|August 19, 2025
概括
本研究引入了一个无监督的深度学习框架,通过解开与视线相关的信息来改进3D视线估计. 新的交叉编码方法有效地从眼睛和面部图像中提取准确的目光表示.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 当注释数据稀缺时,无监督学习对于深度学习至关重要.
- 现有的无监督的方法难以区分微妙的目光线索与3D目光估计中的无关信息.
研究的目的:
- 开发一个无监督的学习框架,用于3D凝视估计,将与凝视相关的信息与与凝视无关的信息分开.
- 通过有效利用未标记的数据,提高视线估计的准确性.
主要方法:
- 提出一种新的无监督学习框架,寻求图像对之间的共享信息.
- 使用具有特征切换的编码器和解码器用于潜伏表示学习.
- 从眼睛和脸部图像中导出交叉编码器和交叉编码器++模型来表示目光.
主要成果:
- 拟议的框架理论上保证了将信息分解成不同的潜在特征部分.
- 交叉编码器和交叉编码器++在公众视线数据集上的现有方法相比,表现优越.
- 除研究证实了成功提取眼神特征,无论是从数量上还是质量上.
结论:
- 开发的无监督框架有效地解决了在3D视线估计中区分视线相关信息的挑战.
- 交叉编码器模型在无监督的目光表示学习中提供了显著的进步.
- 这项工作为使用未标记数据的更强大,更准确的3D目光估计系统铺平了道路.
相关概念视频
Observational Learning
311
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
311
Association Areas of the Cortex
6.2K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
6.2K
Introduction to Learning
530
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
530
The Representativeness Heuristic
16.2K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
16.2K
Associative Learning
572
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
572


