寻找宝藏:体现的对比学习增强粗细对象寻找与探险家和歧视者合作合作
IEEE transactions on neural networks and learning systems
|November 20, 2025
概括
本研究介绍了用于3D对象导航的嵌入式对比学习 (ECL),改善3D场景理解和对象定位. 这种新的方法提高了复杂环境中的代理性能.
科学领域:
- 机器人和人工智能 机器人和人工智能
- 计算机视觉 计算机视觉
- 具体的人工智能
背景情况:
- 目前的对象导航 (ObjectNav) 代理依赖于有限的二维地图或容易被屏蔽的视觉数据,阻碍了3D场景几何感知.
- 现有的ObjectNav方法往往将探索和利用分开,导致对象本地化不佳和探索策略效率低下.
- 在3D环境中体现的感知仍然是自主代理人的挑战.
研究的目的:
- 开发一种嵌入式对比学习 (ECL) 方法,改进3D场景布局和对象导航的语义暗示编码.
- 提出一个粗细的ObjectNav政策,通过合作代理来加强勘探和开发.
- 在复杂,看不见的3D环境中提升体内代理人的能力.
主要方法:
- 嵌入式对比学习 (ECL) 结合几何一致性 (GC) 和行为意识 (BA) 进行3D场景理解.
- 通过从多视觉输入中预测导航操作来建模的行为意识 (BA).
- 通过无监督对比学习,通过将视觉刺激与3D语义形状对齐来实现几何一致性 (GC).
- 一个粗细的ObjectNav政策,利用一个探索者-歧视者合作框架,灵感来自人类的寻宝.
主要成果:
- 拟议的ECL方法在对象检测 (ObjDet) 和实例细分 (InstSeg) 任务上表现出强的性能.
- 使用ECL增强的ObjectNav策略在Matterport3D (MP3D),Gibson和HM3D等基准数据集上显著优于最先进的 (SOTA) 方法.
- 合作的探索者和区分器代理有效地提高了对象定位和导航效率.
结论:
- 开发的体现式对比学习方法增强了代理人感知和编码3D场景几何和语义的能力.
- 与合作代理的新型粗细ObjectNav策略代表了体内AI在导航任务中的重大进步.
- 这项研究提供了一个强大的框架,用于在复杂的现实场景中改善体现剂的性能.
相关概念视频
01:22Purposive Learning
426
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
426
01:12Observational Learning
802
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
802
01:24Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
01:27Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
01:21Cognitive Learning
981
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
981
01:14Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K