层次自我包:层次自我中心的视频理解与不同的任务视角
IEEE transactions on pattern analysis and machine intelligence
|October 14, 2025
概括
Hier-EgoPack通过在不同时间尺度上进行推理来增强视频中的人类活动理解. 这种统一的框架改善了自主系统.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 在视频中识别人类活动需要整体感知,整合场景理解和时间预测.
- 像EgoPack这样的现有框架统一了各种各样的任务,但缺乏多颗粒度的时间推理.
- 自主系统需要先进的功能来关联概念和利用任务协同效应.
研究的目的:
- 介绍Hier-EgoPack,这是对人类活动理解的EgoPack的一个进步.
- 为了更广泛的任务适用性,实现跨多种时间细分度的推理.
- 开发一个统一的框架,用于视频分析的同时多任务学习.
主要方法:
- 在视频理解中提出了一个用于时间推理的新层次架构.
- 整合了一个针对多细分推理挑战的图形神经网络 (GNN) 层.
- 在多个Ego4D基准上对框架进行了评估,包括剪辑级和框架级任务.
主要成果:
- 证明了Hier-EgoPack在同时解决各种视频理解任务中的有效性.
- 展示了框架在各种时间尺度上处理推理的能力.
- 在Ego4D基准上取得了强的表现,验证了层次化的方法.
结论:
- Hier-EgoPack通过整合多颗粒度时间推理,显著提升了人类活动识别.
- 统一的层次架构为复杂的视频理解任务提供了高效和有效的解决方案.
- 这项工作为具有整体视频感知能力的更复杂的自主系统铺平了道路.
更多相关视频
相关概念视频
01:23Actor-Observer Effect
332
The actor-observer effect, a cognitive bias closely linked to the fundamental attribution error, refers to the tendency for individuals to attribute their behavior to external, situational factors while explaining others’ behavior in terms of internal, dispositional traits. This asymmetry in attribution significantly influences social perception and judgment.Cognitive Mechanisms Behind the EffectTwo primary psychological mechanisms contribute to the actor-observer effect: differences in...
332
01:22Vygotsky's Cognitive Development in Cultural Context
941
Lev Vygotsky, a pioneering Russian psychologist, developed a theory of cognitive development that centers on the influence of social and cultural factors. Unlike Jean Piaget, who emphasized the child's direct interaction with the physical world as key to development, Vygotsky argued that cognitive growth is an interpersonal process that unfolds within a cultural context. For Vygotsky, a child's learning cannot be separated from their social environment, which includes the values,...
941
01:12Observational Learning
832
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
832