自我身份映射自我身份映射
Xiuding Cai1, Yaoyao Zhu2, Linjie Fu3
1Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu, 610213, China; University of Chinese Academic Sciences, Beijing, 101408, China.
概括
自我身份映射 (SIM) 是一种新的规范化技术,通过从输出重建输入来增强深度学习模型,减少信息丢失. 这种plug-and-play方法, ρSIM,改善了跨多种任务的概括性,并提高了现有的规范化效率.
科学领域:
- 深度学习 (Deep Learning) 是一种深度学习.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 深度学习中的传统规范化方法通常依赖于启发式,限制了它们的有效性和可靠性.
- 在训练深度神经网络方面,过度装配和糟糕的概括是重大挑战.
研究的目的:
- 引入自我身份映射 (SIM),这是一个数据内在的规范化框架,旨在增强代表性学习.
- 开发一个计算效率高的版本,rSIM,并证明其模型不可知和任务不可知适用性.
主要方法:
- SIM使用反向映射机制,从其转换的输出重建输入,以减少信息丢失.
- ρSIM包含了补丁级特征采样和基于投影的重建,以提高计算效率.
- 拟议的调节器被设计成一个plug-and-play模块,用于无集成.
主要成果:
- ρSIM在图像分类,短拍即时学习和域泛化任务中表现出一致的性能改进.
- 该方法有效地保存语义信息,并提高了像语义细分和图像翻译等密集到密集的任务的性能.
- 当与现有的规范化技术相结合时, ρSIM 显示了正交效益,进一步提高了它们的有效性.
结论:
- 自我身份映射 (SIM) 提供了一种简单而有效的方法来规范深度学习.
- 计算效率高的 ρSIM 变体广泛适用于各种网络架构和任务,包括非视觉领域.
- ρSIM增强了表示学习,改善了概括,并补充了现有的规范化策略.
相关概念视频
01:25Personal Identity
311
Personal identity is the deeply felt sense of self that individuals cultivate over time, intricately woven from intrinsic qualities they consider essential to their existence—qualities such as morality, intelligence, and friendliness. These attributes serve as vital internal benchmarks, guiding individuals in evaluating whether their actions resonate with their true selves.When personal identity takes center stage in one's life, individuals often emphasize their distinctiveness,...
311
01:20Understanding Self-Concept
210
The self-concept encompasses individuals' beliefs about themselves, structured through cognitive frameworks known as self-schemas. These schemas function as mental representations of specific traits or behaviors, influencing how self-relevant information is perceived, processed, and remembered. For example, individuals who are schematic for body weight are more likely to interpret routine experiences—such as dining out or shopping—through the lens of that trait. Conversely, those...
210
02:16Self-Schemas
35.4K
In general, a schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
35.4K
01:21Role-Based Identity
175
Role-based identities are central to understanding how individuals navigate social environments by adopting distinct self-conceptions aligned with various societal roles. These identities are not fixed traits but are constructed through personal actions and the social feedback individuals receive in context-specific interactions. Each social role, such as student, teacher, or friend, carries a set of expectations and norms that influence how people think, feel, and behave within that...
175
02:57The Sense of Self: Reflected Self-Appraisal and Social Comparison
55.4K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
55.4K
01:29Social Identity
243
Social identity constitutes a significant aspect of an individual’s self-concept, shaped by membership in various social groups, including gender, nationality, ethnicity, sexual orientation, and political affiliation. Individuals associate specific traits with particular social groups, leading to internalization of these traits. For example, musicians are often perceived as creative, while women are frequently associated with nurturing tendencies. Once individuals identify with a...
243