通过等级融合架构搜索以缓解不一致性来增强多模式学习
概括
这项研究介绍了层次融合多模式神经架构搜索 (HF-MNAS) 以优化多模式学习. HF-MNAS有效地发现融合架构,同时减轻模式标签不一致,降低计算成本.
科学领域:
- 人工智能
- 机器学习
- 计算机视觉
背景情况:
- 多模式学习需要有效的功能融合策略,通常需要大量的计算资源和专业知识.
- 现有的方法缺乏在融合架构设计过程中解决模式和标签之间的不一致的机制.
研究的目的:
- 开发一种高效的层次融合多模式神经架构搜索 (HF-MNAS) 方法.
- 减轻多式联动功能中的模式标签不一致.
- 降低与设计融合架构相关的计算成本.
主要方法:
- 引入了双层搜索空间:宏观层面用于特征提取和连接,微观层面用于细胞优化.
- 开发了一个缓解不一致的模块,以尽量减少模式和标签之间的差异.
- 实施基于重要性的节点选择机制以实现最佳细胞形成.
主要成果:
- 在多模式分类任务中,HF-MNAS在准确性,搜索时间和推断速度之间取得了竞争平衡.
- 与最先进的方法相比,显著降低了计算成本.
- 验证了模式标签不一致会对模型性能产生负面影响,并且拟议的模块有效地减轻了这一问题.
结论:
- HF-MNAS提供了一种高效和有效的多式联接特征架构搜索方法.
- 解决模式标签不一致的问题对于提高多模式学习效率至关重要.
- 拟议的方法为资源有限的多式联络学习应用提供了实用解决方案.
相关概念视频
Associative Learning
572
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
572
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Cognitive Learning
517
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
517
Observational Learning
311
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
311
Collisions in Multiple Dimensions: Problem Solving
4.3K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.3K
Purposive Learning
206
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
206
