数据驱动的知识融合为深度多实例学习提供了深度多实例学习
IEEE transactions on neural networks and learning systems
|August 9, 2024
概括
这项研究引入了一种新的数据驱动的知识融合,用于深度多实例学习 (MIL) 算法. DKMIL方法通过从关键数据样本中提取知识来增强模型学习,提高复杂数据集的性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机科学 计算机科学
背景情况:
- 多实例学习 (MIL) 对复杂的数据结构至关重要.
- 当前的深度MIL方法往往将知识困在算法中,限制了模型开发.
- 现有的MIL方法可能会导致大量的知识损失,并阻碍创建更强大的模型.
研究的目的:
- 为深度MIL (DKMIL) 算法提出一个新的数据驱动的知识融合.
- 开发数据和模型之间的新接口,以提高学习能力和可扩展性.
- 通过从关键数据样本中提取和融合知识来提高深度MIL的有效性.
主要方法:
- 引入了一个数据驱动的知识融合 (DKF) 模块来分析关键样本决策.
- 设计了一个知识融合模块,从模型学习的关键样本中提取有价值的信息.
- 提出了两级注意力 (TLA) 模块,以学习浅层和深层特征,以进行有效的分类.
主要成果:
- DKF模块提供了数据和模型之间的新接口,提供了强大的可扩展性.
- 从现有算法中获得的先前知识可以被整合起来,以提高模型的学习能力.
- 该TLA模块允许逐步学习浅层和深层特征,以改进分类.
结论:
- 提出的DKMIL算法通过融合数据驱动的知识,为深度MIL提供了一种新的方法.
- DKF和TLA模块展示了拟议架构的可扩展性和效率.
- 在五个类别的62个数据集上的实验验验证了DKMIL方法的有效性.
相关概念视频
Multi-input and Multi-variable systems
105
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
105
Associative Learning
324
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
324
Collisions in Multiple Dimensions: Problem Solving
3.7K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
3.7K
Collisions in Multiple Dimensions: Introduction
4.9K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
4.9K
Observational Learning
158
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
158
Cognitive Learning
235
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
235


