一个全面的实验比较联合和集中式学习之间的学习
Swier Garst1, Julian Dekker1, Marcel Reinders1
1Intelligent Systems, Delft University of Technology, van Mourik Broekmanweg 6, Delft, Zuid-Holland 2628 XE, The Netherlands.
Database : the journal of biological databases and curation
|March 21, 2025
概括
联合学习为培训分类器提供了与集中学习相似的性能,而无需共享敏感数据. 这种机器学习方法能够稳定地处理数据不平衡和复杂模型,为保护隐私的研究提供了前景.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 计算科学 计算科学
背景情况:
- 联合学习可以在没有集中敏感数据的情况下实现协作模式培训,这对于医疗研究等面临隐私和法律障碍的领域至关重要.
- 联邦和集中式学习之间的现有比较在很大程度上是理论性的,缺乏对其性能和学习行为的广泛实验验证.
研究的目的:
- 在联合学习和集中学习策略之间进行全面的实验比较.
- 评估各种分类器在各种数据集和数据分布中的性能和学习行为.
- 探索样本和类分布不平衡对联合学习有效性的影响.
主要方法:
- 使用各种数据集对多个分类器进行实验性评估.
- 在不同样本和类分布下对客户的绩效进行分析.
- 评估联合学习对数据不平衡,维度和模型复杂性的强度.
主要成果:
- 联合学习在广泛的环境中表现出与集中学习相美的性能.
- 联合学习有效地处理各种数据不平衡,包括倾斜的分布和多类问题.
- 联合学习显示出对高数据维度和复杂模型的稳定性,尽管对基于位置的批量效应敏感.
结论:
- 联合学习为数据共享提供了一个有前途的替代方案,提供与集中式方法相似的性能,同时保持数据隐私.
- 实验结果支持在数据集中化具有挑战性或被禁止的场景中应用联合学习.
- 联合学习对数据异质性和复杂性的弹性使其适合使用分布式数据集的现实应用.
相关概念视频
01:27Associative Learning
270
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
270
01:12Observational Learning
111
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
111
01:21Cognitive Learning
122
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
122
01:18Introduction to Learning
318
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
318
01:13Randomized Experiments
6.6K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.6K
01:22Purposive Learning
95
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
95