相关实验视频
FedDyH:一个多方策略与GA优化框架,用于动态异质联合学习.
Xuhua Zhao1, Yongming Zheng2, Jiaxiang Wan3
1School of Electronic Information, Zhejiang Guangsha Vocational and Technical University of Construction, Dongyang 322103, China.
Biomimetics (Basel, Switzerland)
|March 26, 2025
概括
联合学习 (FL) 面临着动态数据异质性的挑战. 该 FedDyH 框架使用生物系统灵感,跨客户端蒸,自适应规范化和遗传算法来提高在各种环境中的模型稳定性和准确性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算生物学 计算生物学
背景情况:
- 联合学习 (FL) 允许保护隐私的分布式学习,特别是用于跨机构的医学图像分析.
- 现实世界的数据显示出动态异质性 (例如,疾病进展,成像设备变化),导致FL模型的灾难性遗忘和性能恶化.
- 现有的FL方法不足以解决动态异质性问题,限制了它们在复杂,不断变化的医疗数据集中的有效性.
研究的目的:
- 提出FedDyH框架,这是一个创新的解决方案,旨在解决联合学习中的动态数据异质性挑战.
- 通过从生物适应性调节中汲取灵感,在动态,异质的环境中增强联合学习模型的稳定性和准确性.
主要方法:
- FedDyH框架采用跨客户端知识蒸来模拟细胞间信息传输,保留本地特征并减轻知识遗忘.
- 一个动态调节术语自适应地调整其强度,模仿调节性T细胞以平衡全球趋同与局部特异性.
- 一个基因算法 (GA) 集成用于适应性超参数优化,模拟生物进化以提高模型适应性和性能.
主要成果:
- 与SOTA基线FedDecorr相比,FedDyH框架在基准数据集上显示了显著的准确性改善:MNIST (+2.59%),时尚-MNIST (+0.55%) 和CIFAR-10 (+5.79%).
- 实验结果验证了框架在处理动态环境中的数据异质性的有效性.
- 该研究强调了在联合学习中使用GA等优化算法进行超参数调整的新性.
结论:
- FedDyH框架为动态,异质环境中的联合学习提供了强大且适应性的解决方案,这对于医疗图像分析至关重要.
- 这种以生物学为灵感的方法通过有效管理数据变异来提高模型稳定性和预测准确性.
- 这项工作通过引入用于处理动态异质性和优化模型性能的新方法来推进联合学习.
相关概念视频
Observational Learning
111
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
111
Introduction to Learning
315
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
315
Associative Learning
270
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
270
Cognitive Learning
114
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
114
Improving Translational Accuracy
8.5K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
8.5K
Multi-input and Multi-variable systems
93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
93