通过路径平面感知优化损失景观的单域泛化
IEEE transactions on neural networks and learning systems
|October 24, 2025
概括
单域泛化 (SDG) 从一个源域学习. 路径平面感知优化 (PFO) 在神经网络中找到平面最小值,改善了无需合成数据的跨域概括.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 传统的域泛化 (DG) 需要多个源域.
- 单一领域的GD (SDG) 是更实用的,但具有挑战性.
- 现有的SDG方法具有计算开销和有限的有效性.
研究的目的:
- 为单域泛化提出一个新的优化框架.
- 解决SDG中当前数据增强和风格转移技术的局限性.
- 为了提高模型的稳定性和跨领域的概括能力.
主要方法:
- 路径平面感知优化 (PFO) 框架.
- 在深度神经网络优化环境中识别和利用平面最小值.
- 代优化用于构建参数空间中的模型集的路径.
- 通过使用由分类决策模组确定的点从战略互连的模型实例开始优化路径.
主要成果:
- 在跨域概括方面,PFO实现了显著的性能改进.
- 该方法在损失格局中隐含地对准了源域和目标域之间的分布.
- 在基准数据集上的实证评估验证了拟议方法的有效性.
结论:
- 路径平面感知优化为单域泛化提供了一个计算效率高和有效的解决方案.
- 该方法通过在优化环境中利用平面最小值来增强跨领域的概括性.
- 在有限域数据的场景中,PFO为提高模型稳定性提供了一个有希望的方向.
相关概念视频
Survival Tree
383
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
383
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
Reducing Line Loss
355
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
355
Optimization Problems
8
Optimization problems often involve identifying maximum or minimum values under specific constraints. A well-known example is determining the longest horizontal pipe that can be moved around a right-angled corner, where a 3-meter-wide hallway meets a 2-meter-wide hallway. This scenario, common in architectural design and industrial transport, can be understood conceptually through geometric and trigonometric reasoning.To visualize the problem, consider the pipe as a straight line that touches...
8
Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
Improving Translational Accuracy
3.5K
3.5K
