没有全球Lipschitz连续性的分散的初级-二元优化
IEEE transactions on neural networks and learning systems
|February 4, 2026
概括
本研究介绍了针对优化问题的自适应式去中心化算法 (ADPPD和ADPD),通过使用本地Lipschitz连续性估计来克服现有方法的局限性. 这些可扩展的算法提供更快的融合,而不需要全球Lipschitz常数.
科学领域:
- 优化理论 优化理论
- 分布式系统 分布式系统
- 机器学习 机器学习
背景情况:
- 现有的分布式优化算法通常需要全局的利普希茨连续性,这是不切实际的估计,可能不会持有.
- 准确的利普希茨常数估计和全球假设的需要限制了当前方法的适用性和性能.
研究的目的:
- 为复合优化问题提出新的去中心化算法,即自适应式去中心化近似初级二元化 (ADPPD) 和自适应式去中心化初级二元化 (ADPD).
- 通过消除对全球利普希茨连续性和过于保守的步骤大小的需求,克服现有方法的局限性.
主要方法:
- 开发了两种新的算法,ADPPD和ADPD,在改进的初级-双元框架内具有自适应式步骤大小.
- 算法利用局部估计的协同强制性和利普希茨模块,避免全球假设.
- 理论分析以确定凸和强烈凸场景的收率.
主要成果:
- 对于凸函数,ADPPD 实现了 $\mathcal {O}(1/k) $ 的 ergodic 收率.
- 当光滑项强烈凸起时,ADPD显示了线性收率.
- 在最小平方和逻辑回归上的数值实验证实了相对于现有方法的更快的趋同.
结论:
- 拟议的自适应式去中心化算法 (ADPPD和ADPD) 对于复合优化问题是有效的.
- 这些算法通过利用本地Lipschitz连续性估计提供了更好的可扩展性和更快的融合.
- 这些方法消除了对全球Lipschitz连续性的需求,提高了实际适用性.
相关概念视频
Global Climate Change
29.0K
Throughout its ~4.5 billion year history, the Earth has experienced periods of warming and cooling. However, the current drastic increase in global temperatures is well outside of the Earth’s cyclic norms, and evidence for human-caused global climate change is compelling. Paleoclimatology, the study of ancient climate conditions, provides ample evidence for human-caused global climate change by comparing recent conditions with those in the past.
29.0K
Introduction to Global Positioning System
541
The Global Positioning System (GPS) revolutionized positioning on Earth, providing precise location data through satellite ranging. The GPS system was developed in 1978 by the U.S. Department of Defense for military use, and it became available for civilian applications in 1983, transforming fields including navigation, fleet management, and time synchronization for telecommunications systems.GPS consists of satellites in medium Earth orbit, about 20,200 kilometers above the surface,...
541
Optimal Foraging
13.9K
How animals obtain and eat their food is called foraging behavior. Foraging can include searching for plants and hunting for prey and depends on the species and environment.
13.9K
Continuing Care
2.0K
Continuing care describes the variety of health, personal, and social services provided over a prolonged period. The need for continuing care is increasing because people are living longer. Many people do not have families or others to care for them. Continuing care is mainly for patients who are disabled, functionally dependent, or suffering from a terminal disease. It is available within institutional settings or in homes. Examples include nursing centers or facilities, assisted living,...
2.0K
Continuity of a Function
248
A function is continuous at a point a if three conditions are met: the function is defined at a, the limit of the function as x approaches a exists, and this limit equals the function’s value. Mathematically, this is written asThis definition ensures the graph of the function does not exhibit any breaks, holes, or jumps at that point. Discontinuities occur when any of these conditions fail. A removable discontinuity exists when the two-sided limit exists but the function is either...
248
Continuity Equation
3.3K
The continuity equation asserts that the mass flow rate must remain constant for a steady flow of an incompressible fluid within a confined system. This principle applies to systems where fluid passes through varying cross-sectional areas, such as nozzles, syringes, and pipes.
The mass flow rate is expressed as:
The mass flow rate is expressed as:
3.3K


