$\beta $-DARTS++:为代理强大的差分架构的双级规范化搜索
相关实验视频
Updated: Jan 16, 2026

13:19
Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
9.9K
IEEE transactions on pattern analysis and machine intelligence
|October 1, 2025
概括
贝塔-衰变规范化通过提高稳定性和概括性来增强神经架构搜索 (NAS). 这种方法应用于DARTS (可差异化架构搜索),也可以在各种代理设置中提高稳定性,从而提高性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 神经架构搜索 (NAS) 自动化了神经网络设计,可差异化的NAS (例如DARTS) 提供了效率.
- 现有的可微分NAS方法在稳定性,概括性和对代理配置的稳定性方面面临挑战.
研究的目的:
- 引入Beta-Decay规范化以稳定基于DARTS的NAS并改善搜索架构的泛化.
- 针对不同代理设置中可差异化的NAS方法的稳定性.
- 通过将Beta-Decay与洪水规范化相结合来提议双级规范化,以提高代理稳定性.
主要方法:
- 引入了Beta-Decay规范化,以限制DARTS训练期间的架构参数值和方差.
- 进行了全面的实验,以在各种代理配置 (数据,通道,层,时代) 中对可差异化的NAS方法进行基准测试.
- 将洪水规范化集成到Beta-Decay DARTS的重量优化中,创建双级规范化.
主要成果:
- 贝塔衰变规范化显著稳定了NAS搜索过程,并提高了搜索网络的可转移性.
- 与其他NAS方法相比,Beta-Decay DARTS (β-DARTS) 在大多数代理设置中表现出卓越的性能.
- 双层规范化进一步增强了可差异化的NAS方法的代理稳定性,在实验和理论上都得到了验证.
结论:
- 贝塔衰变是一种有效的规范化技术,用于改善基于DARTS的NAS的稳定性和泛化.
- 拟议的β-DARTS方法对各种代理配置具有强大的稳定性.
- 双层规范化为增强可分化NAS的代理稳定性提供了一个有希望的方向.
相关概念视频
Implicit Differentiation: Problem Solving
26
Curves defined implicitly, where variables cannot be separated algebraically, require specialized techniques for analysis. The conchoid of Nicomedes exemplifies such a case. Its equation links x and y in a way that prevents isolation of one variable, making implicit differentiation essential to determine the slope and behavior at any point on the curve.The implicit form of the conchoid can be expressed as:To differentiate this equation, y is treated as a function of x, and the chain rule is...
26
Differential Leveling
660
Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
660
Implicit Differentiation
16
In classical mechanics, motion is often described through relationships between spatial coordinates and time. A car moving along a straight highway with constant acceleration serves as a simple case where velocity is an explicit function of time. This scenario results in a linear equation, enabling straightforward analysis using basic differentiation techniques.In contrast, a satellite in circular orbit follows a path defined by an implicit function. The position of the satellite is constrained...
16
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.8K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.8K
Design Example: Maintaining Level of an Embankment
408
Constructing a roadway embankment over uneven terrain requires precise leveling to ensure stability and proper drainage. Surveyors use a leveling instrument and staff to calculate ground elevations and determine the required fill material at each point along the embankment alignment.The process begins by positioning a leveling instrument near a benchmark with a known elevation. A backsight reading establishes the instrument height, which serves as a reference for subsequent measurements. A...
408
Multi-input and Multi-variable systems
392
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
392
