相关实验视频
FBCA:灵活的围攻和征服算法用于多层感知子优化问题
Shuxin Guo1,2, Chenxu Guo1,2, Jianhua Jiang1,2
1Center for Artificial Intelligence, Jilin University of Finance and Economics, Changchun 130117, China.
Biomimetics (Basel, Switzerland)
|November 26, 2025
概括
灵活的围攻和征服算法 (FBCA) 通过提高搜索灵活性和趋同来增强多层感知器 (MLP) 训练. 在复杂的优化任务中,FBCA的性能优于现有方法,证明了它对深度学习模型的潜力.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 优化算法 优化算法
背景情况:
- 多层感知子 (MLP) 是深度学习模型的基础,如CNN,RNN和变压器.
- MLP培训受到非凸优化景观的挑战,其中包括点和局部最小值,导致梯度消失和过早收.
- 现有的启发式算法,如GA,GWO和DE以及围攻和征服算法 (BCA),在搜索灵活性,检测,适应和融合速度方面存在局限性.
研究的目的:
- 提出一个灵活的围攻和征服算法 (FBCA),以克服在训练MLP中的传统优化算法的局限性.
- 为复杂的深度学习任务增强优化算法的搜索灵活性和融合能力.
- 为了证明FBCA在基准函数测试和MLP优化问题中的卓越性能.
主要方法:
- 引入了三种新的机制:正弦导向的软非对称高斯扰动,用于增强本地探索.
- 实现了指数调制的螺旋扰动,以实现快速的全球收适应.
- 使用非线性认知系数驱动的速度更新,以实现平衡的勘探-开发和改进的融合.
主要成果:
- 在IEEE CEC 2017对12个最先进的算法进行的基准函数测试中,FBCA获得了第一名.
- 在100维问题上,FBCA比BCA有62%的胜率.
- 在6个MLP优化问题中,FBCA取得了卓越的性能,显示出出色的对应精度和稳定性.
结论:
- 对于复杂的非线性优化问题,FBCA显著提高了搜索灵活性和融合能力.
- 拟议的算法表现出卓越的全球优化能力,特别是在训练多层感知子时.
- FBCA显示出强大的应用价值和优化神经网络和深度学习模型的潜力.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
267
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
267
Collisions in Multiple Dimensions: Problem Solving
5.2K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
5.2K
Multi-input and Multi-variable systems
376
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
376
Ampere-Maxwell's Law: Problem-Solving
1.1K
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
1.1K
Statically Indeterminate Problem Solving
671
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
671
Mathematical Modeling: Problem Solving
231
Mathematical modeling transforms real-world scenarios into mathematical expressions, allowing for structured problem-solving and analysis. This process involves defining the situation, assigning variables to measurable quantities, selecting an appropriate model, and solving the resulting equation. Such models are invaluable in finance, providing precise methods to evaluate investments, loans, and repayment structures.A widely used example is the calculation of fixed monthly payments on a loan,...
231