Appropriate noise addition to metaheuristic algorithms can enhance their performance
Kwok Pui Choi1, Enzio Hai Hong Kam2, Xin T Tong3
1Department of Statistics and Data Science, National University of Singapore, Singapore, 117546, Singapore.
Scientific Reports
|March 31, 2023
Summary
This study introduces a heterogeneous Perturbation-Projection (HPP) strategy to improve nature-inspired swarm algorithms. HPP enhances exploration, ensuring algorithms converge to global optima for complex optimization problems.
Area of Science:
- Computational intelligence
- Optimization algorithms
- Nature-inspired computing
Background:
- Swarm-based algorithms are powerful for complex optimization but suffer from premature convergence.
- Ensuring convergence to a global optimum remains a challenge for these general-purpose methods.
Purpose of the Study:
- To propose a novel strategy, heterogeneous Perturbation-Projection (HPP), to enhance the exploration capability of swarm algorithms.
- To guarantee sufficient convergence conditions and ensure algorithms converge to a global optimum.
Main Methods:
- The HPP strategy involves applying stochastic perturbation to half of the swarm agents.
- All agents are then projected onto the set of feasible solutions.
- The HPP strategy was tested with Particle Swarm Optimization (PSO), Bat Algorithm (BAT), and Ant Colony Optimization (ACO).
Main Results:
- Algorithms enhanced with HPP demonstrated significantly improved performance compared to their original versions.
- The HPP-enhanced algorithms outperformed the originals in 60-80% of experimental runs.
- Significant performance margins were observed in extensive numerical experiments.
Conclusions:
- The heterogeneous Perturbation-Projection (HPP) strategy is a general, simple, and effective method for improving swarm-based optimization algorithms.
- HPP guarantees convergence to a global optimum and overcomes common drawbacks like premature convergence.
- This approach offers a robust enhancement for various nature-inspired swarm intelligence algorithms.
More Related Videos
Related Concept Videos
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
88
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
88
Heuristics
119
Heuristics are problem-solving strategies that use mental shortcuts to simplify decision-making. Unlike algorithms, which must be followed precisely to achieve a correct result, heuristics offer a general problem-solving framework. They save time and energy but can sometimes lead to less rational decisions.
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
119
Effects of feedback
636
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
636
Randomized Experiments
7.1K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.1K
Decision Making: P-value Method
5.6K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.6K
Weighted Mean
5.2K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
5.2K


