工具和基准不断发展:它们对SBSE实验中的参数调整的影响是什么?
Amid Golmohammadi1, Man Zhang2, Andrea Arcuri1,3
1Kristiania University of Applied Sciences, Kirkegata 24-26, 0153 Oslo, Norway.
概括
在基于搜索的软件工程 (SBSE) 中的工具演变需要重新评估之前的实验. 使用EvoMaster工具复制的研究表明,大多数参数仍然有效,但有些需要调整以获得最佳性能.
科学领域:
- 软件工程 软件工程 软件工程
- 人工智能的人工智能
- 计算智能是一种计算智能.
背景情况:
- 基于搜索的软件工程 (SBSE) 研究依赖于不断发展的工具.
- 工具开发可以影响以前的SBSE研究的有效性和可重复性.
- 参数调整对于调整实验以适应更新的软件工程工具至关重要.
研究的目的:
- 用最新版本的EvoMaster工具重新评估以前的SBSE研究.
- 评估工具演变对实验有效性和可重复性的影响.
- 调查参数调整以优化SBSE工具性能.
主要方法:
- 使用基于搜索的EvoMaster fuzzer复制了之前的5项研究.
- 扩大了复制实验中使用的文物集.
- 测试了729个参数配置,并使用机器学习来分析参数的影响.
主要成果:
- 大多数参数在最新的EvoMaster版本中保持了有效性.
- 两个参数需要调整以获得最佳性能.
- 优化的参数配置显示了比默认设置更高的性能.
结论:
- 定期重新评估SBSE工具及其参数是必不可少的.
- 持续的工具开发需要更新的实验验证.
- 参数调整可以显著提高SBSE工具的性能,如EvoMaster.
相关概念视频
Contaminants and Errors
340
Effective sample preparation is crucial for accurate and reliable laboratory analysis. During this process, two significant sources of error can arise: concentration bias from improper sample splitting and contamination caused by methods used to reduce particle size, such as grinding or homogenization. Identifying and minimizing these potential errors is crucial to ensuring the validity of the analysis.
Another key consideration is determining the appropriate number of samples required to...
Another key consideration is determining the appropriate number of samples required to...
340
Instrument Calibration
672
Instrument calibration is essential for ensuring that instruments produce accurate and consistent results. It is vital in manufacturing, healthcare, testing laboratories, and scientific research. Calibration processes are specific to each instrument and help enhance data accuracy. Each instrument has a unique calibration process tailored to its design and function to improve data accuracy.
Analytical Balance Calibration
An analytical balance measures mass and requires regular calibration to...
Analytical Balance Calibration
An analytical balance measures mass and requires regular calibration to...
672
Parametric Survival Analysis: Weibull and Exponential Methods
1.0K
Parametric survival analysis models survival data by assuming a specific probability distribution for the time until an event occurs. The Weibull and exponential distributions are two of the most commonly used methods in this context, due to their versatility and relatively straightforward application.
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
1.0K
Introduction to Statistical Process Control
589
Statistical Process Control (SPC) is a method used to monitor and control quality within processes, particularly in manufacturing and service delivery, by employing statistical methods. SPC aims to distinguish between natural (common cause) variation and variation due to specific changes or events (special cause), allowing for timely improvements and sustained quality. The control chart, a pivotal tool in SPC, visually displays data over time alongside a central line of upper and lower control...
589
Testing a Claim about Standard Deviation
2.9K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.9K


