STB:对于入侵检测系统不平衡数据集的树增强模型的合成少数超标采样技术
Li-Hua Li1, Ramli Ahmad1, Radius Tanone1
1Information Management, Chaoyang University of Technology, Taichung, Wufeng District, Taiwan.
PeerJ. Computer science
|December 11, 2023
概括
本研究介绍了SMOTE树增强 (STB),以解决入侵检测系统 (IDS) 中不平衡的数据集. 该方法提高了对网络攻击的预测准确性,达到99%的准确性和F1分数.
科学领域:
- 计算机科学 计算机科学
- 网络安全 网络安全
- 机器学习 机器学习
背景情况:
- 侵入检测系统 (IDS) 由于攻击模式,经常面临不平衡的数据集.
- 不平衡的数据阻碍了对各种网络威胁的准确预测.
- 现有的方法在IDS的有效数据平衡方面扎.
研究的目的:
- 提出一种新的方法,即SMOTE树增强 (STB),用于从不平衡的IDS数据集生成合成数据.
- 评估STB在提高用于入侵检测机器学习算法的准确性方面的有效性.
- 评估拟议方法的计算效率.
主要方法:
- 实施了合成少数群体过量采样技术 (SMOTE) 来生成合成表格数据.
- 应用了三种基于增强的机器学习算法:LightGBM,XGBoost和CatBoost.
- 在多个IDS数据集上使用准确度和F1得分来评估模型性能.
主要成果:
- SMOTE显著提高了LightGBM和XGBoost算法的准确性.
- 该STB方法实现了99%的平均准确性和F1得分,超过了之前的研究.
- 轻GBM展示了最快的计算时间 (2.29秒),其次是XGBoost (11.58秒) 和CatBoost (52.9秒).
结论:
- SMOTE树增强是一种有效的技术,用于处理IDS中的不平衡数据集.
- 拟议的方法提高了入侵检测的预测准确性和效率.
- 通过更快,更准确的威胁识别,STB为提高网络安全提供了一个有前途的解决方案.
相关概念视频
Survival Tree
87
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
87
Cluster Sampling Method
11.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.9K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Bootstrapping
608
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
608
Systematic Sampling Method
10.4K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
Systematic sampling is one of the simplest methods...
Systematic sampling is one of the simplest methods...
10.4K
Stratified Sampling Method
12.0K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a stratified sample, divide the population into groups called strata and then take a...
To choose a stratified sample, divide the population into groups called strata and then take a...
12.0K


