相关实验视频
Updated: Jun 21, 2025

08:20
In Situ Soil Moisture Sensors in Undisturbed Soils
Published on: November 18, 2022
6.1K
走向智能水传感技术的可靠性:评估经典机器学习模型用于异常检测
Mimoun Lamrini1,2, Bilal Ben Mahria3, Mohamed Yassin Chkouri2
1Department of Engineering Sciences and Technology (INDI), Vrije Universiteit Brussel (VUB), 1050 Brussels, Belgium.
Sensors (Basel, Switzerland)
|July 13, 2024
概括
智能水传感依赖于准确的数据;这项研究发现,支持矢量机 (SVM) 能够有效地检测电导率 (EC),溶解氧 (DO),温度 (Temp) 和pH传感器数据中的异常值,从而改善水管理分析.
科学领域:
- 环境科学 环境科学
- 数据科学数据科学数据科学
- 传感器技术 传感器技术
背景情况:
- 智能水传感对于有效的水资源管理至关重要.
- 传感器数据的准确性受到异常值的挑战,影响分析.
- 异常值检测对于可靠的智能水感应至关重要.
研究的目的:
- 评估机器学习模型,用于智能水传感数据中的异常值检测.
- 为了评估传感器电导率 (EC),溶解氧 (DO),温度 (Temp) 和pH的性能.
- 提高水质监测的可靠性.
主要方法:
- 实施了四种机器学习模型:支持向量机器 (SVM),人工神经网络 (ANN),决策树 (DT) 和隔离森林 (iForest).
- 使用来自布鲁塞尔实时智能水感应系统的数据集.
- 应用异常值检测作为数据可视化的预处理步骤.
主要成果:
- 支持矢量机 (SVM) 在所有测试参数中表现出卓越的性能.
- SVM获得了高的F1分数:pH为98.38%,温度为96.98%,DO为97.88%,EC为98.11%.
- 人工神经网络 (ANN) 也取得了显著的成果,提供了一个可行的替代方案.
结论:
- 在智能水传感数据中,SVM对于异常值检测非常有效.
- 精确的异常值去除可以提高水质监测的可靠性.
- 机器学习模型为改进智能水传感系统提供了强大的解决方案.
相关概念视频
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Detection of Gross Error: The Q Test
6.0K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.0K
What Are Outliers?
3.8K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.8K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Random Error
865
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
865
Survival Tree
79
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
79

