在强大的回归中对异常值的比例的引导式估计
1School of Mathematics, Southeast University, Nanjing, China.
概括
本研究引入了一种用于强大的回归的新引导方法,准确估计内向和外向比例,而不需要置信度. 该方法增强了异常值的检测,并提供了对数据分布的图形洞察.
科学领域:
- 统计 统计 统计 统计
- 机器学习 机器学习
背景情况:
- 强大的回归模型对于处理异常值的数据至关重要.
- 现有的异常值检测方法通常依赖于特定的分布假设或预定义的置信水平,限制了它们的适用性.
- 准确估计内向和外向比例对于可靠的模型配件至关重要.
研究的目的:
- 在强大的回归中开发一种非参数引导方法来估计内向和外向比例.
- 提供一种针对分布假设的可靠方法,不需要预先指定的置信级别.
- 提供一个图形工具来可视化内向和外向分布.
主要方法:
- 一种基于稳定性概念的非参数式引导式方法.
- 数字实验,比较拟议的方法与现有的替代方案.
- 将该方法扩展到使用方差稳定转换的通用线性模型.
- 应用到现实世界的数据集来识别异常值.
主要成果:
- 与现有方法相比,拟议的引导方法提供了更准确和更稳定的内向和外向比例估计.
- 该方法生成的不稳定性路径作为理解数据分布的有价值的图形工具.
- 该方法有效地识别了通用线性模型和现实世界的应用中的异常值.
结论:
- 开发的非参数引导方法提供了一个强大的,准确的方法来估计回归中的内向和外向比例.
- 该方法的稳定性和图形输出增强了其在数据分析和异常值检测中的实际实用性.
- 这种方法是多功能性的,扩展到通用线性模型,并证明了对真实世界的数据的有效性.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
1.4K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.4K
Outliers and Influential Points
3.9K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
3.9K
What Are Outliers?
3.6K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.6K
Detection of Gross Error: The Q Test
4.9K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
4.9K
Estimating Population Mean with Unknown Standard Deviation
7.6K
In practice, we rarely know the population standard deviation. In the past, when the sample size was large, this did not present a problem to statisticians. They used the sample standard deviation s as an estimate for σ and proceeded as before to calculate a confidence interval with close enough results. However, statisticians ran into problems when the sample size was small. A small sample size caused inaccuracies in the confidence interval.
William S. Gosset (1876–1937) of the...
William S. Gosset (1876–1937) of the...
7.6K
Bootstrapping
571
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
571


