不良条件回归模型中的聚合:与基于的方法的比较
Ana Helena Tavares1,2, Ana Silva3, Tiago Freitas4
1Center for Research and Development in Mathematics and Applications (CIDMA), 3810-193 Aveiro, Portugal.
Entropy (Basel, Switzerland)
|October 28, 2025
概括
一种新的规范化方法提高了大规模回归分析的精度准确性,而不是传统的方法,如袋装和袋装. 这种信息理论方法在推断问题上具有优势,特别是在有噪音或对线数据的情况下.
科学领域:
- 统计 统计 统计 统计
- 信息理论 信息理论
- 数据科学数据科学数据科学
背景情况:
- 传统的回归方法在处理大数据方面存在问题.
- 集成方法,如袋装和袋装,可能会在不良条件的数据,特别是对线性数据下失败.
- 常规最小平方 (OLS) 估计器在大数据分析中存在风险,特别是对线性.
研究的目的:
- 为了比较一个新的规范化方法与已建立的方法 (包装,magging) 大规模回归.
- 在预测和精度准确性方面评估性能.
- 突出在具有挑战性的数据集中推断正常化的好处.
主要方法:
- 一个模拟研究,将正常化与袋装和袋装相比较.
- 分析侧重于预测和精确度准确度指标.
- 在不同的群体大小下进行评估,并对每个群体进行观察.
主要成果:
- 规范化的和聚合方法显示出类似的预测准确度.
- 在精度准确性方面,规范化的显著超过了其他方法.
- 这种优势甚至在较少的群体和观测的情况下也存在.
结论:
- 正常化方法为大规模回归推理提供了更高的精度准确性.
- 在使用具有对线性大规模数据的OLS估计器时,建议谨慎使用.
- 提出的战略显示了计量经济学,基因组学,环境科学和机器学习的潜力.
相关概念视频
Aggregates Classification
963
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
963
Mechanistic Models: Compartment Models in Individual and Population Analysis
241
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
241
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
282
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
282
Variation
7.7K
An important characteristic of any set of data is the variation in the data. In some data sets, the data values are concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. The most common measure of variation, or spread, is the standard deviation, which is the square root of variance.
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
7.7K
Random Error
7.8K
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
7.8K
Regression Toward the Mean
6.8K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.8K


