不匹配的列车和测试数据清理管道对回归模型的影响:实践教训
James Nevin1, Michael Lees1, Paul Groth1
1Informatics Institute, University of Amsterdam, Amsterdam, Netherlands.
PeerJ. Computer science
|June 26, 2025
概括
培训和测试之间的数据清理管道不匹配影响机器学习 (ML) 模型的性能. 意想不到的是,这些差异可以改善测试结果并影响模型选择.
科学领域:
- 数据科学数据科学数据科学
- 机器学习 机器学习
- 数据质量数据质量
背景情况:
- 现实世界的数据集往往包含数据质量问题,需要数据清理.
- 机器学习 (ML) 模型在清理数据上进行训练和测试,但清理管道可能会有所不同.
- 在更新数据清理流程时,生产ML模型可能不会被重新训练.
研究的目的:
- 调查ML模型培训和测试之间改变数据清理管道的影响.
- 分析数据清理管道差异如何影响回归模型性能.
- 了解不匹配的清洁工艺对模型选择的影响.
主要方法:
- 开发和评估了超过6000个机器学习模型.
- 在模型培训和测试阶段之间,系统地改变了数据清理管道.
- 在各种数据清理场景下评估回归模型的性能.
主要成果:
- 培训和测试数据清理管道之间的不匹配显著影响回归模型的性能.
- 反直观地说,管道差异可以导致改进测试组的性能.
- 改变的清洁工艺可以改变选择表现最好的模型的选择.
结论:
- 数据清理管道的选择和一致性在ML工作流程中至关重要.
- 数据科学家应该意识到更新清洁过程而没有重新训练模型的潜在后果.
- 需要进一步的研究来优化动态的ML环境中的数据清理策略.
相关概念视频
Survival Tree
166
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
166
Regression Analysis
6.1K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
6.1K
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K
Mismatch Repair
40.6K
Overview
40.6K
Data Validation
263
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
263
Residuals and Least-Squares Property
7.9K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.9K


