使用NSQIP数据库的完全随机预测结果配对产生频繁的统计学意义而没有临床意义
Whisper Grayson1, Aritra Chakraborty2, Nicholas M Brown1
1Department of Orthopaedic Surgery & Rehabilitation, Loyola University Health System, Maywood, IL, USA.
The Journal of arthroplasty
|August 30, 2025
概括
由于样本规模庞大,大型国家数据库可以产生具有统计意义的,但在临床上无意义的结果. 这项研究表明,随机变量配对经常产生错误的发现,强调了以假设为导向的研究的必要性.
科学领域:
- 骨科手术
- 医疗信息学
- 生物统计学
背景情况:
- 大规模的国家数据库对于关节整形结果研究是有价值的.
- 这些数据库中的大量样本可能导致具有统计意义但与临床无关的发现.
- 这项研究调查了大型临床数据集的数据驱动分析中错误发现的风险.
研究的目的:
- 测试大型数据集中的随机变量配对产生统计学意义上的关联的假设.
- 检查大型临床数据集的数据驱动分析中错误发现风险的程度.
主要方法:
- 一个大型国家数据库的回顾性横截面分析.
- 使用当前程序术语 (CPT) 代码识别接受全膝关节 (TKA) 或全关节整形手术 (THA) 的患者.
- 随机选择20个预测结果变量对进行分析,并根据变量类型进行适当的统计测试.
主要成果:
- 在随机配对的变量中,70% (14分之 20) 的结果具有统计学意义 (P< 0. 05).
- 例如CPT代码与血红蛋白A1c以及身高与慢性阻塞性肺病 (COPD).
- 尽管缺乏临床依据,但仍发现了这些显著的关联.
结论:
- 大数据库中的随机配对经常产生统计学上显著的结果,但没有临床相关性,由样本大小决定.
- 这强调了在大型数据库研究中过度解释统计学意义的风险.
- 在结果研究中强调以假设为导向的方法和效果大小解释的必要性.
相关概念视频
Sign Test for Matched Pairs
207
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
207
Statistical Significance
20.4K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.4K
Cochran's Q Test
544
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
544
McNemar's Test
415
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
415
Wilcoxon Signed-Ranks Test for Matched Pairs
219
The Wilcoxon signed-rank test for matched pairs evaluates the null hypothesis by combining the ranks of differences with their signs. It essentially tests whether the median of the differences in a population of matched pairs is zero. Since the test incorporates more information than the sign test, it generally yields more trustable conclusions. This test also does not require the data to follow a normal distribution, but two conditions must be met for it to be applicable: (1) the data must...
219
Significance Testing: Overview
3.8K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.8K


