NSQIPデータベースを使用した完全にランダム化された予測結果のペアリングは,臨床的意味のない頻繁な統計的有意性をもたらします
Whisper Grayson1, Aritra Chakraborty2, Nicholas M Brown1
1Department of Orthopaedic Surgery & Rehabilitation, Loyola University Health System, Maywood, IL, USA.
The Journal of arthroplasty
|August 30, 2025
まとめ
大規模な国家データベースは 統計的に有意だが 臨床的に無意味な結果を生むことができる この研究は,ランダム変数のペアリングがしばしば誤った発見をもたらすことを示し,仮説主導の研究の必要性を強調しています.
科学分野:
- 整形 術
- 医療情報学
- バイオ統計学
背景:
- 大規模な国家データベースは,関節整形手術の結果の研究に価値があります.
- これらのデータベースの膨大なサンプルサイズは,統計的に有意だが,臨床的に無関係な発見につながる.
- この研究は,大規模な臨床データセットのデータ主導の分析で誤った発見のリスクを調査します.
研究 の 目的:
- 大量のデータセットにおけるランダム変数のペアリングは,統計的に有意な関連を生むという仮説を検証する.
- 大規模な臨床データセットのデータ主導の分析における誤った発見リスクの範囲を検証する.
主な方法:
- 大規模な国家データベースの遡及的横断分析
- 現在の手続き用語 (CPT) のコードを使用して,全膝 (TKA) または全股関節整形手術 (THA) を受けている患者の識別.
- 分析のために20の予測結果変数ペアをランダムに選択し,変数タイプに基づいて適切な統計テストを適用します.
主要な成果:
- ランダムにペア化された変数の70% (14件中20件) が統計的に有意な結果をもたらした (P < 0. 05).
- 例としては,CPTコードとヘモグロビンA1c,身長と慢性閉塞性肺疾患 (COPD) が挙げられます.
- これらの有意な関連性は,基礎となる臨床的根拠の欠如にもかかわらず発見されました.
結論:
- 大規模なデータベースでのランダムなペアリングは,サンプルサイズによって誘発される,臨床的関連性のない統計的に有意な結果を生成する.
- これは,大規模なデータベースの研究における 統計的意義を過度に解釈する危険性を強調しています.
- 結果研究における仮説主導の方法論と効果サイズ解釈の必要性を強調する.
関連する概念動画
Sign Test for Matched Pairs
207
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
207
Statistical Significance
20.4K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.4K
Cochran's Q Test
544
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
544
McNemar's Test
415
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
415
Wilcoxon Signed-Ranks Test for Matched Pairs
219
The Wilcoxon signed-rank test for matched pairs evaluates the null hypothesis by combining the ranks of differences with their signs. It essentially tests whether the median of the differences in a population of matched pairs is zero. Since the test incorporates more information than the sign test, it generally yields more trustable conclusions. This test also does not require the data to follow a normal distribution, but two conditions must be met for it to be applicable: (1) the data must...
219
Significance Testing: Overview
3.8K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.8K


