试验序列分析的可重复性缺乏:一个元流行病学研究
Xing Xing1, Yining Wang2, Yipeng Wang3
1Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
Trials
|March 19, 2025
概括
在系统性审查中,试验序列分析 (TSA) 的可重现性很低. 大多数运输安全局缺乏足够的数据来准确评估统计能力,这阻碍了可靠的证据综合.
科学领域:
- 医学研究方法论医学研究方法论.
- 证据综合研究
- 生物统计学 生物统计学
背景情况:
- 系统审查和元分析对于证据综合至关重要.
- 试验顺序分析 (TSA) 通过动态监测证据来增强元分析.
- 统计方法的可复制性对于可靠的研究结果至关重要.
研究的目的:
- 在2023年发表的系统性审查中评估试验顺序分析 (TSA) 的可重现性.
- 确定影响TSA可复制性的因素.
- 突出报告TSA方法的改进领域.
主要方法:
- 采用了一种超流行病学研究设计.
- 两名独立调查人员评估并复制了来自98个系统审查的TSA.
- 对关键的TSA组件 (信息大小,决策边界,Z曲线,结果特定指标) 的数据可用性进行了评估.
主要成果:
- 在审查的系统性审查中,TSA的完全可重复性仅在13%的系统性审查中实现.
- 很大一部分TSA缺乏基本数据,包括信息大小 (72%),事件率 (65%的二元结果),相对风险降低 (44%的二元结果),最小相关差异 (53%的连续结果),以及差异 (72%的连续结果).
- TSA的可复制性与更高的期刊影响因子和遵守PRISMA指南有关.
结论:
- 在系统性审查中,试验序列分析的可重复性是惊人的低.
- 关键数据元素的不完整报告严重阻碍了TSA的可复制性.
- 加强报告标准和研究人员,审稿人和编辑之间的协作努力是必要的,以提高TSA可靠性和证据综合的整体质量.
更多相关视频
06:55Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
14.3K
05:53Candidate Gene Testing in Clinical Cohort Studies with Multiplexed Genotyping and Mass Spectrometry
Published on: June 21, 2018
10.1K
相关概念视频
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
110
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
110
Wald-Wolfowitz Runs Test II
170
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
170
Longitudinal Research
11.8K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
11.8K
Blinding
2.3K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
2.3K
Randomized Experiments
6.6K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.6K
Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
