两周系统审查 (2weekSR) 方法被另一个团队盲目复制成功:一个案例研究
Catalin Tufanaru1, Didi Surian1, Anna Mae Scott2
1Australian Institute of Health Innovation, Level 6, Macquarie University, 75 Talavera Road, North Ryde, New South Wales 2109, Australia.
Journal of clinical epidemiology
|October 25, 2023
概括
使用自动化工具复制为期2周的系统审查 (2weekSR) 显示了方法的高准确性,但由于报告缺陷,结果存在挑战. 加强报告是系统审查可复制性的关键.
科学领域:
- 医疗信息学 医疗信息学
- 证据综合 证据综合
- 研究方法研究方法研究方法学
背景情况:
- 系统审查 (SRs) 对于证据综合至关重要.
- 自动化工具可以加快SR创建,但它们的可复制性需要评估.
- 忠实度方法是评估研究可重复性的一种强有力的方法.
研究的目的:
- 评估使用自动化工具开发的2周系统审查 (2weekSR) 的可复制性.
- 评估复制过程对方法和结果的忠实性.
- 识别影响自动化系统审查可重复性的障碍.
主要方法:
- 开发了系统审查和元分析 (PRISMA) 合规的优先报告项目复制协议.
- 一个由三名审查员组成的团队进行了复制,将时间和元分析结果与原来的2周SR.进行了比较.
- 计算了方法和结果的审查过程忠实度评分 (FSs),并确定了复制障碍.
主要成果:
- 复制需要63个人小时,在15个日历日内完成.
- 实现了对方法的高保真度得分 (0.95),并进行了轻微的部分复制.
- 结果的低保真度 (0.63),由于原始研究中缺少信息,部分或没有复制几个任务.
结论:
- 一个为期2周的系统审查 (2weekSR) 被一个小团队使用自动化工具成功复制.
- 该研究强调需要在系统审查中进行全面报告,以提高可复制性.
- 改进的报告标准可以显著提高自动化证据合成的可靠性和可重复性.
更多相关视频
04:34Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia
Published on: February 17, 2023
1.1K
10:38Observational Study Protocol for Repeated Clinical Examination and Critical Care Ultrasonography Within the Simple Intensive Care Studies
Published on: January 16, 2019
20.2K
相关概念视频
Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
Case Studies
11.7K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.7K
Blinding
2.5K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
2.5K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
133
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
133
Observational Studies
8.7K
Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
8.7K
Group Design
8.9K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
8.9K
