在没有黄金标准的情况下提高同行评审的可靠性
Tarmo Äijö1, Daniel Elgort2,3, Murray Becker2,4
1Covera Health, New York, NY, USA. tarmo.aijo@coverahealth.com.
Journal of imaging informatics in medicine
|February 5, 2024
概括
一种新的贝叶斯式审查者间协议率 (BIRAR) 方法提高了放射科医生同行审查的准确性和一致性. 这种统计方法解释了放射科医生的变化,提高了医疗专业人员的质量评估.
科学领域:
- 放射学 放射学是一门学科.
- 医学统计 医学统计
- 提高质量 提高质量
背景情况:
- 同行评审对于认证和认证至关重要,有助于错误分析和知识共享.
- 传统的同行评审方法与读者间的变异性作斗争,限制了可扩展性和可靠性.
- 减少同行评审的变化对于准确的评估和医生信心至关重要.
研究的目的:
- 引入一种新的统计方法,贝叶斯的评审者间协议率 (BIRAR),将放射学家的变化纳入同行评审.
- 提高放射学同行评审评估的准确性和一致性.
- 为医生提供可靠的洞察力,以提高质量和同行学习计划.
主要方法:
- 一个计算机模拟将预定义的错误率分配给假设的放射科医生.
- 蒙特卡洛模拟 (每次实验100个样本) 产生了同行评审数据.
- 评估BIRAR与其他四种方法进行比较,包括金标准,用于测量解释错误率.
主要成果:
- 与"单一/标准"和"多数小组"方法相比,BIRAR的相对准确性分别高出93%和79%.
- BIRAR显示相对变异性比"单一/标准"和"多数小组"方法低43%,66%.
- 准确性和可变性是由模拟解释错误率的中位数差异和95% CI定义的.
结论:
- BIRAR是一种实用且可扩展的同行评审方法.
- 它产生了更准确,更不变的解释质量的评估.
- BIRAR考虑了放射科医生的变化,建立了一个基于群体共识的标准.
更多相关视频
08:29An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion
Published on: March 31, 2022
4.5K
08:52Improving Reproducibility to Meet Minimal Information for Studies of Extracellular Vesicles 2018 Guidelines in Nanoparticle Tracking Analysis
Published on: November 17, 2021
2.4K
相关概念视频
02:07Improving Translational Accuracy
10.5K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.5K
01:29Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
02:07Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K
01:15Data Validation
162
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
162
01:56Ethics in Research
23.0K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.0K