放射学质量评分的可复制性:一个内部和内部评审者可靠性研究
Tugba Akinci D'Antonoli1, Armando Ugo Cavallo2, Federica Vernuccio3
1Institute of Radiology and Nuclear Medicine, Cantonal Hospital Baselland, Liestal, Switzerland. tugba.akincidantonoli@unibas.ch.
European radiology
|September 21, 2023
概括
放射学质量评分 (RQS) 显示,评估放射学研究的可靠性很低. 开发一个更强大和可重复的评分系统对于提高放射学研究质量至关重要.
科学领域:
- 无线电学 (Radiomics) 是一种辐射学.
- 医疗成像医学成像
- 生物统计学 生物统计学
背景情况:
- 放射学质量评分 (RQS) 被广泛用于评估放射学研究.
- 确保RQS的可靠性对于准确评估研究质量至关重要.
研究的目的:
- 调查总RQS的内部和间评级可靠性.
- 在大型多读者研究中评估个人RQS项目分数的可复制性.
主要方法:
- 有不同经验的9名评级者被分为三组.
- 评估者之间的可靠性是用和没有先前的RQS培训进行评估的.
- 评估者内部可靠性是通过让评估者的一个子集在一个月后重新评估研究来评估的.
- 使用了类内相关系数 (ICC) 和kappa统计数据.
主要成果:
- 总RQS的评价者间可靠性差到中等 (ICC 0.30-0.55).
- 项目可复制性显示出低至良好的可靠性 (kappa -0.12至0.75).
- 总RQS的评级者内部可靠性中等至优异 (ICC 0.522-0.99),特别是在经验丰富的评级者中.
结论:
- 总RQS及其单个项目的可复制性很低.
- 在放射学研究中,有很大需要改进,可重复的评分系统.
- 增强的评分系统对于弥合放射学研究和临床应用之间的差距至关重要.
更多相关视频
08:52Software-Assisted Quantitative Measurement of Osteoarthritic Subchondral Bone Thickness
Published on: March 18, 2022
3.0K
12:50Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly
Published on: April 14, 2014
40.3K
相关概念视频
Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT
29
Calcium-Scoring CT ScanA calcium-scoring CT scan, also known as coronary artery calcium (CAC) scan, detects calcium deposits in the coronary arteries. This test assesses the risk of coronary artery disease (CAD), which can lead to cardiovascular events such as angina, heart failure, and sudden cardiac arrest.A calcium-scoring CT scan is generally recommended for individuals at intermediate risk of CAD without symptoms. It includes:Men aged 40-75 and women aged 50-75: Especially those with a...
29
Reliability and Validity
12.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.8K
Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K
Receiver Operating Characteristic Plot
280
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
280
