临床图片对症状检查应用程序的评估有多适合? 一个测试的理论视角
Marvin Kopka1,2, Markus A Feufel1, Eta S Berner3
1Department of Psychology and Ergonomics (IPA), Division of Ergonomics, Technische Universität Berlin, Berlin, Germany.
Digital health
|August 24, 2023
概括
这项研究表明,症状检查应用程序的标准准确度指标可能具有误导性. 一个新的指标,能力比较得分 (CCS),通过考虑案例难度,提供了更可靠的评估.
科学领域:
- 数字健康数字健康
- 医疗信息学 医疗信息学
- 医疗技术评估 医疗技术评估
背景情况:
- 症状检查应用程序越来越多地使用,需要强大的性能评估.
- 使用案例简介的当前审计研究可能存在方法上的限制.
- 评估这些应用程序的真正能力对于用户的安全和信任至关重要.
研究的目的:
- 评估病例简介,以评估症状检查器的性能.
- 提议对基于案例图片的审计研究方法进行改进.
- 引入一个新的指标,以更准确地评估症状检查能力.
主要方法:
- 重新分析现有的症状检查器审计研究数据.
- 测试理论指标的应用.
- 开发和实施能力比较得分 (CCS) 以控制项目难度.
主要成果:
- 症状检查器的表现排名在使用CCS调整项目难度时经常发生变化.
- 传统的准确度指标通过不考虑更容易选择案例,高估了应用程序功能.
- 许多案例 vignettes 显示出较低的项目总相关性,表明质量差.
结论:
- 一种测试理论方法识别了症状检查器评估中的有效性威胁.
- 对于竞争性评估,CCS提供了一个比单独的准确性更有意义的衡量标准.
- 使用CCS等指标标准化方法,可以更可靠地评估症状检查能力.
相关概念视频
Clinical Trials
6.8K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.8K
Cochran's Q Test
390
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
390
Sensitivity, Specificity, and Predicted Value
488
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
488
Reliability and Validity
12.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.8K
Assessment of the Gastrointestinal System II: Health Perception Pattern
140
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
140
Patient-centered Care
2.1K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.1K


