如何评估症状检查器和诊断决策支持系统的准确性:症状检查器准确性报告框架 (SCARF)
Marvin Kopka1, Markus A Feufel1
1Division of Ergonomics, Department of Psychology & Ergonomics (IPA), Technische Universität Berlin, Straße des 17. Juni 135, Berlin, 10623, Germany, 49 30-314-70806.
JMIR human factors
|January 16, 2026
概括
一个新的框架,症状检查器准确性报告框架 (SCARF),标准化了健康应用程序和人工智能工具的评估. 这旨在提高诊断决策支持系统评估的质量和可比性.
科学领域:
- 数字健康数字健康
- 医疗信息学 医疗信息学
- 医疗人工智能 医疗人工智能
背景情况:
- 症状检查器被公众广泛用于初步健康评估.
- 这些工具以前的评估方法缺乏质量控制和标准化.
- 十年的研究突出了需要一个强大的方法框架.
研究的目的:
- 综合实证研究,并为症状检查者提出一个标准化的评估框架.
- 引入症状检查器准确性报告框架 (SCARF) 及其检查清单.
- 提高未来症状检查器评估的质量和可比性.
主要方法:
- 对症状检查器评估的经验研究的系统综合.
- 发展症状检查器准确性报告框架 (SCARF).
- 包括案例选择,评估设计和可比度指标的标准.
主要成果:
- SCARF提供了一种标准化的方法来评估症状检查器.
- 该框架强调代表性案例选择和有效的评估设计.
- 它引入了指标,以改善基于人工智能的健康工具的跨研究可比性.
结论:
- SCARF解决了长期以来对高质量的方法框架的需求.
- 实施SCARF将提高在线症状检查器评估的可靠性.
- 这一框架促进了人工智能诊断工具的元分析和知情决策.
相关概念视频
Receiver Operating Characteristic Plot
471
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
471
SBAR II: Application of SBAR
5.7K
SBAR is an effective communication tool used by healthcare professionals to communicate patient information accurately. SBAR stands for Situation, Background, Assessment, and Recommendation. For a better understanding, an example is given below.
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
5.7K
Documentation of Nursing Diagnosis
1.6K
The nurse documents nursing diagnoses and enters them into the patient record. The identified patient's nursing diagnosis is either written out with a plan of care or entered into the electronic health record.
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
1.6K
Sensitivity, Specificity, and Predicted Value
1.2K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
1.2K


