External Validation of a Multivariable Diagnostic Prediction Model for Acute Invasive Fungal Rhinosinusitis in

Aviv Spillinger1, Johanna Ellefson1, Qiuyu Yang2

  • 1Department of Otolaryngology-Head & Neck Surgery, University of Wisconsin School of Medicine & Public Health, Madison, Wisconsin, USA.

Abstract

Insights

This study validates a diagnostic model for acute invasive fungal rhinosinusitis (AIFS), showing it performs well in identifying patients with different risk factors. The model is generalizable and aids in timely AIFS detection.

Area of Science:

  • Otolaryngology
  • Infectious Diseases
  • Medical Diagnostics

Background:

  • Prompt detection and intervention are critical for improving outcomes in acute invasive fungal rhinosinusitis (AIFS).
  • Diagnostic prediction models aid in risk-stratification but require external validation to confirm accuracy.
  • This study validates a previously developed AIFS diagnostic model in an independent patient cohort.

Purpose of the Study:

  • To externally validate a published diagnostic prediction model for acute invasive fungal rhinosinusitis (AIFS).
  • To assess the model's performance in an independent cohort with potentially different comorbidities.

Main Methods:

  • A retrospective chart review identified patients with suspected AIFS from 2008-2023.
  • The Yin et al. predictive model was applied to calculate risk in 65 patients (11 diagnosed with AIFS).
  • Model performance was evaluated using calibration and discrimination metrics.

Main Results:

  • The validation cohort had higher rates of diabetes, steroid use, and organ transplantation, but lower rates of hematologic malignancy and neutropenia compared to the development cohort.
  • Both three-variable (C-index: 0.844) and four-variable (C-index: 0.963) models demonstrated adequate discrimination.
  • Models showed slight overprediction, with calibration-in-the-large risks of 24.1% and 24.2% respectively.

Conclusions:

  • The AIFS diagnostic model shows acceptable discrimination and calibration upon external validation.
  • The model is generalizable to patients with varying comorbidities.
  • Larger studies are recommended to further confirm predictive performance and clinical utility.

Related Concept Videos

Data Validation01:03

Data Validation

Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
5.3K
Pneumonia III: Complications and Assessment01:30

Pneumonia III: Complications and Assessment

Pneumonia poses the potential for numerous complications that warrant consideration. These complications include the following:
435
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
661
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
332