Recurrent events counted in evaluations of predictive accuracy
Related Experiment Videos
Terry P Haines1, Keith D Hill, Kim L Bennell
1The University of Melbourne, Peter James Centre, The University of Queensland and Princess Alexandra Hospital, c/o Physiotherapy Department, Princess Alexandra Hospital, Woolloongabba, Queensland 4102, Australia. terrence_haines@health.qld.gov.au
Objectives:
To describe an alternate approach for the calculation of sensitivity and specificity when analyzing the accuracy of screening tools, which can be used when standard calculations may be inappropriate. Sensitivity(ER) (ER denoting event rate) is the number of events correctly predicted, divided by the total number of events. Specificity(ER) is the amount of time that study participants are predicted to be event negative, divided by the total amount of participant observed time. Variance estimates for these statistics are constructed by bootstrap resampling, taking into account event dependence.
Methods:
Standard and alternate approaches for calculating sensitivity and specificity were applied to hospital falls risk screening tool data. In this application, the outcome of interest was a recurrent event, there were multiple applications of the screening tool, delays in screening tool completion, and patients' follow-up durations were unequal.
Results:
Application of sensitivity(ER) and specificity(ER) to this data not only provided a clearer description of the screening tool's overall accuracy, but also allowed examination of accuracy over time, accuracy in predicting specific event numbers, and evaluation of the added value that screening tool reapplications may have.
Conclusion:
Sensitivity(ER) and specificity(ER) provide a valuable approach to screening tool evaluation in the clinical setting.
Related Concept Videos
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
The...
Hindsight Biases
Receiver Operating Characteristic Plot
Survival Tree
Building a Survival Tree
Constructing a survival tree begins...
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...