Related Experiment Video
Updated: Jun 28, 2025
Dual-Task Stroop Paradigm for Detecting Cognitive Deficits in High-Functioning Stroke Patients
Published on: December 16, 2022
An algorithm for the National Institute of Health Stroke Scale assessment: A multicenter, two-arm and cluster
Joao Brainer Clares de Andrade1, Evelyn de Paula Pacheco2, Millene Rodrigues Camilo3
1Universidade Federal de São Paulo, São Paulo, Brazil; United Health Group Brazil, Sao Paulo, Brazil; Centro Universitario Sao Camilo, São Paulo, Brazil; Hospital Israelita Albert Einstein, São Paulo, Brazil; Institute of Aeronautics Technology, Bioengineer Laboratory, Sao Paulo, Brazil.
Background:
The NIH Stroke Scale (NIHSS) is a validated tool for assessing stroke severity, increasingly used by general practitioners in telemedicine services. Mobile apps may enhance its reliability. We aim to validate a digital platform (SPOKES) for NIHSS assessment in telemedicine and healthcare settings.
Methods:
Hospitals using a telemedicine service were randomly allocated to control or SPOKES-user groups. The discrepancy between the NIHSS scores reported and those confirmed by experts was evaluated. Healthcare providers from comprehensive stroke centers were invited for interrater validation. Participants were randomized to assess the NIHSS using videos of real patients. Weighted Kappa (wk) statistics analyzed the agreement, and logistic regression determined the correlation with the congruency.
Results:
A total of 299 telemedicine consultations from 12 hospitals were included. The difference between the NIHSS scores reported and double-checked was lower in the SPOKES group (p = 0.03), with a significantly higher level of complete agreement (72.5 % vs. 50.4 %, p = 0.005). Adoption of SPOKES was associated with complete congruency (OR 4.01, 95 %CI 1.42-11.35, p = 0.009). For interrater validation, 20 participants were considered. In the SPOKES group, almost-perfect and strong agreement occurred in 13.3 %(n = 6/45) and 84.4 %(n = 38/45) of ratings, respectively; in the control group, 6.7 %(n = 3/45) were almost-perfect, 28.9 %(n = 13/45) strong and 51 %(n = 23/45) were minimal.
Conclusion:
A free and reliable mobile application for NIHSS assessment can significantly improve interrater agreement between healthcare professionals, and between NIHSS-certified neurologists and general practitioners. Our results underscore the importance of ongoing training and education in enhancing the consistency and reliability of NIHSS scores.
