Related Experiment Video
Updated: Jun 29, 2025

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
An automated flowchart for the Modified Rankin Scale assessment: A multicenter inter-rater agreement analysis
Joao Brainer C de Andrade1,2,3,4, Terence J Quinn5, Leonardo Augusto Carbonera6
1Departments of Health Informatics and Neurology, Universidade Federal de São Paulo, São Paulo, Brazil.
Background And Objective:
The Modified Rankin Scale (mRS) is a widely adopted scale for assessing stroke recovery. Despite limitations, the mRS has been adopted as primary outcome in most recent clinical acute stroke trials. Designed to be used by multidisciplinary clinical staff, the congruency of this scale is not consistent, which may lead to mistakes in clinical or research application. We aimed to develop and validate an interactive and automated digital tool for assessing the mRS-the iRankin.
Methods:
A panel of five board-certified and mRS-trained vascular neurologists developed an automated flowchart based on current mRS literature. Two international experts were consulted on content and provided feedback on the prototype platform. The platform contained five vignettes and five real video cases, representing mRS grades 0-5. For validation, we invited neurological staff from six comprehensive stroke centers to complete an online assessment. Participants were randomized into two equal groups usual practice versus iRankin. The participants were randomly allocated in pairs for the congruency analysis. Weighted kappa (kw) and proportions were used to describe agreement.
Results:
A total of 59 professionals completed the assessment. The kw was dramatically improved among nurses, 0.76 (95% confidence interval (CI) = 0.55-0.97) × 0.30 (0.07-0.67), and among vascular neurologists, 0.87 (0.72-1) × 0.82 (0.66-0.98). In the accuracy analysis, after the standard mRS values for the vignettes and videos were determined by a panel of experts, and considering each correct answer as equivalent to 1 point on a scale of 0-15, it revealed a higher mean of 10.6 (±2.2) in the iRankin group and 8.2 (±2.3) points in the control group (p = 0.02). In an adjusted analysis, the iRankin adoption was independently associated with the score of congruencies between reported and standard scores (beta coefficient = 2.22, 95% CI = 0.64-3.81, p = 0.007).
Conclusion:
The iRankin adoption led to a substantial or near-perfect agreement in all analyzed professional categories. More trials are needed to generalize our findings. Our user-friendly and free platform is available at https://www.irankinscale.com/.
Insights
The iRankin tool improves consistency in Modified Rankin Scale (mRS) assessments for stroke recovery. This digital solution enhances agreement among healthcare professionals, aiding clinical and research applications.
Area of Science:
- Neurology
- Clinical Trials
- Digital Health
Background:
- The Modified Rankin Scale (mRS) is crucial for stroke recovery assessment but suffers from inconsistent application among clinical staff.
- This inconsistency can lead to errors in clinical practice and research.
- There is a need for standardized tools to improve mRS assessment accuracy.
Purpose of the Study:
- To develop and validate an interactive, automated digital tool named iRankin for assessing the Modified Rankin Scale.
- To enhance the congruency and accuracy of mRS scoring among healthcare professionals.
Main Methods:
- An automated flowchart was developed by vascular neurologists based on mRS literature.
- The iRankin platform included vignettes and video cases for assessing mRS grades 0-5.
- Neurological staff from six stroke centers participated in a randomized controlled trial comparing iRankin to usual practice.
Main Results:
- The iRankin tool significantly improved agreement (weighted kappa) among nurses and vascular neurologists.
- Participants using iRankin achieved higher accuracy scores in mRS assessment compared to the control group (10.6 vs. 8.2, p=0.02).
- iRankin adoption was independently associated with improved congruency scores.
Conclusions:
- The iRankin tool demonstrated substantial to near-perfect agreement across professional categories, enhancing mRS assessment.
- Further trials are recommended to generalize these findings.
- The user-friendly, free iRankin platform is accessible online.
More Related Videos
Related Concept Videos
Ranks
Kendall's Coefficient of Concordance
Interpreting R Charts
An R chart plots the range of subsets of measurements collected from a process. Each point on the chart represents the range—defined as the difference between the maximum and minimum...
Friedman Two-way Analysis of Variance by Ranks
The R Chart
R charts are pivotal for pinpointing shifts in process variability. Stability is indicated when all data points remain within the defined upper and lower...

