Related Experiment Video
Updated: Mar 23, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
The Community Assessment of Risk Instrument: Investigation of Inter-Rater Reliability of an Instrument Measuring Risk
R M Clarnette1, J P Ryan, E O'Herlihy
1Dr Patricia Leahy-Warren, Email: patricia.leahy@ucc.ie, Telephone: +353214901461.
This study found the Community Assessment of Risk Instrument (CARI) demonstrates good inter-rater reliability for assessing frailty risk in older adults. However, variations in clinical data communication and professional interpretation impact specific risk predictions.
Area of Science:
- Gerontology
- Healthcare Risk Assessment
- Clinical Geriatrics
Background:
- Frailty is a growing concern in community-dwelling older adults, increasing their risk of adverse health outcomes.
- Current risk assessment practices in aged care lack detailed understanding of assessor decision-making and risk interpretation.
Purpose of the Study:
- To evaluate the inter-rater reliability of the Community Assessment of Risk Instrument (CARI), a novel risk assessment tool.
- To assess the CARI's effectiveness in predicting adverse outcomes such as institutionalization, hospitalization, and death.
Main Methods:
- A cohort study involving 50 community-dwelling older adults assessed by a geriatrician and a registered nurse.
- Utilized the CARI to score participants' risk for adverse outcomes, with reliability assessed using Gamma, Spearman, and Kappa statistics.
- Internal consistency was evaluated using Cronbach's alpha.
Main Results:
- The CARI demonstrated good to excellent agreement for most items across Mental State and Activities of Daily Living domains (Gamma >0.77).
- Global domain scores and risk scales for institutionalization (0.86) and death (0.78) showed strong inter-rater reliability.
- Lower reliability was observed for hospitalization risk (Gamma 0.29) and within the Medical state domain (Cronbach's alpha <0.51).
Conclusions:
- The CARI generally exhibits good inter-rater reliability for assessing frailty and associated risks in older adults.
- Variability in risk assessment, particularly for medical conditions, may stem from communication issues and differing professional interpretations.
- The instrument's findings suggest a need for standardized data communication and interpretation protocols in geriatric risk assessment.
Related Concept Videos
Reliability and Validity
Kendall's Coefficient of Concordance
Relative Risk
Introduction to Test of Independence
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
Confidence Coefficient
Odds Ratio

