Related Experiment Video
Updated: Jan 8, 2026
Computerized Adaptive Testing System of Functional Assessment of Stroke
Published on: January 7, 2019
Reliability and validity of the 15-item Action Research Arm Test with a clinically-informed decision rule
Shota Yoshihara1, Taiichi Sakamoto1, Satoru Amano1,2
1Department of Rehabilitation Sciences, Kitasato University Graduate School of Medical Sciences, Kanagawa, Japan.
Purpose:
To address the time burden of the widely used 19-item Action Research Arm Test (ARAT), a 15-item version using a decision rule has been proposed. However, the reliability and criterion-related validity of this decision rule have not been formally evaluated. Existing frameworks also do not specify the optimal direction of item administration. This study examined the reliability and validity of the 15-item ARAT using a decision rule and a task direction protocol based on Brunnstrom Recovery Stages.
Methods:
In this cross-sectional study, 30 patients with post-stroke hemiparesis were assessed using the 19-item ARAT and the Fugl-Meyer Assessment (FMA). The 15-item ARAT dataset was derived from the 19-item version. Reliability with and without the decision rule was assessed using intraclass correlation coefficients (ICC), item-level agreement via weighted κ, and criterion-related validity via Spearman's ρ.
Results:
The decision rules reduced the total number of items from 450 to 226 across all participants. The ICC was 0.997 (95% CI: 0.993-0.999). Item-level agreement was high (κ = 0.88-1.00), although lower for item 6 (κ = 0.68). Correlations with the FMA (ρ = 0.72) and the 19-item ARAT (ρ = 0.96) were strong.
Conclusion:
This decision rule enhances efficiency without compromising reliability or validity.
