Related Experiment Video
Updated: Jul 21, 2026

10:32
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 24, 2014
Inter-evaluator reliability of the ALS functional rating scale.
Barbara Miano1, Gregory J Stoddard, Summer Davis
1Department of Neurology University of Utah, Salt Lake City, Utah 84132, USA.
Summary
The ALS Functional Rating Scale-Revised (ALSFRS-R) shows similar functional changes over time regardless of evaluator. Minor score differences arise when patients or providers evaluate, but the ALSFRS-R remains reliable with changing evaluators.
Area of Science:
- Neurology
- Clinical Trials
- Patient-Reported Outcomes
Background:
- The ALS Functional Rating Scale-Revised (ALSFRS-R) is crucial for tracking ALS progression and clinical trial outcomes.
- Traditionally, patient or caregiver evaluations were intended, but healthcare providers commonly conduct ratings.
- Discrepancies in ALSFRS-R scoring based on evaluator type (provider, patient, caregiver) are not well-established.
Purpose of the Study:
- To investigate potential differences in ALSFRS-R scoring when evaluations are performed by healthcare providers versus patients or caregivers.
- To assess the impact of changing evaluators on ALSFRS-R scores within a clinical trial context.
Main Methods:
- Comparative analysis of ALSFRS-R scores based on evaluator identity (provider, patient, caregiver).
- Modeling the statistical influence of evaluator changes on trial outcomes, simulating a scenario with remote final assessments.
- Utilizing visit-specific data to identify scoring variations.
Main Results:
- Overall, all evaluator types demonstrated similar trends in functional changes over time.
- Significant visit-specific differences were observed, with higher ALSFRS-R scores when patients and providers were the evaluators.
- Simulated changes in evaluators for 25% of final assessments resulted in a minimal score change (less than one point).
Conclusions:
- The ALSFRS-R demonstrates consistent tracking of functional changes across different evaluator types.
- Despite minor visit-specific variations, the ALSFRS-R is robust and can be reliably used even with changes in evaluators during clinical trials.
Related Concept Videos
Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.

