The performance quality rating scale (PQRS): reliability, convergent validity, and internal responsiveness for two...

Area of Science:

• Rehabilitation Science
• Occupational Therapy
• Psychometrics

Background:

• The Performance Quality Rating Scale (PQRS) is an observational tool for assessing performance quality in meaningful activities.
• Inconsistent application and lack of psychometric validation have limited PQRS use.
• This study addresses the need for psychometric evaluation of PQRS scoring systems.

Purpose of the Study:

• To test and compare the psychometric properties of two PQRS scoring systems.
• Evaluate reliability and validity in adult stroke survivors and children with developmental coordination disorder (DCD).

Main Methods:

• Secondary analysis of video-recorded activities from studies on adults with stroke and children with DCD.
• Three rater pairs scored performances using PQRS operational definitions (PQRS-OD) and a generic rating system (PQRS-G).

Main Results:

• PQRS-OD demonstrated substantial inter-rater reliability (ICCs 0.83–0.93) versus moderate for PQRS-G (ICCs 0.71–0.77).
• Both systems showed substantial test-retest reliability (>0.80 ICC) and high internal responsiveness.
• Convergent validity with the Canadian Occupational Performance Measure (COPM) was inconsistent (low to moderate).

Conclusions:

• Both PQRS scoring systems are reliable with good internal responsiveness.
• PQRS-OD offers superior inter-rater reliability and greater sensitivity to clinical change, making it preferable for accuracy.
• Further research should explore PQRS-OD validity using objective performance measures.