The validity of occupational performance assessments: a validity generalization meta-analysis.

Area of Science:

• Occupational therapy and performance measurement.
• Psychometrics and validity generalization.
• Evidence-based practice in healthcare.

Background:

• Occupational performance assessments are crucial for evaluating client function.
• Understanding the validity and generalizability of these assessments is essential for effective clinical application.
• Previous research has explored various validity types, but a synthesized view is needed.

Purpose of the Study:

• To determine the sample-weighted mean validity effect sizes of occupational performance assessments.
• To evaluate the generalizability of these validity estimates from research settings to clinical practice.

Main Methods:

• Conducted a meta-analysis of 27 studies investigating occupational performance assessment validity.
• Employed bare-bones Validity Generalization (VG) guidelines (Hunter & Schmidt, 2004) combined with Maximum Likelihood (ML) procedures.
• Analyzed convergent, divergent, and predictive validity estimates.

Main Results:

• The mean validity coefficients for the included occupational performance assessments ranged from medium to large.
• These results indicate a substantial degree of validity for the assessed tools.
• The findings suggest that the validity observed in research settings is likely to hold in clinical environments.

Conclusions:

• Occupational performance assessments demonstrate robust validity.
• The generalizability of these assessments from research to clinical settings is supported by the findings.
• Further meta-analyses with complete dis-attenuation are recommended to refine validity coefficient estimates.