The design and methodology for a pilot study of home and community-based services outcome measures

The Research and Training Center on HCBS Outcome Measurement (RTC/OM) developed and piloted measures in six domains to assess the outcomes experienced by HCBS recipients. These measures were based upon the revised National Quality Forum's HCBS Outcome Measurement framework.

The background and rationale for the pilot study are outlined along with the research design, sampling frame, and psychometric and statistical methods used. In addition, administration feasibility for all measures are described. Finally, a summary of results across all measures is provided. Detailed results for individual outcome measure domains are left to forthcoming publications.

Measure construct under study were piloted on a sample of 107 participants identified as receiving HCBS or HCBS-like services and experiencing one of five disabilities: intellectual and developmental, age-related, or physical disabilities as well as Traumatic/Acquired Brain Injury and Serious Mental Health Conditions. Participants were interviewed either in-person or through HIPAA compliant online video conferencing over one to two sessions. Psychometric evidence was evaluated with internal consistency and test-retest reliability, as well as inter-observer agreement. Nonparametric methods were used to test for group comparisons.

Initial reliability and validity results of outcomes on five measures were good to excellent. No significant group differences between disability groups were found.

The psychometric evidence for the tested measures is very promising. Only two of the six measures required significant changes prior to their use in an upcoming field study. Details on results and revisions for individual measures will appear in later publications.