Developing an outcomes measurement system: the value of testing

Outcomes measurement systems often experience similar challenges to implementing data collection and demonstrating value. This article examines the experiences of 451 hospitals participating in a 2-year research effort designed to assess the ability of participants to successfully implement collection of obstetric and peri-operative indicator data for development of an outcomes measurement system. Measures of ability to implement include rate of attrition and reasons for withdrawal, resources expended, months of data transmitted, internal factors that affected ability to operationalize data collection, and assessment of value of participating in the testing process. The findings indicate considerable variation in implementation ability, challenges encountered, and satisfaction with the experience. Several changes in the operational system were made in response to the findings. Many of the lessons learned from the testing experience may be applicable to sponsors of and participants in other outcomes measurement systems.