Measuring and improving performance in multicenter research consortia

Some evidence suggests that the quality of the organization and management of research consortia influences productivity and staff satisfaction. Collaborators in a research consortium generally focus on developing and implementing studies and thus rarely assess the process of collaboration. We present an approach to evaluating and improving a research consortium, using the HMO Cancer Research Network (CRN) as an example.

Five domains are evaluated: extent of collaboration and quality of communication; performance of projects and infrastructure; data quality; scientific productivity; and impact on member organizations. The primary assessment tool is a survey of CRN scientists and project staff, undertaken annually.

Each year, the evaluation has identified critical aspects of this collaboration that could be improved. Several tangible changes have been implemented to improve productivity of the consortium. The most important result of the CRN Evaluation is the ability to have open dialogue about ways to improve its overall performance.

Optimizing the process of collaboration will contribute to achievement of the scientific goals. The experience of the CRN provides a useful framework and process for evaluating the structure of consortium-based research.