Annual reports in the Pacific: transforming data into information and knowledge

Annual Reports provide a wealth of raw data. However, they are often comprised of pages of complex tables with little interpretation or descriptive analysis provided, thus limiting their usefulness in monitoring and evaluating health patterns. This article provides an overview of research carried out as part of a Masters Dissertation, which was concerned with what Annual Reports from Pacific Island Countries can tell us about the quality of data being produced from Health Information Systems (HIS). Five dimensions of quality were selected for assessment (comparability, disaggregation, interpretability, presentation and timeliness), and methods of measurement developed accordingly. Findings from the research are two-fold. Firstly, reports are often excessively long, with a wide range of information on the entire Health System and include pages of dense tables with little critical analysis on implications for policy or decision-making. The second main finding relates to the concept of quality. Overall, the research found that the quality of data produced from HIS, as presented in Annual Reports, is poor. The wealth of data contained within Annual Reports deserve wider dissemination and use, and could play a crucial role in evidence-based decision making and the monitoring and evaluation of health systems and health outcomes. As such, four key recommendations are proposed: (1) comprehensive review of reporting practices; (2) development of quality assessment tools; (3) development of regional reporting templates; and (4) development of a minimum data set.