Health and economic benefits of well-designed evaluations: some lessons from evaluating neuroblastoma screening

Well-designed evaluations of health services are frequently made today. However, the extent of the evaluations' benefits and costs is not well documented, creating uncertainty whether their use is optimal from society's perspective. We examined these costs and benefits using data from one well-designed evaluation, the Quebec Neuroblastoma Screening Project (QNSP). It screened most Quebec newborns between 1989 and 1994 for neuroblastoma. As previously reported, the screening did not reduce neuroblastoma mortality and caused adverse health effects.

We compared the cost of doing the QNSP with its benefits. Had the QNSP not been undertaken, neuroblastoma screening would have been implemented throughout North America. We assume that screening would have started in 1989 and ended in 2002. The QNSP's benefits include the health costs and adverse health effects averted by not using ineffective screening during those 14 years. In our calculations we used neuroblastoma incidence data for the QNSP and for Ontario where there was no screening, detailed data describing the health services used by the patients, and Quebec cost data for those services.

The QNSP cost 8.77 million dollars (2002 US dollars). By not implementing similar screening programs between 1989 and 2002, the United States and Canada avoided 574.1 million dollars in health costs, the unnecessary treatment of 9223 children, and false-positive findings for 5003 children screened.

The health care costs and adverse health effects averted by the QNSP justify its costs. These results show that well-designed evaluations can yield--at least sometimes--benefits substantially greater than their high costs. This raises an important policy issue: are these evaluations now being under- or over used?