[Do laymen understand information about hospital quality? An empirical verification using risk-adjusted mortality...

The effect of public reporting to improve quality in healthcare is reduced by the limited intelligibility of information about the quality of healthcare providers. This may result in worse health-related choices especially for older people and those with lower levels of education. There is, as yet, little information as to whether laymen understand the concepts behind quality comparisons and if this comprehension is correlated with hospital choices.

An instrument with 20 items was developed to analyze the intelligibility of five technical terms which were used in German hospital report cards to explain risk-adjusted death rates. Two online presentations of risk-adjusted death rates for five hospitals in the style of hospital report cards were developed. An online survey of 353 volunteers tested the comprehension of the risk-adjusted mortality rates and included an experimental hospital choice.

The intelligibility of five technical terms was tested: risk-adjusted, actual and expected death rate, reference range and national average. The percentages of correct answers for the five technical terms were in the range of 75.0-60.2%. Between 23.8% and 5.1% of the respondents were not able to answer the question about the technical term itself. The least comprehensible technical terms were "risk-adjusted death rate" and "reference range". The intelligibility of the 20 items that were used to test the comprehension of the risk-adjusted mortality was between 89.5% and 14.2%. The two items that proved to be least comprehensible were related to the technical terms "risk-adjusted death rate" and "reference range". For all five technical terms it was found that a better comprehension correlated significantly with better hospital choices.

We found a better than average intelligibility for the technical terms "actual and expected death rate" and for "national average". The least understandable were "risk-adjusted death rate" and "reference range". Since the self-explanatory technical terms "actual and expected death rate" and "national average" are easy to understand and the comprehension is correlated with hospitals choices, we recommend using them for the presentation of measures which contain risk-adjusted mortality. The technical terms "risk-adjusted death rate" and "reference range" should stay in the background, since comprehension problems can be expected and explanations would have to be provided.