Related Experiment Video
Updated: May 18, 2026
Design and Optimization Strategies of a High-Performance Vented Box
Published on: June 9, 2023
Specifying the probability characteristics of funnel plot control limits: an investigation of three approaches
Bradley N Manktelow1, Sarah E Seaton
1Department of Health Sciences, University of Leicester, Leicester, United Kingdom. brad.manktelow@le.ac.uk
Background:
Emphasis is increasingly being placed on the monitoring and comparison of clinical outcomes between healthcare providers. Funnel plots have become a standard graphical methodology to identify outliers and comprise plotting an outcome summary statistic from each provider against a specified 'target' together with upper and lower control limits. With discrete probability distributions it is not possible to specify the exact probability that an observation from an 'in-control' provider will fall outside the control limits. However, general probability characteristics can be set and specified using interpolation methods. Guidelines recommend that providers falling outside such control limits should be investigated, potentially with significant consequences, so it is important that the properties of the limits are understood.
Methods:
Control limits for funnel plots for the Standardised Mortality Ratio (SMR) based on the Poisson distribution were calculated using three proposed interpolation methods and the probability calculated of an 'in-control' provider falling outside of the limits. Examples using published data were shown to demonstrate the potential differences in the identification of outliers.
Results:
The first interpolation method ensured that the probability of an observation of an 'in control' provider falling outside either limit was always less than a specified nominal probability (p). The second method resulted in such an observation falling outside either limit with a probability that could be either greater or less than p, depending on the expected number of events. The third method led to a probability that was always greater than, or equal to, p.
Conclusion:
The use of different interpolation methods can lead to differences in the identification of outliers. This is particularly important when the expected number of events is small. We recommend that users of these methods be aware of the differences, and specify which interpolation method is to be used prior to any analysis.
Related Concept Videos
01:24Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:22Interpreting R Charts
An R chart plots the range of subsets of measurements collected from a process. Each point on the chart represents the range—defined as the difference between the maximum and minimum values—of a sample...
01:17Probability Histograms
01:18Finding Critical Values for Chi-Square
00:57Modified Boxplots
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
01:14Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...