Related Experiment Video
Updated: Aug 6, 2026
Monitoring Colony-level Effects of Sublethal Pesticide Exposure on Honey Bees
Published on: November 15, 2017
Comparing the part with the whole: should overlap be ignored in public health measures?
Lillian J Hayes1, Geoffrey Berry
1Faculty of Nursing and Midwifery, University of Sydney, Sydney, New South Wales 2006, Australia. lhayes@nursing.usyd.edu.au
Background:
In public health, health outcomes such as cancer incidence or mortality of subgroups are often compared with health outcomes of the whole population. Our objective was to explore the effect of overlap that occurs in such comparisons and to develop a correction factor to adjust the test statistics and confidence intervals to allow for the effect in situations where the full data are not available.
Method:
The standard error of a difference between a statistic calculated for a subgroup and for the whole population was derived theoretically both ignoring and allowing for overlap. The ratio of these standard errors was defined as the correction factor. Cancer incidence and death data (1997-2001) for the Australian state of New South Wales (NSW) were examined to demonstrate the utility of the correction factor.
Results:
If the overlap is ignored, significance tests are conservative and confidence intervals too wide. In an example with an overlap of 12%, the correction factor was 1.13 and the significance level of 0.08 was corrected to 0.05 by taking the overlap into account.
Conclusions:
The overlap may not be of concern if the result is significant or if the subgroup is <10% of the whole population, but if the overlap is greater than 10% it should not be ignored. The easiest way of allowing for overlap is to use a correction factor, calculated from the amount of overlap, to adjust analyses that ignore overlap.
Related Concept Videos
01:22Healthcare Associated Infections II: Preventive Measures
The best practices for preventing healthcare-associated infections include hand hygiene, patient risk...
01:26Standard Precaution
Hand hygiene is the most crucial means to prevent the transmission of disease. Employers are legally required to provide their workers with personal protective equipment (PPE) to minimize exposure or contact with...
01:27Confounding in Epidemiological Studies
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:22PPE Use in Healthcare Settings I: Donning
01:24Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...