The effect of matching on the power of randomized community intervention studies

Currently, there is considerable interest in studies that use the community as the experimental unit. Health promotion programmes are one example. Because such activities are expensive, the number of experimental units (communities) is usually very small. Investigators often match communities on demographic variables in order to improve the power of their studies. Matching is known to improve power in certain circumstances. However, we show here that if the number of communities is small, the matched design will probably have less power than the unmatched design. This is due primarily to the loss of degrees of freedom in the matched design, which outweighs the benefits of matching on any but the strongest correlates of changes in behaviour. In the community intervention situation, even small differences in sample size between the matched and unmatched analyses can have expensive consequences.