Measuring effectiveness in community randomized trials of HIV prevention

Complicated HIV transmission dynamics make it unclear how to design and interpret results from community-randomized controlled trials (CRCT) of interventions to prevent infection.

Mathematical modelling was used to investigate the effectiveness of interventions to prevent HIV transmission aimed at high-risk groups and factors related to the chance of recording a statistically significant result.

Behaviour change by high-risk groups can substantially reduce HIV incidence in the whole population, although its effect is sensitive to the structure of the sexual network and the phase of the epidemic. There is a delay between the behaviour change happening and its full effect being realized in the low-risk group and this can pull the measured incidence rate ratio towards one and reduce the chance of recording a statistically significant result in a CRCT. Our simulations suggest that only with unrealistically favourable study conditions would a statistically significant result be likely with 5 years follow-up or less. Small differences in the epidemiological parameters between communities can lead to misleading incidence rate ratios. Behaviour change independent of the intervention can increase the epidemiological impact of the intervention and the chance of recording a statistically significant result.

HIV prevention interventions, especially those targeted at high-risk groups may take longer to work at the population level and need more follow-up time in a CRCT to generate statistically significant results. Mathematical modelling can be used in the design and analysis of CRCTs to understand how the impact of the intervention could develop and the implications this has for statistical power.