A Bayesian method for safety signal detection in ongoing blinded randomised controlled trials

Sponsors have a responsibility to minimise risk to participants in clinical studies through safety monitoring. The FDA Final Rule for IND Safety Reporting requires routine aggregate safety evaluation, including in ongoing blinded studies. We are interested in estimating the probability that the true adverse event rate in the experimental arm exceeds that in the control arm. We developed a Bayesian approach that specifies an informative meta-analytic predictive prior on the event probability in the control arm and an uninformative prior on that in the experimental arm. We combined these priors with a mixture likelihood that considers each patient in the ongoing blinded study may belong to the experimental or control arm. This allowed us to estimate the quantity of interest without unblinding. We evaluated our method by simulation, pairing scenarios that differed only in whether a safety signal was present or missing, and quantifying the ability of our model to discriminate using signal detection theory. Our approach shows benefit. It detects safety signals more reliably with greater sample sizes and for common rather than rare events. Performance does not deteriorate markedly when historical studies exhibit heterogeneous hazards or non-constant hazards. Our method will allow us to monitor safety signals in ongoing blinded studies with the goal of earlier identification and risk mitigation. Our method could be adapted to use informative priors on both arms or predictive covariates where pertinent data exist. We stress that ongoing safety monitoring should involve a multi-disciplinary team where statistical methods are paired with medical judgement.