Evaluation of signal detection algorithms within the Elanco Animal Health Pharmacovigilance database

Statistical algorithms for detecting safety signals are beginning to be applied to Animal Health Pharmacovigilance (PV) databases. How these signal detection algorithms (SDAs) perform in an animal health PV database is the subject of this report. Statistical methods and SDAs were assessed against a set of known signals in order to identify which SDAs were most appropriate for signal detection using the Elanco Animal Health PV database. A reference set of adverse events that should signal was created for 31 products across four species. Nine SDAs based on five disproportionality statistical methods were evaluated against the reference set. The performance metrics were sensitivity, precision, specificity, accuracy, and F score. For bovine and porcine products, the Observed-to-Expected (O/E) SDA was the closest in terms of geometric distance to 100% sensitivity and 100% precision. For canine and feline products, the Information Component (IC) SDA was geometrically closest to 100% sensitivity and 100% precision. Principal Component Analysis confirmed that the O/E and IC SDAs were unique performers with respect to one another and other SDAs. The performance of the SDAs was dependent on the choice of the statistical method with differences seen between animal species.