Related Experiment Video
Updated: Aug 10, 2026
Automated Contraction Analysis of Human Engineered Heart Tissue for Cardiac Drug Safety Screening
Published on: April 15, 2017
Development of an automated assessment tool for MedWatch reports in the FDA adverse event reporting system
Lichy Han1, Robert Ball2, Carol A Pamer2
1Biomedical Informatics Training Program, Stanford University, Stanford, CA, USA.
Objective:
As the US Food and Drug Administration (FDA) receives over a million adverse event reports associated with medication use every year, a system is needed to aid FDA safety evaluators in identifying reports most likely to demonstrate causal relationships to the suspect medications. We combined text mining with machine learning to construct and evaluate such a system to identify medication-related adverse event reports.
Methods:
FDA safety evaluators assessed 326 reports for medication-related causality. We engineered features from these reports and constructed random forest, L1 regularized logistic regression, and support vector machine models. We evaluated model accuracy and further assessed utility by generating report rankings that represented a prioritized report review process.
Results:
Our random forest model showed the best performance in report ranking and accuracy, with an area under the receiver operating characteristic curve of 0.66. The generated report ordering assigns reports with a higher probability of medication-related causality a higher rank and is significantly correlated to a perfect report ordering, with a Kendall's tau of 0.24 ( P = .002).
Conclusion:
Our models produced prioritized report orderings that enable FDA safety evaluators to focus on reports that are more likely to contain valuable medication-related adverse event information. Applying our models to all FDA adverse event reports has the potential to streamline the manual review process and greatly reduce reviewer workload.
