Related Experiment Video
Updated: Mar 3, 2026
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Evaluation of the Case-Crossover (CCO) Study Design for Adverse Drug Event Detection
Zachary Burningham1, Tao He2, Chia-Chen Teng2
1Salt Lake City Veterans Affairs Medical Center (VAMC), Health Services Research and Development (HSRD), Informatics, Decision-Enhancement and Analytic Sciences (IDEAS) Center, 500 Foothill Drive, Salt Lake City, UT, 84148, USA. zachary.burningham@va.gov.
Introduction:
The case-crossover (CCO) design was originally intended to study exposures characterized as intermittent with acute effects. The performance of the CCO design is not well characterized under alternative exposure and outcome relationships.
Objective:
The purpose of this study was to evaluate the ability of the CCO to identify simulated treatment effects under different drug exposures and outcomes relationships while varying the duration of the 1:1 matched risk and control windows.
Methods:
The simulated data were obtained from the Observational Medical Dataset Simulator, version 2 (OSIM2). The area under the receiver operator characteristic curve (AUC) was calculated to compare CCO performance across outcome types, simulated relative risk (RR), and duration of risk and control windows.
Results:
The AUC for acute outcomes was higher for shorter risk and control windows and improved with higher simulated RR. For example, the AUC for the simulated RR of 4 was 0.95 for a 30-day window length and 0.78 for a 360-day window length. The AUC for the accumulative outcomes increased with longer risk and control windows and stronger simulated RR. For example, the AUC for the simulated RR of 4 was 0.85 for a 360-day window length and 0.23 for a 30-day window length. Risk and control window lengths did not appear to sufficiently alter the AUC for insidious onset outcomes.
Conclusions:
The CCO performed best for acute-onset outcomes, but may be useful for exploring adverse outcomes with accumulative effects. Careful consideration must be given to the hypothesized drug exposure and outcome distribution because specification of risk and control window duration affects CCO performance.
Related Concept Videos
01:16Crossover Experiments
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
01:19Pharmacovigilance
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
01:15Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
01:20Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
01:20Comparing the Survival Analysis of Two or More Groups