Related Experiment Video
Updated: May 6, 2026
07:31
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
8.4K
Empirical performance of a self-controlled cohort method: lessons for developing a risk identification and analysis
Patrick B Ryan1, Martijn J Schuemie, David Madigan
1Janssen Research and Development LLC, 1125 Trenton-Harbourton Road, Room K30205, PO Box 200, Titusville, NJ, 08560, USA, ryan@omop.org.
Drug Safety
|October 30, 2013
Summary
The self-controlled cohort method shows promise for identifying medical product risks in observational data, demonstrating strong predictive accuracy. However, it requires calibration for accurate risk magnitude estimation.
Area of Science:
- Pharmacoepidemiology
- Health Informatics
- Biostatistics
Background:
- Observational healthcare data can identify medical product risks, but robust methodologies are needed.
- The self-controlled cohort method compares pre- and post-exposure outcomes within an exposed group for risk identification.
- The performance of this method in real-world data has not been fully evaluated.
Purpose of the Study:
- To assess the effectiveness of the self-controlled cohort method for identifying medical product risks using observational healthcare data.
- To evaluate the method's performance across various drug-outcome scenarios and data sources.
Main Methods:
- Applied the self-controlled cohort method to 399 drug-outcome scenarios across 5 real-world databases and 6 simulated datasets.
- Included 165 positive and 234 negative control scenarios with varying injected relative risks.
- Evaluated method performance using area under the receiver operating characteristic curve (AUC), bias, and coverage probability.
Main Results:
- The self-controlled cohort design demonstrated strong predictive accuracy (AUC >0.76) across diverse scenarios and databases.
- Estimates generated by the method exhibited significant bias.
- Low coverage probability was observed, indicating potential issues with reliability.
Conclusions:
- The self-controlled cohort method is promising for risk *identification* (discrimination) in observational data.
- The method may not be suitable for quantifying risk *magnitude* without substantial calibration.
- Further refinement is needed for accurate interpretation and application in risk estimation systems.
Related Concept Videos
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
631
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
631
01:20Comparing the Survival Analysis of Two or More Groups
734
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
734
01:15Assumptions of Survival Analysis
503
Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.
503
01:25Statistical Methods for Analyzing Epidemiological Data
1.3K
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
1.3K
01:18Introduction To Survival Analysis
963
Survival analysis is a statistical method used to study time-to-event data, where the "event" might represent outcomes like death, disease relapse, system failure, or recovery. A unique feature of survival data is censoring, which occurs when the event of interest has not been observed for some individuals during the study period. This requires specialized techniques to handle incomplete data effectively.
The primary goal of survival analysis is to estimate survival time—the time...
The primary goal of survival analysis is to estimate survival time—the time...
963
01:24Kaplan-Meier Approach
807
The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
807