Related Experiment Video
Updated: Jun 21, 2025

Establishing a Competing Risk Regression Nomogram Model for Survival Data
Published on: October 23, 2020
Optimal Significance Levels and Sample Sizes for Signal Detection Methods Based on Non-constant Hazards
Odile Sauzet1,2,3, Julia Dyck4, Victoria Cornelius5
1Department of Business Administration and Economics, Bielefeld University, Bielefeld, Germany. odile.sauzet@uni-bielefeld.de.
Background And Objectives:
Statistical methods for signal detection of adverse drug reactions (ADRs) in electronic health records (EHRs) need information about optimal significance levels and sample sizes to achieve sufficient power. Sauzet and Cornelius proposed tests for signal detection based on the hazard functions of Weibull type distributions (WSP tests) which use the time-to-event information available in EHRs. Optimal significance levels and sample sizes for the application of the WPS tests are derived.
Method:
A simulation study was performed with a range of scenarios for sample size, rate of event due (ADRs), and not due to the drug and random time to ADR occurrence. Based on the area under the curve of the receiver operating characteristic graph, we obtain optimal significance levels of the different WSP tests for the implementation in a hypothesis free signal detection setting and approximate sample sizes required to reach a power of 80% or 90%.
Results:
The dWSP-pPWSP (combination of double WSP and power WSP) test with a significance level of 0.004 was recommended. Sample sizes needed for a power of 80% were found to start at 60 events for an ADR rate equal to the background rate of 0.1. The number of events required for a background rate of 0.05 and an ADR rate equal to a 20% increase of the background rate was 900.
Conclusion:
Based on this study, it is recommended to use the dWSP-pWSP test combination for signal detection with a significance level of 0.004 when the same test is applied to all adverse events not depending on rates.
Related Concept Videos
Significance Testing: Overview
Hazard Rate
Critical Region, Critical Values and Significance Level
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the...
Introduction to the Sign Test
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Errors In Hypothesis Tests

