Related Experiment Video
Updated: Sep 2, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Evaluating and implementing block jackknife resampling Mendelian randomization to mitigate bias induced by
Si Fang1,2, Gibran Hemani1,2, Tom G Richardson1,2,3
1Population Health Sciences, Bristol Medical School, University of Bristol, Bristol BS8 2BN, UK.
Abstract:
Participant overlap can induce overfitting bias into Mendelian randomization (MR) and polygenic risk score (PRS) studies. Here, we evaluated a block jackknife resampling framework for genome-wide association studies (GWAS) and PRS construction to mitigate overfitting bias in MR analyses and implemented this study design in a causal inference setting using data from the UK Biobank. We simulated PRS and MR under three scenarios: (1) using weighted SNP estimates from an external GWAS, (2) using weighted SNP estimates from an overlapping GWAS sample and (3) using a block jackknife resampling framework. Based on a P-value threshold to derive genetic instruments for MR studies (P < 5 × 10-8) and a 10% variance in the exposure explained by all SNPs, block-jackknifing PRS did not suffer from overfitting bias (mean R2 = 0.034) compared with the externally weighted PRS (mean R2 = 0.040). In contrast, genetic instruments derived from overlapping samples explained a higher variance (mean R2 = 0.048) compared with the externally derived score. Overfitting became considerably more severe when using a more liberal P-value threshold to construct PRS (e.g. P < 0.05, overlapping sample PRS mean R2 = 0.103, externally weighted PRS mean R2 = 0.086), whereas estimates using jackknife score remained robust to overfitting (mean R2 = 0.084). Using block jackknife resampling MR in an applied analysis, we examined the effects of body mass index on circulating biomarkers which provided comparable estimates to an externally weighted instrument, whereas the overfitted scores typically provided narrower confidence intervals. Furthermore, we extended this framework into sex-stratified, multivariate and bidirectional settings to investigate the effect of childhood body size on adult testosterone levels.
Insights
Participant overlap can bias Mendelian randomization (MR) and polygenic risk score (PRS) studies. A block jackknife resampling framework effectively mitigates this overfitting bias in PRS construction and MR analyses, ensuring more robust genetic insights.
Area of Science:
- Genetics and Bioinformatics
- Statistical Genetics
- Epidemiology
Background:
- Participant overlap in genome-wide association studies (GWAS) can introduce overfitting bias into Mendelian randomization (MR) and polygenic risk score (PRS) analyses.
- This bias can affect the accuracy of causal inference and genetic risk prediction.
Purpose of the Study:
- To evaluate a block jackknife resampling framework for GWAS and PRS construction to mitigate overfitting bias in MR.
- To implement and assess this framework in a causal inference setting using UK Biobank data.
Main Methods:
- Simulated PRS and MR under three scenarios: external GWAS weights, overlapping GWAS sample weights, and block jackknife resampling.
- Applied the block jackknife resampling MR framework to examine body mass index effects on circulating biomarkers.
- Extended the framework to sex-stratified, multivariate, and bidirectional analyses.
Main Results:
- Block-jackknifing PRS showed no overfitting bias (mean R2=0.034) compared to externally weighted PRS (mean R2=0.040) at a stringent P-value threshold (P < 5 × 10-8).
- Overlapping sample PRS exhibited higher variance explained (mean R2=0.048).
- Overfitting worsened with liberal P-value thresholds (P < 0.05), but jackknife estimates remained robust (mean R2=0.084) versus overlapping (mean R2=0.103) and external (mean R2=0.086).
- Applied MR analysis yielded comparable estimates to external instruments, while overfitted scores produced narrower confidence intervals.
Conclusions:
- The block jackknife resampling framework effectively mitigates overfitting bias in PRS construction and MR analyses.
- This method provides robust and reliable estimates, particularly in the presence of sample overlap or when using more liberal P-value thresholds.
- The framework's extension to complex settings enhances its utility for causal inference research.
Related Concept Videos
Randomized Experiments
Simple randomization
Simple...
Random Sampling Method
Bootstrapping
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding in Epidemiological Studies
Cluster Sampling Method
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...

