Related Experiment Video
Updated: Apr 25, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Sample size importantly limits the usefulness of instrumental variable methods, depending on instrument strength and
Anna G C Boef1, Olaf M Dekkers2, Jan P Vandenbroucke1
1Department of Clinical Epidemiology, C7-P, Leiden University Medical Centre, PO Box 9600, 2300 RC Leiden, The Netherlands.
Objectives:
Instrumental variable (IV) analysis is promising for estimation of therapeutic effects from observational data as it can circumvent unmeasured confounding. However, even if IV assumptions hold, IV analyses will not necessarily provide an estimate closer to the true effect than conventional analyses as this depends on the estimates' bias and variance. We investigated how estimates from standard regression (ordinary least squares [OLS]) and IV (two-stage least squares) regression compare on mean squared error (MSE).
Study Design:
We derived an equation for approximation of the threshold sample size, above which IV estimates have a smaller MSE than OLS estimates. Next, we performed simulations, varying sample size, instrument strength, and level of unmeasured confounding. IV assumptions were fulfilled by design.
Results:
Although biased, OLS estimates were closer on average to the true effect than IV estimates at small sample sizes because of their smaller variance. The threshold sample size above which IV analysis outperforms OLS regression depends on instrument strength and strength of unmeasured confounding but will usually be large given the typical moderate instrument strength in medical research.
Conclusion:
IV methods are of most value in large studies if considerable unmeasured confounding is likely and a strong and plausible instrument is available.
Related Concept Videos
One-Way ANOVA: Unequal Sample Sizes
Sample Size Calculation
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Mechanistic Models: Compartment Models in Individual and Population Analysis
Group Design

