Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

5.9K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.9K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.5K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.5K
Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

683
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:  
683
Study Design in Statistics01:15

Study Design in Statistics

8.5K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
8.5K
Sample Size Calculation01:19

Sample Size Calculation

3.8K
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
3.8K
Confounding in Epidemiological Studies01:27

Confounding in Epidemiological Studies

262
Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...
262

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A comparison of Fast Healthcare Interoperability Resources and Observational Medical Mutcomes Partnership electronic health record data within the All of Us Research Program.

Journal of the American Medical Informatics Association : JAMIA·2026
Same author

Reconciling fast Hepatitis B evolutionary rates with ancient co-divergence.

bioRxiv : the preprint server for biology·2026
Same author

Navigating the landscape of novel meshes: comprehensive review of physicomechanical categorization of mesh for hernia repair.

Hernia : the journal of hernias and abdominal wall surgery·2026
Same author

Heterogeneity of Treatment Effects Across Nine Glucose-Lowering Drug Classes in Type 2 Diabetes: Extension of the LEGEND-T2DM Network Study.

Diabetes, obesity & metabolism·2026
Same author

Semaglutide and Neovascular Age-Related Macular Degeneration Among Adults with Type 2 Diabetes: An OHDSI Network Study.

Ophthalmology·2026
Same author

Phenome-wide analysis of downstream health outcomes following second-line antidiabetic agent prescriptions in All of Us.

Nature communications·2026
Same journal

A Mixture of Distributed Lag Non-Linear Models to Account for Spatially Heterogeneous Exposure-Lag-Response Associations.

Statistics in medicine·2026
Same journal

Practical Considerations for Gaussian Process Modeling for Causal Inference in Quasi-Experimental Studies With Panel Data.

Statistics in medicine·2026
Same journal

Covariate Adjustment for Wilcoxon Two Sample Statistic and Test.

Statistics in medicine·2026
Same journal

Beyond Fixed Thresholds: Optimizing Summaries of Wearable Device Data via Piecewise Linearization of Quantile Functions.

Statistics in medicine·2026
Same journal

A Causal Framework for Evaluating the Total Effect of Strategies Aiming to Expand Screening and to Improve Outcomes.

Statistics in medicine·2026
Same journal

Causal Effects on Nonterminal Event Time With Application to Antibiotic Usage and Future Resistance.

Statistics in medicine·2026
See all related articles

Related Experiment Video

Updated: Sep 12, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

14.6K

Assessing Covariate Balance With Small Sample Sizes.

George Hripcsak1,2,3, Linying Zhang2,4, Yong Chen2,5,6,7

  • 1Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, USA.

Statistics in Medicine
|August 7, 2025
PubMed
Summary
This summary is machine-generated.

Propensity score adjustment diagnostics can falsely flag studies as biased due to chance imbalance. A new diagnostic method improves accuracy by testing if the standardized mean difference statistically exceeds thresholds, enhancing bias detection in meta-analyses.

Keywords:
confoundingcovariate balancemeta‐analysisobservational researchpropensity score

More Related Videos

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.1K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.2K

Related Experiment Videos

Last Updated: Sep 12, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

14.6K
Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.1K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.2K

Area of Science:

  • Epidemiology
  • Biostatistics
  • Health Research Methods

Background:

  • Propensity score adjustment methods like matching, stratification, and weighting balance covariates to address confounding.
  • Standard diagnostics, such as standardized mean difference (SMD) thresholds, assess covariate balance but can be overly sensitive in smaller studies.
  • Chance imbalance may be incorrectly identified as significant bias, especially in meta-analyses with increasing precision.

Purpose of the Study:

  • To address the challenge of inflated type 1 error rates in propensity score diagnostics due to chance imbalance.
  • To propose and evaluate a novel diagnostic approach for assessing covariate balance in propensity score adjustment.
  • To ensure the reliability of diagnostic assessments in meta-analyses where effect estimates become more precise.

Main Methods:

  • Developed an alternative diagnostic that statistically tests if the standardized mean difference (SMD) significantly exceeds a predefined threshold.
  • Evaluated the proposed diagnostic through simulations and real-world data across various sample sizes (250-4000) and numbers of covariates (20-100,000).
  • Compared the performance of the new diagnostic against standard nominal threshold tests and no testing in terms of type 1 error rate and statistical power.

Main Results:

  • The proposed diagnostic demonstrates a superior trade-off between type 1 error rate and statistical power compared to standard methods.
  • This improved performance was consistent across a wide range of sample sizes and covariate numbers.
  • Meta-analysis of diagnostics is crucial in network studies to prevent systematic confounding from overwhelming effect estimates.

Conclusions:

  • The novel diagnostic method provides a more accurate assessment of covariate balance in propensity score adjustment, mitigating issues with chance imbalance.
  • This approach enhances the rigor of diagnostics, particularly in meta-analyses and network studies, by ensuring precise and reliable bias assessment.
  • The procedure supports the comprehensive review of numerous covariates, leading to more robust study evaluations.