Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

5.8K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.8K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K
Study Design in Statistics01:15

Study Design in Statistics

8.0K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
8.0K
Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

251
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:  
251
Confounding in Epidemiological Studies01:27

Confounding in Epidemiological Studies

164
Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...
164
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

177
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
177

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A comparison of Fast Healthcare Interoperability Resources and Observational Medical Mutcomes Partnership electronic health record data within the All of Us Research Program.

Journal of the American Medical Informatics Association : JAMIA·2026
Same author

Reconciling fast Hepatitis B evolutionary rates with ancient co-divergence.

bioRxiv : the preprint server for biology·2026
Same author

Navigating the landscape of novel meshes: comprehensive review of physicomechanical categorization of mesh for hernia repair.

Hernia : the journal of hernias and abdominal wall surgery·2026
Same author

Phenome-wide analysis of downstream health outcomes following second-line antidiabetic agent prescriptions in All of Us.

Nature communications·2026
Same author

Global approaches to infectious disease surveillance and modeling.

Nature medicine·2026
Same author

Patterns and Trends of Glucose-Lowering Therapy in Alzheimer's Disease and Related Dementias.

Diabetes, obesity & metabolism·2026
Same journal

Comparative Evaluation of Pretrained Large Language Models for Suicide Risk Prediction from Clinical Notes in U.S. Veterans.

medRxiv : the preprint server for health sciences·2026
Same journal

Nocturnal Respiratory Rate and Variability Predict Long-term Mortality in Stable Outpatients with Cardiovascular Disease.

medRxiv : the preprint server for health sciences·2026
Same journal

MOSAIC: Methylation-Oriented Site Analysis and Information Classifier for Robust Epigenomic Classification of Acute Leukemia in Clinical Cohorts with Variable Tumor Purity.

medRxiv : the preprint server for health sciences·2026
Same journal

Risk beliefs, intensive digital information and demand for a new preventative health product in public clinics: Evidence from an experiment in Zimbabwe.

medRxiv : the preprint server for health sciences·2026
Same journal

Development of an automated, imaging-based preoperative screening model for early identification of malnutrition in an abdominal surgery cohort.

medRxiv : the preprint server for health sciences·2026
Same journal

A Pilot Project Leveraging Large Language Models for Automated Screening and Variable Extraction in Observational Studies.

medRxiv : the preprint server for health sciences·2026
See all related articles

Related Experiment Video

Updated: Jun 27, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

14.5K

Assessing Covariate Balance with Small Sample Sizes.

George Hripcsak1,2,3, Linying Zhang2,4, Yong Chen2,5,6,7

  • 1Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY, USA.

Medrxiv : the Preprint Server for Health Sciences
|May 7, 2024
PubMed
Summary
This summary is machine-generated.

Propensity score adjustment diagnostics can falsely flag imbalance due to chance, especially in meta-analyses. A new diagnostic method improves accuracy by testing for statistically significant imbalance, enhancing study validity.

Keywords:
confoundingcovariate balancemeta-analysisobservational researchpropensity score

More Related Videos

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

3.9K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.0K

Related Experiment Videos

Last Updated: Jun 27, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

14.5K
Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

3.9K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.0K

Area of Science:

  • Biostatistics
  • Epidemiology
  • Health Research Methods

Background:

  • Propensity score adjustment methods (matching, stratification, weighting) are used to control for confounding in observational studies.
  • Standard diagnostics, like standardized mean difference (SMD) thresholds, assess covariate balance but can be unreliable in small to moderate sample sizes.
  • Chance imbalance can lead to falsely rejecting study validity, particularly when using fixed thresholds for SMD.

Purpose of the Study:

  • To address the issue of inflated Type I error rates in propensity score diagnostics due to chance imbalance.
  • To propose and evaluate a novel diagnostic approach for propensity score adjustment that accounts for increasing precision in meta-analyses.
  • To improve the reliability and rigor of covariate balance assessment in large-scale studies and meta-analyses.

Main Methods:

  • Proposed an alternative diagnostic that statistically tests if the standardized mean difference (SMD) significantly exceeds a predefined threshold.
  • Evaluated the performance of the proposed diagnostic against standard nominal threshold tests using simulations and real-world data.
  • Investigated the behavior of diagnostics in meta-analyses, emphasizing the need for meta-analysis of diagnostics alongside effect estimates.

Main Results:

  • Chance imbalance is a significant issue in real-world settings, even with sample sizes up to 2000.
  • The proposed diagnostic demonstrates a superior trade-off between Type I error rate and statistical power across various sample sizes (250-4000) and numbers of covariates (20-100,000).
  • Meta-analyses require accompanying meta-analyses of diagnostics to prevent systematic confounding from overwhelming effect estimates.

Conclusions:

  • The proposed statistically significant threshold diagnostic offers a more robust approach to assessing covariate balance in propensity score adjustment.
  • This method is crucial for ensuring the validity of findings in meta-analyses, especially in network studies where confounding can be substantial.
  • The procedure facilitates the review of numerous covariates, leading to more rigorous and reliable study diagnostics.