Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

180
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
180
Statistical Significance01:50

Statistical Significance

20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
Experimental Designs01:16

Experimental Designs

11.2K
An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
11.2K
Factorial Design02:01

Factorial Design

13.0K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.0K
Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

1.5K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.5K
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

120
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
120

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Impacts of Paid Family Leave on Perinatal Health: A Nationwide Quasi-Experimental Study.

Pediatrics·2026
Same author

A cross-sectional analysis of county-level determinants of pandemic-era policy implementation.

Frontiers in public health·2026
Same author

Safety net program participation and churning during the COVID-19 pandemic: a longitudinal analysis of low-income California families.

SSM - population health·2026
Same author

Attending an Historically Black College or University and all-cause mortality in US Black adults.

American journal of epidemiology·2026
Same author

Disparities in Longer-term Breastfeeding Practices and Postpartum Mental Health After the 2022 Formula Crisis.

Academic pediatrics·2026
Same author

Peer-Mentored Social Media Groups for Youth Vaping Cessation: Single-Arm Pilot Trial.

JMIR pediatrics and parenting·2026

Related Experiment Video

Updated: Jun 21, 2025

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

5.9K

Advances in Difference-in-differences Methods for Policy Evaluation Research.

Guangyi Wang1,2, Rita Hamad2, Justin S White1,3

  • 1From the Philip R. Lee Institute for Health Policy Studies, University of California San Francisco (UCSF), San Francisco, CA.

Epidemiology (Cambridge, Mass.)
|July 5, 2024
PubMed
Summary
This summary is machine-generated.

Difference-in-differences (DiD) methods are crucial for policy evaluations but can be biased by heterogeneous treatment effects. This primer introduces robust DiD estimators and addresses parallel trends violations for more reliable causal inference.

More Related Videos

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
08:24

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies

Published on: August 25, 2023

689
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.3K

Related Experiment Videos

Last Updated: Jun 21, 2025

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

5.9K
The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
08:24

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies

Published on: August 25, 2023

689
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.3K

Area of Science:

  • Epidemiology
  • Econometrics
  • Health Policy Evaluation

Background:

  • Difference-in-differences (DiD) is a quasi-experimental design for longitudinal policy evaluations.
  • Standard DiD estimators may produce biased results with heterogeneous treatment effects, often arising from staggered policy implementation.

Purpose of the Study:

  • To provide an overview of DiD methods for epidemiologists.
  • To address challenges in DiD, including heterogeneous treatment effects and parallel trends assumption violations.
  • To guide the application of recently developed heterogeneity-robust DiD estimators.

Main Methods:

  • Review of DiD methodology.
  • Summary of challenges in DiD with heterogeneous treatment effects.
  • Discussion of heterogeneity-robust DiD estimators and parallel trends assumption violations.
  • Simulation study comparing DiD estimator performance.

Main Results:

  • DiD estimators can be biased when treatment effects vary across groups or time.
  • Heterogeneity-robust DiD estimators offer improved causal inference in complex policy settings.
  • Violations of the parallel trends assumption can significantly impact DiD results.

Conclusions:

  • Understanding and addressing heterogeneous treatment effects is critical for valid DiD analysis in epidemiology.
  • The adoption of robust DiD methods enhances the reliability of causal inference in policy evaluations.
  • Further research and simulation studies are needed to guide the practical application of advanced DiD techniques.