Related Experiment Video
Updated: Jul 26, 2025

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023
EVALUATING CONTRADICTORY EXPERIMENTAL AND NON-EXPERIMENTAL ESTIMATES OF NEIGHBORHOOD EFFECTS ON ECONOMIC OUTCOMES FOR
David J Harding1, Lisa Sanbonmatsu2, Greg J Duncan3
1University of California at Berkeley, Department of Sociology, 462 Barrows Hall, Berkeley CA 94720.
Non-experimental studies often show neighborhood effects on adults, but this research suggests selection bias may explain these findings. Comparing experimental and non-experimental data found similar results, challenging previous conclusions.
Area of Science:
- Urban Sociology
- Economics
- Public Policy
Background:
- Non-experimental studies frequently report significant neighborhood effects on adult outcomes.
- Residential mobility experiments, like Moving to Opportunity (MTO), have yielded contrasting results, questioning these neighborhood effects.
- Discrepancies between experimental and non-experimental findings necessitate rigorous comparison.
Purpose of the Study:
- To compare experimental and non-experimental estimates of neighborhood effects using data from the Moving to Opportunity (MTO) experiment and the Panel Study of Income Dynamics (PSID).
- To investigate potential reasons for discrepancies, including exposure duration, effect heterogeneity, and move disruption.
- To assess the role of selection bias in non-experimental studies of neighborhood effects.
Main Methods:
- Employed a within-study comparison design.
- Analyzed data from the Moving to Opportunity (MTO) experiment.
- Conducted a parallel analysis using the Panel Study of Income Dynamics (PSID).
Main Results:
- Observed striking similarities between non-experimental estimates derived from MTO and PSID data.
- Found no clear evidence linking estimate differences to exposure duration, non-linear effects, magnitude of change, move frequency, heterogeneity, or measurement issues.
- Results regarding MTO-induced moves being disruptive were inconsistent.
Conclusions:
- The findings suggest that selection bias may account for the robust neighborhood effects observed in non-experimental studies on adult economic outcomes.
- The study highlights the importance of considering selection mechanisms when interpreting neighborhood effects.
- Reconciling experimental and non-experimental findings is crucial for accurate policy implications.
Related Concept Videos
Bias in Epidemiological Studies
Confounding in Epidemiological Studies
Regression Toward the Mean
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Longitudinal Studies

