Related Experiment Video
Updated: Aug 18, 2026

Post-Movie Subliminal Measurement (PMSM), for Investigating Implicit Social Bias
Published on: February 29, 2020
Discussing hidden bias in observational studies
1Wharton School, University of Pennsylvania, Philadelphia.
Abstract:
In observational studies or nonrandomized experiments, treated and control groups may differ in their outcomes even if the treatment has no effect; this may happen if the groups were not comparable before the start of treatment. The groups may fail to be comparable in either of two ways: They may differ with respect to characteristics that have been measured, in which case there is an overt bias, or they may differ in ways that have not been measured, in which case there is a hidden bias. Overt biases are controlled through adjustments, such as matching. Hidden bias is more difficult to address because the relevant measurements are not available. A sensitivity analysis asks how much hidden bias would need to be present if hidden bias were to explain the differing outcomes in the treated and control groups. A sensitivity analysis provides a tangible and specific framework for discussing hidden biases.
Related Concept Videos
Naturalistic Observations
Blind Procedures
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Confounding in Epidemiological Studies
Bias in Epidemiological Studies

