Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Naturalistic Observations

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

Cochran's Q Test

Cochran's Q Test

Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...

Impact of Social Context on Individuals

Impact of Social Context on Individuals

Social psychology examines how the real or imagined presence of others influences individuals' thoughts, feelings, and behaviors. A key concept in this field is the role of social context in shaping behavior. The same individual may act differently depending on the social setting, due to the varying expectations and norms associated with each environment. This context-dependent behavior illustrates the influence of social roles, which prescribe appropriate conduct in specific situations.Social...

Social Proof

Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.

Strategies for Assessing and Addressing Confounding

Strategies for Assessing and Addressing Confounding

Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...

Criteria for Causality: Bradford Hill Criteria - II

Criteria for Causality: Bradford Hill Criteria - II

The Bradford Hill criteria serve as guidelines for establishing causative links in epidemiological research. Beyond Strength, Consistency, Specificity, and Temporality, key criteria also include Biological Gradient, Plausibility, Coherence, Experiment, and Analogy. These principles assist scientists in assessing the likelihood of causation in complex biological contexts. Below is a summary of these concepts:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Family resources, resilience beliefs, and parental adaptation: A moderated mediation analysis.

Family process·2024

Same author

Exploring the factors contributing to parent stress symptoms during the COVID-19 pandemic in Europe: An ABC-X model approach.

Family process·2024

See all related articles

Search research articles

Related Experiment Video

Updated: Jul 16, 2026

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents

Published on: July 10, 2017

Under What Conditions Does Evidence Travel? Assessing Context Sensitivity and Generalizability in Cash Transfer

Anis Ben Brik^1,2

¹Faculty of Communication, Culture and Society, Institute of Communication and Public Policy, Università della Svizzera italiana, Lugano, Switzerland.

Evaluation Review

|July 14, 2026

Summary

Evidence-based policy often assumes interventions work everywhere. This study on cash transfer programs shows some effects are stable, but context significantly impacts outcomes, urging caution in cross-context predictions.

Keywords:

context sensitivity evaluation methodology evidence-based policy fragility index generalizability replication

Related Experiment Videos

Last Updated: Jul 16, 2026

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents

Published on: July 10, 2017

Area of Science:

Social Policy Research
Development Economics
Program Evaluation

Background:

The evidence-based policy movement relies on intervention replicability across diverse contexts.
Complex social programs may not exhibit universal effectiveness due to contextual factors.
Generalizability of rigorously evaluated interventions remains a critical question in policy science.

Purpose of the Study:

To assess the generalizability and contextual robustness of findings from cash transfer programs.
To evaluate the extent to which intervention effects replicate across different countries in the Middle East and North Africa.
To introduce and apply methodological tools for assessing evidence robustness in comparative policy research.

Main Methods:

Utilized leave-one-out cross-validation to test the stability of relationships.
Employed permutation tests to distinguish genuine patterns from chance findings.
Applied equivalence testing and fragility indices to quantify robustness and contextual sensitivity.
Analyzed data from 15 cash transfer programs across 12 Middle Eastern and North African countries.

Main Results:

Leave-one-out analysis showed high stability, with 100% of key relationships maintaining magnitude within 25% of full-sample estimates.
A strong correlation between transfer size and poverty reduction (r = 0.711, p < .001) demonstrated consistency.
Equivalence testing indicated that similar program designs can yield statistically distinct outcomes in 67% of comparisons.
Fragility indices (2-3) suggested moderate robustness for most observed relationships.

Conclusions:

While some core relationships in cash transfer programs exhibit stability, contextual factors significantly influence program effectiveness.
The assumption of universal intervention replication may be unwarranted for complex social programs.
Methodological tools were provided for robust evidence assessment in small-sample comparative studies, advocating for epistemic humility.