Weighing People Rather Than Food: A Framework for Examining External Validity.

Area of Science:

• Psychological Science
• Research Methodology

Background:

• Psychological science training prioritizes internal validity but lacks rigorous methods for external validity.
• The trade-offs between internal and external validity are not consistently addressed across all research areas.

Purpose of the Study:

• To introduce a systematic framework for evaluating external validity in psychological research.
• To enhance the generalizability of research findings by considering populations, settings, outcomes, and timeframes.
• To encourage greater attention to external validity in study design, data analysis, and reporting.

Main Methods:

• A conceptual framework for external validity is presented, focusing on four key domains: populations, settings, outcomes, and timeframes.
• The framework is illustrated by reviewing mindless eating interventions for weight loss.
• Analysis involves assessing the alignment of study parameters with real-world application.

Main Results:

• Existing research on mindless eating interventions often fails to use appropriate populations (e.g., overweight individuals), outcomes (e.g., weight change), settings (e.g., home environments), or timeframes (e.g., sustained follow-up).
• This misalignment limits the demonstrated applicability of findings to the general public.
• The review highlights a general deficit in demonstrating empirical support for practical advice due to poor external validity.

Conclusions:

• Psychological scientists should prioritize external validity in designing, analyzing, and reporting studies to ensure findings are generalizable.
• Editors and reviewers should hold researchers accountable for demonstrating the external validity of their work.
• Applying the proposed framework can lead to more practically relevant and impactful psychological science.