Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Fundamental Attribution Error01:14

Fundamental Attribution Error

13.5K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
13.5K
Case Studies01:22

Case Studies

13.0K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
13.0K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

6.7K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
6.7K
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

1.1K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.1K
Generalized Anxiety Disorder01:30

Generalized Anxiety Disorder

435
Generalized Anxiety Disorder (GAD) is a chronic condition characterized by excessive and uncontrollable worry that persists for at least six months, significantly interfering with daily functioning. Unlike situational anxiety, which arises in response to specific stressors, GAD often occurs without a clear cause. Individuals may experience disproportionate worry about work, health, or relationships. For instance, a person might continuously fear poor health despite normal medical evaluations or...
435
Reliability and Validity01:29

Reliability and Validity

13.5K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Integrating explanation and prediction in computational social science.

Nature·2021
Same author

Decoding brain activity using a large-scale probabilistic functional-anatomical atlas of human cognition.

PLoS computational biology·2017
Same author

BIDS apps: Improving ease of use, accessibility, and reproducibility of neuroimaging data analysis methods.

PLoS computational biology·2017
Same author

Large-Scale Meta-Analysis of Human Medial Frontal Cortex Reveals Tripartite Functional Organization.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2016
Same author

Pain in the ACC?

Proceedings of the National Academy of Sciences of the United States of America·2016
Same author

Regional specialization within the human striatum for diverse psychological functions.

Proceedings of the National Academy of Sciences of the United States of America·2016
Same journal

Are language models models?

The Behavioral and brain sciences·2026
Same journal

Large language models illuminate the mechanistic underpinnings of the creative aspect of language use (CALU), long regarded as a mystery.

The Behavioral and brain sciences·2026
Same journal

LLMs as a platform for studying constraint interaction: Motivation and challenges.

The Behavioral and brain sciences·2026
Same journal

Beyond the data gap: Children create languages, violate their input statistics, and exhibit critical periods.

The Behavioral and brain sciences·2026
Same journal

Not-so-strange love: Language models and generative linguistic theories are more compatible than they appear.

The Behavioral and brain sciences·2026
Same journal

Rich data drive generalization: Lessons from machine learning for linguistics and cognitive science.

The Behavioral and brain sciences·2026
See all related articles

Related Experiment Video

Updated: Nov 25, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.1K

The generalizability crisis.

Tal Yarkoni1

  • 1Department of Psychology, The University of Texas at Austin, Austin, TX78712-1043, USAtyarkoni@gmail.com.

The Behavioral and Brain Sciences
|December 21, 2020
PubMed
Summary
This summary is machine-generated.

Many psychology studies misalign verbal hypotheses with statistical models, particularly linear mixed models. This mismatch, especially with under-specified random effects, can inflate false positives and hinder generalizability, contributing to the replication crisis.

Keywords:
Generalizationinferencephilosophy of sciencepsychologyrandom effectsstatistics

More Related Videos

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
07:43

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios

Published on: August 4, 2023

2.5K
The Resident-intruder Paradigm: A Standardized Test for Aggression, Violence and Social Stress
09:12

The Resident-intruder Paradigm: A Standardized Test for Aggression, Violence and Social Stress

Published on: July 4, 2013

71.9K

Related Experiment Videos

Last Updated: Nov 25, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.1K
Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
07:43

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios

Published on: August 4, 2023

2.5K
The Resident-intruder Paradigm: A Standardized Test for Aggression, Violence and Social Stress
09:12

The Resident-intruder Paradigm: A Standardized Test for Aggression, Violence and Social Stress

Published on: July 4, 2013

71.9K

Area of Science:

  • Psychology
  • Statistical Inference
  • Quantitative Research Methods

Background:

  • Psychological theories are primarily verbal, but their empirical evaluation relies heavily on statistical inference.
  • The validity of translating verbal hypotheses into quantitative analysis hinges on the alignment between verbal and statistical expressions.
  • Current practices in psychological research often exhibit a disconnect between theoretical claims and their statistical operationalization.

Purpose of the Study:

  • To investigate the consequences of misaligning verbal hypotheses with statistical models in psychology.
  • To examine how the under-specification of random effects in linear mixed models impacts the generalizability of research findings.
  • To explore the role of this misalignment in psychological research's ongoing challenges, including the replication crisis.

Main Methods:

  • Analysis of the application of statistical inference in psychology, with a focus on linear mixed models.
  • Examination of the common practice of using 'random effect' formalism for intersubject variability.
  • Critique of the under-specification of random effects for other variables intended for generalization (e.g., stimuli, tasks, sites).

Main Results:

  • Many psychological studies fail to align verbal hypotheses with their statistical operationalization, particularly within linear mixed models.
  • Under-specification of random effects restricts the generalizability of findings more than researchers typically acknowledge.
  • This misalignment can significantly increase false-positive rates and lead to unsupported broad verbal generalizations.

Conclusions:

  • The lack of alignment between verbal and statistical hypothesis expressions is a core issue in psychological research.
  • Addressing this gap is crucial for improving the validity and replicability of psychological findings.
  • Potential improvements include more rigorous statistical operationalization and careful consideration of generalization intentions.