Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Significance01:37

Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
Significance Testing: Overview01:04

Significance Testing: Overview

Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with data...
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

On the difficulty of studying "Basic" behavioral processes in humans.

The Behavior analyst·2012
Same author

Where have all the behaviorists gone?

The Behavior analyst·2012
Same author

Praxics and behaviorism.

The Behavior analyst·2012
Same author

Tolerance to the effects of cocaine on performance under behavior-correlated reinforcement magnitude.

Journal of the experimental analysis of behavior·2001
Same author

Are responses in avoidance procedures "safety" signals?

Journal of the experimental analysis of behavior·2001
Same author

A comparison of fixed and variable doses of cocaine in producing and augmenting tolerance to its effects on schedule-controlled behavior.

Behavioural pharmacology·2001
Same journal

An Internal and Critical Review of the PEAK Relational Training System for Children with Autism and Related Intellectual Disabilities: 2014-2017.

The Behavior analyst·2020
Same journal

Self-Control Based on Soft Commitment.

The Behavior analyst·2020
Same journal

Behavioral Pragmatism: Making A Place for Reality and Truth.

The Behavior analyst·2020
Same journal

The Challenges of Integrating Behavioral and Neural Data: Bridging and Breaking Boundaries Across Levels of Analysis.

The Behavior analyst·2020
Same journal

Automating Scoring of Delay Discounting for the 21- and 27-Item Monetary Choice Questionnaires.

The Behavior analyst·2020
Same journal

The Future of Behavior Analysis: Foxes and Hedgehogs Revisited.

The Behavior analyst·2020
See all related articles

Related Experiment Video

Updated: May 23, 2026

A System for Tracking the Dynamics of Social Preference Behavior in Small Rodents
08:38

A System for Tracking the Dynamics of Social Preference Behavior in Small Rodents

Published on: November 21, 2019

Statistical inference in behavior analysis: Some things significance testing does and does not do.

M N Branch

    The Behavior Analyst
    |April 6, 2012
    PubMed
    Summary
    This summary is machine-generated.

    Statistical significance testing is often overestimated in behavioral science. It provides limited insight into finding reliability or the probability of chance results, hindering scientific progress.

    More Related Videos

    Rodent Behavioral Testing to Assess Functional Deficits Caused by Microelectrode Implantation in the Rat Motor Cortex
    10:42

    Rodent Behavioral Testing to Assess Functional Deficits Caused by Microelectrode Implantation in the Rat Motor Cortex

    Published on: August 18, 2018

    Strategies for Assessing Autistic-Like Behaviors in Mice
    07:38

    Strategies for Assessing Autistic-Like Behaviors in Mice

    Published on: September 20, 2024

    Related Experiment Videos

    Last Updated: May 23, 2026

    A System for Tracking the Dynamics of Social Preference Behavior in Small Rodents
    08:38

    A System for Tracking the Dynamics of Social Preference Behavior in Small Rodents

    Published on: November 21, 2019

    Rodent Behavioral Testing to Assess Functional Deficits Caused by Microelectrode Implantation in the Rat Motor Cortex
    10:42

    Rodent Behavioral Testing to Assess Functional Deficits Caused by Microelectrode Implantation in the Rat Motor Cortex

    Published on: August 18, 2018

    Strategies for Assessing Autistic-Like Behaviors in Mice
    07:38

    Strategies for Assessing Autistic-Like Behaviors in Mice

    Published on: September 20, 2024

    Area of Science:

    • Behavioral Science
    • Psychology
    • Behavior Analysis

    Background:

    • Significance testing is widely used in behavioral science research.
    • The interpretation and utility of significance testing are frequently debated.
    • Overreliance on statistical significance may impede scientific advancement.

    Purpose of the Study:

    • To critically evaluate the role and limitations of significance testing in behavioral science.
    • To highlight the potential negative impacts of overemphasizing statistical significance.
    • To advocate for a more nuanced approach to data interpretation in behavioral research.

    Main Methods:

    • Conceptual analysis of the role of significance testing.
    • Review of common practices and interpretations in behavioral science literature.
    • Discussion of alternative or complementary approaches to data evaluation.

    Main Results:

    • Significance testing does not reliably estimate finding reproducibility or the probability of chance occurrences.
    • Its application can narrow research questions, reduce scientific accountability, and de-emphasize individual behavior.
    • Overemphasis can lead to flawed theory testing and undermine data reliability, particularly in behavior analysis.

    Conclusions:

    • Statistical significance is a secondary consideration, not a primary outcome, in evaluating research findings.
    • A reduced emphasis on significance testing is recommended for advancing a robust science of behavior.
    • Researchers should prioritize direct data interpretation and reliability over arbitrary statistical thresholds.