Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Significance01:50

Statistical Significance

20.4K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.4K
Significance Testing: Overview01:04

Significance Testing: Overview

3.7K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.7K
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

2.1K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.1K
Behrens–Fisher Test00:57

Behrens–Fisher Test

132
The Behrens-Fisher test is a statistical method designed to address the Behrens-Fisher problem, which arises when comparing the means of two normally distributed populations with unequal variances. Unlike the Student's t-test, which assumes equal variances, the Behrens-Fisher test allows for mean comparison without this restrictive assumption. This flexibility makes it particularly valuable in scenarios where two independent samples exhibit normality but lack variance homogeneity.
This test...
132
Fisher's Exact Test01:08

Fisher's Exact Test

778
Fisher's exact test is a statistical significance test widely used to analyze 2x2 contingency tables, particularly in situations where sample sizes are small. Unlike the chi-squared test, which approximates P-values and assumes minimum expected frequencies of at least five in each cell, Fisher's exact test calculates the exact probability (P-value) of observing the data or more extreme results under the null hypothesis. This feature makes it especially valuable when the assumptions of...
778
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

1.8K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Assessing Growth of BACB Certificants (1999-2019).

Perspectives on behavior science·2024
Same author

Building a Social Justice Framework for Cultural and Linguistic Diversity in ABA.

Behavior analysis in practice·2022
Same author

Reconsideration of the type I error rate for psychological science in the era of replication.

Psychological methods·2022
Same author

Statistical Decision-Making Accuracies for Some Overlap- and Distance-based Measures for Single-Case Experimental Designs.

Perspectives on behavior science·2022
Same author

Behavioral Research with Planaria.

Perspectives on behavior science·2020
Same author

Automating Phase Change Lines and Their Labels Using Microsoft Excel<sup>(R)</sup>.

Behavior analysis in practice·2017

Related Experiment Video

Updated: Sep 6, 2025

Transauricular Vagus Nerve Stimulation and Electroencephalographic Assessment in Disorders of Consciousness
04:04

Transauricular Vagus Nerve Stimulation and Electroencephalographic Assessment in Disorders of Consciousness

Published on: July 11, 2025

260

Quantification of behavioral data with effect sizes and statistical significance tests.

Mack S Costello1, Raymond F Bagley1, Laura Fernández Bustamante1

  • 1Department of Psychology, Rider University.

Journal of Applied Behavior Analysis
|June 27, 2022
PubMed
Summary

Statistical tests and effect sizes enhance the analysis of single-case experimental designs (SCEDs). Combining visual analysis with statistical complements improves decision accuracy for behavioral data.

Keywords:
behavior analysiseffect sizesingle-case experimental designsingle-case research

More Related Videos

Battery of Behavioral Tests Assessing General Locomotion, Muscular Strength, and Coordination in Mice
06:54

Battery of Behavioral Tests Assessing General Locomotion, Muscular Strength, and Coordination in Mice

Published on: January 23, 2018

13.9K
Automated, Quantitative Cognitive/Behavioral Screening of Mice: For Genetics, Pharmacology, Animal Cognition and Undergraduate Instruction
16:23

Automated, Quantitative Cognitive/Behavioral Screening of Mice: For Genetics, Pharmacology, Animal Cognition and Undergraduate Instruction

Published on: February 26, 2014

14.5K

Related Experiment Videos

Last Updated: Sep 6, 2025

Transauricular Vagus Nerve Stimulation and Electroencephalographic Assessment in Disorders of Consciousness
04:04

Transauricular Vagus Nerve Stimulation and Electroencephalographic Assessment in Disorders of Consciousness

Published on: July 11, 2025

260
Battery of Behavioral Tests Assessing General Locomotion, Muscular Strength, and Coordination in Mice
06:54

Battery of Behavioral Tests Assessing General Locomotion, Muscular Strength, and Coordination in Mice

Published on: January 23, 2018

13.9K
Automated, Quantitative Cognitive/Behavioral Screening of Mice: For Genetics, Pharmacology, Animal Cognition and Undergraduate Instruction
16:23

Automated, Quantitative Cognitive/Behavioral Screening of Mice: For Genetics, Pharmacology, Animal Cognition and Undergraduate Instruction

Published on: February 26, 2014

14.5K

Area of Science:

  • Behavioral Science
  • Research Methodology

Background:

  • Single-case experimental designs (SCEDs) traditionally rely on visual analysis for interpreting behavioral data.
  • Quantifying results through statistical methods is increasingly advocated to enhance decision-making and inter-study communication.

Purpose of the Study:

  • To assess the agreement between traditional visual analysis and statistical significance tests/effect sizes for SCED data.
  • To evaluate the reliability of visual analysis in interpreting SCED results.

Main Methods:

  • 160 pairwise data sets from published SCED articles were analyzed by recruited visual analysts.
  • Visual analyses were compared against results from statistical significance tests (Tau-z, PWD) and effect sizes (RD, g).

Main Results:

  • One-tailed significance testing for Tau-z and percentage of pairwise differences in the predicted direction (PWD) showed general agreement.
  • These statistical measures complemented distance-based effect sizes like Ratio of Distances (RD) and g.
  • Visual analysis demonstrated some unreliability in interpreting SCED data.

Conclusions:

  • Statistical significance tests and effect sizes provide valuable quantitative complements to visual analysis in SCEDs.
  • Combining visual analysis with statistical methods can improve the accuracy and reliability of results interpretation.
  • The findings support the integration of statistical approaches for robust decision-making in SCED research.