Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.2K
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

2.1K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.1K
Significance Testing: Overview01:04

Significance Testing: Overview

3.9K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.9K
Introduction to Test of Independence01:21

Introduction to Test of Independence

2.5K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.5K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

1.8K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.8K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

337
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
337

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

When Do Unifactorial Items Increase the Reliability?

Psychometrika·2026
Same author

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same author

Robust Bayesian multilevel meta-analysis: Adjusting for publication bias in the presence of dependent effect sizes.

Behavior research methods·2026
Same author

Comparing variable selection and model averaging methods for logistic regression.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Investigating the replicability of the social and behavioural sciences.

Nature·2026
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same journal

Planned missingness in intensive longitudinal studies: Extensions and comparisons of multiform designs.

Behavior research methods·2026
Same journal

A validity-guided workflow for robust large language model research in psychology.

Behavior research methods·2026
Same journal

Are 7-point Likert scales preferable to 5-point scales in language research?

Behavior research methods·2026
Same journal

Generative psychometrics via AI-GENIE: Automatic item generation and validation with network-integrated evaluation.

Behavior research methods·2026
Same journal

Exploring psychological tradeoffs: Developing and demonstrating an R Shiny app for Pareto optimization.

Behavior research methods·2026
Same journal

The performance of Bayesian fit measures in detecting misspecified multilevel structural equation modeling.

Behavior research methods·2026
See all related articles

Related Experiment Video

Updated: Sep 23, 2025

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

6.8K

A tutorial on Bayesian single-test reliability analysis with JASP.

Julius M Pfadt1, Don van den Bergh2, Klaas Sijtsma3

  • 1Department of Psychological Research Methods, University of Ulm, Ulm, Germany. julius.pfadt@gmail.com.

Behavior Research Methods
|May 17, 2022
PubMed
Summary
This summary is machine-generated.

This study introduces Bayesian reliability analysis in JASP, offering credible intervals and posterior distributions. This improves upon traditional methods by quantifying uncertainty in reliability estimates for better research practices.

Keywords:
Credible intervalMcDonald’s omega

More Related Videos

A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

21.2K
A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

13.8K

Related Experiment Videos

Last Updated: Sep 23, 2025

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

6.8K
A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

21.2K
A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

13.8K

Area of Science:

  • Psychometrics
  • Statistical analysis
  • Educational measurement

Background:

  • Current reliability analysis often relies solely on Cronbach's alpha.
  • Traditional methods focus on point estimates, neglecting sampling error's impact.
  • There is a need for more robust reliability estimation techniques.

Purpose of the Study:

  • To implement Bayesian estimation for five common single-test reliability coefficients.
  • To provide researchers with tools for quantifying uncertainty in reliability estimates.
  • To enhance the reporting of reliability analyses by including uncertainty.

Main Methods:

  • Utilized Bayesian estimation routines.
  • Integrated these routines into the JASP statistical software.
  • Focused on five popular single-test reliability coefficients.

Main Results:

  • JASP now offers Bayesian credible intervals for reliability coefficients.
  • Posterior distributions allow for probability assessments regarding reliability thresholds.
  • Researchers can easily obtain and interpret uncertainty estimates.

Conclusions:

  • Bayesian reliability analysis in JASP provides a more comprehensive understanding of reliability.
  • The software facilitates the inclusion of uncertainty estimates in research reporting.
  • This approach encourages improved practices in statistical analysis and psychometrics.