Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bonferroni Test01:10

Bonferroni Test

3.0K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.0K
Introduction to Test of Independence01:21

Introduction to Test of Independence

2.6K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.6K
Wilcoxon Rank-Sum Test01:21

Wilcoxon Rank-Sum Test

459
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:
459
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

705
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
705
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

5.0K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
5.0K
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

1.2K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
1.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same author

Robust Bayesian multilevel meta-analysis: Adjusting for publication bias in the presence of dependent effect sizes.

Behavior research methods·2026
Same author

Investigating the replicability of the social and behavioural sciences.

Nature·2026
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same author

Recognize the Value of the Sum Score, Psychometrics' Greatest Accomplishment.

Psychometrika·2026
Same author

Proof of Reliability Convergence to 1 at Rate of Spearman-Brown Formula for Random Test Forms and Irrespective of Item Pool Dimensionality.

Psychometrika·2026
Same journal

Bayesian Machine Learning Tools for Alcohol Use Disorder Research: The bpaup R Package.

Multivariate behavioral research·2026
Same journal

A Unified Framework for Jointly modelling Response Times and Item Position Effects in Computer-Based Learning Assessments.

Multivariate behavioral research·2026
Same journal

Generalizability Theory Applied to Daily Relationship Quality: Substantive and Statistical Directions.

Multivariate behavioral research·2026
Same journal

A Modularized Higher-Order Diagnostic Classification Model for Clustered Attribute Hierarchies.

Multivariate behavioral research·2026
Same journal

Generalizing Causal Effects to a Target Population Without Individual-Level Data from the Target Population.

Multivariate behavioral research·2026
Same journal

betaselectr: Selective (and Proper) Standardization in Structural Equation Models.

Multivariate behavioral research·2026
See all related articles

Related Experiment Video

Updated: Nov 11, 2025

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.2K

Bayesian Estimation of Single-Test Reliability Coefficients.

Julius M Pfadt1, Don van den Bergh2, Klaas Sijtsma3

  • 1Department of Psychological Research Methods, Ulm University.

Multivariate Behavioral Research
|March 24, 2021
PubMed
Summary
This summary is machine-generated.

This study introduces a Bayesian framework for estimating test reliability measures like coefficient alpha and omega. Bayesian credible intervals closely match frequentist confidence intervals, offering a probabilistic approach to understanding reliability uncertainty.

Keywords:
Bayesian reliability estimationCronbach’s alphaGuttman’s lambda-2McDonald’s omegagreatest lower boundinverse Wishart distribution

More Related Videos

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.6K
How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

7.0K

Related Experiment Videos

Last Updated: Nov 11, 2025

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.2K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.6K
How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

7.0K

Area of Science:

  • Psychometrics
  • Statistical Modeling
  • Psychological Measurement

Background:

  • Reliability is crucial for accurate psychological assessment.
  • Common reliability measures include coefficient alpha, lambda 2, greatest lower bound (glb), and omega.
  • Estimating reliability often involves frequentist approaches.

Purpose of the Study:

  • To demonstrate the estimation of key reliability measures within a Bayesian framework.
  • To compare Bayesian credible intervals with frequentist bootstrap confidence intervals.
  • To illustrate the utility of posterior distributions for practical reliability questions.

Main Methods:

  • Bayesian estimation of reliability coefficients (alpha, lambda 2, glb, omega).
  • Utilizing Gibbs sampling for posterior distribution derivation.
  • Employing inverse Wishart distribution for covariance matrices and single-factor CFA models for coefficient omega.

Main Results:

  • Bayesian credible intervals showed high similarity to frequentist bootstrap confidence intervals.
  • Posterior distributions allow for probabilistic answers to questions about reliability ranges.
  • The Bayesian approach effectively quantifies uncertainty in reliability estimation.

Conclusions:

  • Bayesian methods provide a viable and informative alternative for estimating test reliability.
  • The posterior distribution enhances the interpretation of reliability by highlighting uncertainty.
  • This framework facilitates more nuanced decision-making regarding test quality and score interpretation.