Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.3K
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

559
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
559
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

1.1K
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
1.1K
Calibration Curves: Correlation Coefficient01:10

Calibration Curves: Correlation Coefficient

5.3K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
5.3K
Fisher's Exact Test01:08

Fisher's Exact Test

1.3K
Fisher's exact test is a statistical significance test widely used to analyze 2x2 contingency tables, particularly in situations where sample sizes are small. Unlike the chi-squared test, which approximates P-values and assumes minimum expected frequencies of at least five in each cell, Fisher's exact test calculates the exact probability (P-value) of observing the data or more extreme results under the null hypothesis. This feature makes it especially valuable when the assumptions of...
1.3K
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

1.6K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
1.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Data driven pathway analysis and forecast of global warming and sea level rise.

Scientific reports·2023
Same author

Alpha, FACTT, and Beyond.

Psychometrika·2021
Same author

Distributionally weighted least squares in structural equation modeling.

Psychological methods·2021
Same author

Psychometric Properties of the Kidney Disease Quality of Life 36-Item Short-Form Survey (KDQOL-36) in the United States.

American journal of kidney diseases : the official journal of the National Kidney Foundation·2017
Same author

Covariate-free and Covariate-dependent Reliability.

Psychometrika·2016
Same author

Exploratory Bi-factor Analysis: The Oblique Case.

Psychometrika·2016
Same journal

Bayesian evaluation for latent variable models: A tutorial on computing information criteria and bayes factors with the r package bleval.

Psychological methods·2026
Same journal

A stochastic block prior for clustering in graphical models.

Psychological methods·2026
Same journal

Three-level vector autoregressive models.

Psychological methods·2026
Same journal

Scaling cognitive modeling to big data: A deep learning approach to studying individual differences in evidence accumulation model parameters.

Psychological methods·2026
Same journal

Best practices in multilevel modeling for within-cluster group comparisons: An evaluation of coding strategies reflecting group composition and heterogeneity.

Psychological methods·2026
Same journal

A unified framework for psychometrics in experimental psychology: The standardized generalized hierarchical factor model.

Psychological methods·2026
See all related articles

Related Experiment Video

Updated: Mar 13, 2026

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.6K

Specificity-enhanced reliability coefficients.

Peter M Bentler1

  • 1Departments of Psychology and Statistics, University of California.

Psychological Methods
|October 13, 2016
PubMed
Summary
This summary is machine-generated.

Classical reliability coefficients underestimate true reliability by omitting specific variance. This study introduces specificity-enhanced coefficients, offering a more accurate measure of internal consistency and predictive validity in psychometric assessments.

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Author Spotlight: Expanding the Scope of Multiplex Immunoassays for Lyme Borreliosis Diagnostics and Pathogen Research
05:25

Author Spotlight: Expanding the Scope of Multiplex Immunoassays for Lyme Borreliosis Diagnostics and Pathogen Research

Published on: July 14, 2023

2.0K

Related Experiment Videos

Last Updated: Mar 13, 2026

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.6K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Author Spotlight: Expanding the Scope of Multiplex Immunoassays for Lyme Borreliosis Diagnostics and Pathogen Research
05:25

Author Spotlight: Expanding the Scope of Multiplex Immunoassays for Lyme Borreliosis Diagnostics and Pathogen Research

Published on: July 14, 2023

2.0K

Area of Science:

  • Psychometrics
  • Psychological Measurement
  • Statistical Modeling

Background:

  • Classical test theory reliability coefficients (e.g., alpha, omega) are calculated as ratios of common variance to total variance.
  • These traditional coefficients omit specific variance, leading to downward bias and potentially poor prediction of external criteria.
  • Existing reliability measures may not fully capture the nuanced content represented by assessment items.

Purpose of the Study:

  • To propose and illustrate methods for incorporating specific variance into reliability estimates.
  • To introduce new specificity-enhanced reliability coefficients (e.g., alpha+, omega+).
  • To extend classical psychometric formulas (e.g., correction for attenuation, Spearman-Brown) to include specific variance.

Main Methods:

  • Development of novel formulas to compute specificity-enhanced reliability coefficients.
  • Application of these enhanced formulas to existing psychometric data.
  • Extension of established reliability and validity adjustment formulas to accommodate specific variance.

Main Results:

  • Specificity-enhanced coefficients (α+, ω+, λ₄+, ρxx+, ρglb+) provide improved estimates of reliability.
  • These enhanced coefficients offer a more accurate representation of internal consistency compared to classical measures.
  • The proposed methods allow for the quantification of item specificity, reflecting nuanced content facets.

Conclusions:

  • Specificity-enhanced reliability coefficients offer a more comprehensive and accurate assessment of psychometric properties.
  • Reporting these enhanced coefficients alongside classical ones may be beneficial for a fuller understanding of reliability.
  • The inclusion of specific variance enhances the potential predictive validity of reliability estimates and clarifies item content representation.