Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Random and Systematic Errors01:20

Random and Systematic Errors

10.9K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
10.9K
Random Error01:04

Random Error

841
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
841
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

6.1K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.1K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

1.4K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.4K
Uncertainty in Measurement: Accuracy and Precision03:37

Uncertainty in Measurement: Accuracy and Precision

73.5K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. 
73.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Asymptotic standard errors for reliability coefficients in item response theory.

The British journal of mathematical and statistical psychology·2026
Same author

Enhancing Two-Stage Estimation in Differential Equation Models: A Bias-Correction Method via Stochastic Approximation.

Psychometrika·2026
Same author

Adventitious Error and Its Implications for Testing Relations Between Variables and for Composite Measurement Outcomes.

Psychometrika·2026
Same author

What does a <i>Z</i>-curve analysis tell us?

Cognition & emotion·2026
Same author

Depression and anxiety mediate the relationship between COVID-19 stay-at-home orders and tobacco and marijuana use.

PloS one·2025
Same author

A New Fit Assessment Framework for Common Factor Models Using Generalized Residuals.

Psychometrika·2025
Same journal

Proficiency order invariance of MLE, MAP, EAP, and WLE in item response theory.

The British journal of mathematical and statistical psychology·2026
Same journal

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same journal

Polychoric correlations under the assumption of elliptical latent traits.

The British journal of mathematical and statistical psychology·2026
Same journal

Regularized reduced rank regression for mixed predictor and response variables.

The British journal of mathematical and statistical psychology·2026
Same journal

A multiple-choice SDT model for cognitive diagnosis models.

The British journal of mathematical and statistical psychology·2026
Same journal

Modular item response and structural equation modelling via measurement and uncertainty preserving parametric modelling.

The British journal of mathematical and statistical psychology·2026
See all related articles

Related Experiment Video

Updated: Jun 10, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

714

On a general theoretical framework of reliability.

Yang Liu1, Jolynn Pek2, Alberto Maydeu-Olivares3,4

  • 1Department of Human Development and Quantitative Methodology, University of Maryland, College Park, Maryland, USA.

The British Journal of Mathematical and Statistical Psychology
|October 15, 2024
PubMed
Summary
This summary is machine-generated.

This study introduces a new theoretical framework for measuring reliability, focusing on the association between latent and observed scores. It extends existing methods and proposes four key criteria for evaluating reliability measures.

Keywords:
classical test theorylatent variable modellingmeasure of associationpredictionreliability

More Related Videos

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm
06:18

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm

Published on: October 20, 2022

2.0K
Experimental Research Examining How People Can Cope with Uncertainty Through Soft Haptic Sensations
09:07

Experimental Research Examining How People Can Cope with Uncertainty Through Soft Haptic Sensations

Published on: September 16, 2015

9.0K

Related Experiment Videos

Last Updated: Jun 10, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

714
The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm
06:18

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm

Published on: October 20, 2022

2.0K
Experimental Research Examining How People Can Cope with Uncertainty Through Soft Haptic Sensations
09:07

Experimental Research Examining How People Can Cope with Uncertainty Through Soft Haptic Sensations

Published on: September 16, 2015

9.0K

Area of Science:

  • Psychometrics
  • Statistical Modeling
  • Measurement Theory

Background:

  • Reliability is crucial for assessing how well observed scores reflect underlying constructs in measurement models.
  • Existing frameworks, like McDonald's regression approach, offer insights but can be extended.
  • A comprehensive understanding of reliability is essential for accurate data interpretation.

Purpose of the Study:

  • To present a generalized theoretical framework for reliability, emphasizing the association between latent and observed scores.
  • To extend McDonald's regression framework for reliability measurement.
  • To introduce and define four key desiderata for reliability measures: estimability, normalization, symmetry, and invariance.

Main Methods:

  • Developed a theoretical framework for reliability based on the association between latent and observed scores.
  • Extended McDonald's regression framework beyond coefficients of determination.
  • Introduced four desiderata for reliability measures.
  • Illustrated distinct reliability measures with theoretical examples.
  • Conducted a numerical study to examine the behavior of different reliability measures.

Main Results:

  • A generalized framework for reliability measurement was established.
  • Four essential desiderata for reliability measures were formally introduced.
  • Theoretical examples and a numerical study demonstrated the application and behavior of various reliability measures.
  • The study provides a broader perspective on reliability beyond traditional coefficients of determination.

Conclusions:

  • The proposed framework offers a more comprehensive approach to understanding and measuring reliability.
  • The four desiderata provide a robust foundation for evaluating the quality of reliability measures.
  • Further research is needed to explore the practical applications and implications of these findings in various fields.