Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Uncertainty in Measurement: Accuracy and Precision03:37

Uncertainty in Measurement: Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Uncertainty in Measurement: Reading Instruments02:46

Uncertainty in Measurement: Reading Instruments

Counting is the type of measurement that is free from uncertainty, provided the number of objects being counted does not change during the process. Such measurements result in exact numbers. By counting the eggs in a carton, for instance, one can determine exactly how many eggs are there in the carton. Similarly, the numbers of defined quantities are also exact. For example, 1 foot is exactly 12 inches, 1 inch is exactly 2.54 centimeters, and 1 gram is exactly 0.001 kilograms. Quantities...
Accuracy and Precision01:52

Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.  Highly accurate measurements...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

On Estimating the Precision of Individual Test Scores: A Note on Pfadt, Molenaar, Hurks, and Sijtsma.

Psychometrika·2026
Same author

Proportion Explained Component Variance in Second-Order Scales: A Note on a Latent Variable Modeling Approach.

Educational and psychological measurement·2025
Same author

The One-Parameter Logistic Model Can Be True With Zero Probability for a Unidimensional Measuring Instrument: How One Could Go Wrong Removing Items Not Satisfying the Model.

Educational and psychological measurement·2025
Same author

Evaluating Change in Adjusted <i>R</i>-Square and <i>R</i>-Square Indices: A Latent Variable Method Application.

Educational and psychological measurement·2025
Same author

Fatigue in hematological cancer changes across chemotherapy trajectory within the context of IL-6, not hemoglobin level: evidence from growth curve modeling.

Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer·2025
Same author

An Omega-Hierarchical Extension Index for Second-Order Constructs With Hierarchical Measuring Instruments.

Educational and psychological measurement·2025

Related Experiment Video

Updated: Jul 14, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Reliability of multiple-component measuring instruments: improved evaluation in repeated measure designs.

Tenko Raykov1

  • 1Measurement and Quantitative Methods, Michigan State University,443A Erickson Hall, East Lansing, MI 48824, USA. raykov@msu.edu

The British Journal of Mathematical and Statistical Psychology
|May 31, 2007
PubMed
Summary

This study introduces a new covariance analysis for composite reliability in repeated measures, improving accuracy by accounting for specificity variance. The method enhances measurement reliability testing over time and estimates changes in reliability coefficients.

More Related Videos

Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
09:18

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Jul 14, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
09:18

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting

Published on: December 15, 2023

Area of Science:

  • Psychometrics
  • Statistical Modeling
  • Cognitive Psychology

Background:

  • Composite reliability is crucial for assessing measurement accuracy in repeated measure designs.
  • Existing methods may not adequately account for specificity variance or test reliability over time.
  • Accurate estimation of reliability is essential for interpreting changes in cognitive intervention studies.

Purpose of the Study:

  • To present a covariance structure analysis method for improved point and interval estimation of composite reliability.
  • To account for specificity variance in reliability estimation.
  • To enable testing of time-invariance in the reliability of multi-component instruments.

Main Methods:

  • Covariance structure analysis was employed.
  • The method specifically addresses specificity variance.
  • It allows for the ratio of 'pure' measurement error variance to observed scale score variance to be tested.
  • Interval estimation of differences in reliability coefficients across assessment occasions is provided.

Main Results:

  • The proposed method offers improved point and interval estimation of composite reliability.
  • It successfully accounts for specificity variance.
  • Time-invariance of reliability for multi-component instruments can be tested.
  • The procedure facilitates interval estimation of reliability differences across time points.

Conclusions:

  • The covariance structure analysis method provides a robust approach to composite reliability estimation in repeated measures.
  • This method enhances the assessment of measurement instrument reliability over time.
  • The technique is valuable for analyzing data from cognitive intervention studies and similar research designs.