Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
Coefficient of Correlation01:12

Coefficient of Correlation

8.4K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable x and the dependent variable y.
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
8.4K
Correlation and Regression00:53

Correlation and Regression

3.0K
In statistics, correlation describes the degree of association between two variables. In the subfield of linear regression, correlation is mathematically expressed by the correlation coefficient, which describes the strength and direction of the relationship between two variables. The coefficient is symbolically represented by 'r' and ranges from -1 to +1. A positive value indicates a positive correlation where the two variables move in the same direction. A negative value suggests a...
3.0K
Calculating and Interpreting the Linear Correlation Coefficient01:11

Calculating and Interpreting the Linear Correlation Coefficient

7.9K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
7.9K
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

1.4K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
1.4K
Correlations02:20

Correlations

35.8K
Correlation means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A correlation coefficient is a number from -1 to +1 that indicates the strength and direction of the relationship between...
35.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Training Community Health Workers for Diabetes Management in Low- and Middle-Income Countries: Systematic Review.

JMIR diabetes·2026
Same author

Detecting association changes in intensive longitudinal data in real time: An exponentially weighted moving average procedure.

The British journal of mathematical and statistical psychology·2026
Same author

From tetrachoric to kappa: How to assess reliability on binary scales.

The British journal of mathematical and statistical psychology·2025
Same author

Sample size determination for hypothesis testing on the intraclass correlation coefficient in a two-way analysis of variance model.

The British journal of mathematical and statistical psychology·2025
Same author

New developments in experience sampling methodology.

The British journal of mathematical and statistical psychology·2025
Same author

Consistency of perceptual response variability in size estimation and reproduction tasks.

Behavior research methods·2025
Same journal

Bayesian evaluation for latent variable models: A tutorial on computing information criteria and bayes factors with the r package bleval.

Psychological methods·2026
Same journal

A stochastic block prior for clustering in graphical models.

Psychological methods·2026
Same journal

Three-level vector autoregressive models.

Psychological methods·2026
Same journal

Scaling cognitive modeling to big data: A deep learning approach to studying individual differences in evidence accumulation model parameters.

Psychological methods·2026
Same journal

Best practices in multilevel modeling for within-cluster group comparisons: An evaluation of coding strategies reflecting group composition and heterogeneity.

Psychological methods·2026
Same journal

A unified framework for psychometrics in experimental psychology: The standardized generalized hierarchical factor model.

Psychological methods·2026
See all related articles

Related Experiment Video

Updated: Jan 18, 2026

Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.3K

Reliability for multilevel data: A correlation approach.

Tzu-Yao Lin1, Francis Tuerlinckx2, Sophie Vanbelle1

  • 1Department of Methodology and Statistics, Care and Public Health Research Institute, Faculty of Health, Medicine and Life Sciences, Maastricht University.

Psychological Methods
|May 22, 2025
PubMed
Summary
This summary is machine-generated.

This study introduces a new method for measuring reliability in multilevel data, addressing inconsistencies in existing approaches for psychology and medicine. The proposed technique calculates the expected correlation between repeated measurements for more accurate reliability assessment.

More Related Videos

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.4K
Studying Metabolic Brain Connectivity Using 2-Deoxy-2-[18F]Fluoro-D-Glucose Dynamic Positron Emission Tomography at the Single-subject Level
07:28

Studying Metabolic Brain Connectivity Using 2-Deoxy-2-[18F]Fluoro-D-Glucose Dynamic Positron Emission Tomography at the Single-subject Level

Published on: January 24, 2025

673

Related Experiment Videos

Last Updated: Jan 18, 2026

Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.3K
Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.4K
Studying Metabolic Brain Connectivity Using 2-Deoxy-2-[18F]Fluoro-D-Glucose Dynamic Positron Emission Tomography at the Single-subject Level
07:28

Studying Metabolic Brain Connectivity Using 2-Deoxy-2-[18F]Fluoro-D-Glucose Dynamic Positron Emission Tomography at the Single-subject Level

Published on: January 24, 2025

673

Area of Science:

  • Psychometrics
  • Multilevel Modeling
  • Generalizability Theory

Background:

  • Reliability of measurement instruments is crucial in psychology and medicine.
  • Existing reliability coefficients are limited for nested or multilevel data.
  • Recent generalizability theory approaches by Schönbrodt et al. (2022) and ten Hove et al. (2022) show inconsistencies for cluster-level reliability.

Purpose of the Study:

  • To propose an alternative approach for defining reliability coefficients in multilevel data.
  • To address inconsistencies in current methods for quantifying reliability in nested designs.
  • To compare the proposed method with existing approaches.

Main Methods:

  • Developing a novel approach based on the expected correlation between repeated measurements.
  • Analyzing common nested data structures: (a) raters crossed with persons/clusters, persons nested in clusters; (b) raters nested in persons/clusters; (c) persons nested in clusters, crossed with raters/days.
  • Comparing the proposed method with Schönbrodt et al. (2022) and ten Hove et al. (2022).

Main Results:

  • The proposed method offers a consistent definition of reliability coefficients for multilevel data.
  • Identified and explained differences between the proposed approach and existing methods.
  • Demonstrated the application across various common nested data structures.

Conclusions:

  • The proposed approach provides a more accurate and consistent way to assess reliability in multilevel settings.
  • Highlights the need for refined methods in psychometrics for complex data structures.
  • Offers a valuable alternative for researchers dealing with nested data in psychology and medicine.