Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Coefficient of Correlation01:12

Coefficient of Correlation

6.4K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable x and the dependent variable y.
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
6.4K
Calculating and Interpreting the Linear Correlation Coefficient01:11

Calculating and Interpreting the Linear Correlation Coefficient

6.5K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
6.5K
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

547
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
547
Introduction to Test of Independence01:21

Introduction to Test of Independence

2.5K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.5K
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation01:24

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

738
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
738
Calibration Curves: Correlation Coefficient01:10

Calibration Curves: Correlation Coefficient

2.5K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
2.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same author

Reducing Attenuation Bias in Regression Analyses Involving Rating Scale Data via Psychometric Modeling.

Psychometrika·2026
Same author

Standard Errors for Reliability Coefficients.

Psychometrika·2025
Same author

Empirical Bayes Priors for MCMC Estimation of the Multivariate Social Relations Model.

Multivariate behavioral research·2025
Same author

A tutorial on estimating dynamic treatment regimes from observational longitudinal data using lavaan.

Psychological methods·2025
Same author

Interrater Reliability for Interdependent Social Network Data: A Generalizability Theory Approach.

Multivariate behavioral research·2025
Same journal

Bayesian Machine Learning Tools for Alcohol Use Disorder Research: The bpaup R Package.

Multivariate behavioral research·2026
Same journal

A Unified Framework for Jointly modelling Response Times and Item Position Effects in Computer-Based Learning Assessments.

Multivariate behavioral research·2026
Same journal

Generalizability Theory Applied to Daily Relationship Quality: Substantive and Statistical Directions.

Multivariate behavioral research·2026
Same journal

A Modularized Higher-Order Diagnostic Classification Model for Clustered Attribute Hierarchies.

Multivariate behavioral research·2026
Same journal

Generalizing Causal Effects to a Target Population Without Individual-Level Data from the Target Population.

Multivariate behavioral research·2026
Same journal

betaselectr: Selective (and Proper) Standardization in Structural Equation Models.

Multivariate behavioral research·2026
See all related articles

Related Experiment Video

Updated: Sep 19, 2025

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice
06:11

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice

Published on: October 19, 2019

20.2K

How to Estimate Intraclass Correlation Coefficients for Interrater Reliability from Planned Incomplete Data.

Debby Ten Hove1, Terrence D Jorgensen2, L Andries Van der Ark2

  • 1Faculty of Behavioural and Movement Sciences, Section of Educational Sciences, LEARN! Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.

Multivariate Behavioral Research
|June 17, 2025
PubMed
Summary
This summary is machine-generated.

This study compares methods for calculating intraclass correlation coefficients (ICCs) for observational data with missing values. Maximum likelihood estimation of random-effects models is recommended for accurate and feasible ICC estimation in behavioral research.

Keywords:
Generalizability theoryincomplete datainterrater reliabilityintraclass correlation coefficientsobservational researchplanned-missing designssimulation

More Related Videos

Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

27.3K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.6K

Related Experiment Videos

Last Updated: Sep 19, 2025

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice
06:11

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice

Published on: October 19, 2019

20.2K
Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

27.3K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.6K

Area of Science:

  • Behavioral Science
  • Psychometrics
  • Statistical Modeling

Background:

  • Interrater reliability (IRR) is crucial for observational data, often assessed using Intraclass Correlation Coefficients (ICCs).
  • Traditional ICC estimation methods using ANOVA are problematic with incomplete data, common in planned missing observational designs.
  • Behavioral research frequently employs planned missing designs, necessitating robust ICC estimation techniques for incomplete datasets.

Purpose of the Study:

  • To compare the computational accuracy and feasibility of three novel ICC estimation methods for planned incomplete observational data.
  • To identify the most reliable method for estimating ICCs in the presence of missing data within behavioral research contexts.

Main Methods:

  • Simulated planned incomplete data to mimic real-world observational studies.
  • Evaluated three estimation methods: Bayesian hierarchical linear models (MCMC), maximum likelihood (ML) for random-effects models, and ML for common-factor models.
  • Assessed computational accuracy (bias, RMSE, coverage) and feasibility (convergence, time).

Main Results:

  • Maximum likelihood estimation of random-effects models demonstrated superior performance across all evaluated criteria.
  • This method showed better accuracy in point and variability estimates and higher coverage rates compared to alternatives.
  • The study provides R code for practical application of these advanced ICC estimation techniques.

Conclusions:

  • Maximum likelihood estimation of random-effects models, particularly with Monte Carlo confidence intervals, is the preferred method for ICC estimation with incomplete observational data.
  • The findings offer practical guidance for researchers in behavioral sciences dealing with planned missing data.
  • Availability of R code facilitates the implementation of these improved statistical methods in future research.