Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Factorial Design02:01

Factorial Design

Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
Theory of Attribution II: Kelley's Covariation Theory01:29

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
Determination of Expected Frequency01:08

Determination of Expected Frequency

Suppose one wants to test independence between the two variables of a contingency table. The values in the table constitute the observed frequencies of the dataset. But how does one determine the expected frequency of the dataset? One of the important assumptions is that the two variables are independent, which means the variables do not influence each other. For independent variables, the statistical probability of any event involving both variables is calculated by multiplying the individual...
Goodness-of-Fit Test01:16

Goodness-of-Fit Test

The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Multidisciplinary team care and outcomes in FNCLCC grade 3 soft tissue sarcoma: a propensity score-matched and weighted cohort study.

Frontiers in oncology·2026
Same author

Development and temporal validation of a machine learning-based model to predict postoperative recurrence and guide adjuvant radiotherapy in patients with soft tissue sarcoma: a retrospective cohort study.

American journal of cancer research·2026
Same author

Clinical predictors of tocilizumab response in moderate-to-severe thyroid eye disease: a large single-center retrospective cohort study.

Frontiers in endocrinology·2026
Same author

Effect of 0.01% Atropine on Choroidal Thickness and Ocular Growth in Pre-myopic Children.

Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians (Optometrists)·2026
Same author

Early Low-Dose Rituximab for Mild-to-Moderate Thyroid Eye Disease: A Preliminary Evaluation of Efficacy and Safety.

International journal of endocrinology·2026
Same author

Exploring potential therapeutic targets for myopia: Causal analysis and biological annotation with gut microbiota.

Computational biology and chemistry·2025

Related Experiment Video

Updated: Jun 4, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Estimation of reliability in a three-factor model.

Luqiang Wang1, Kevin John Keen, Burt Holland

  • 1Department of Statistics, Temple University, Philadelphia, PA, USA.

Statistics in Medicine
|February 4, 2011
PubMed
Summary
This summary is machine-generated.

This study extends intraclass correlation coefficient (ICC) estimation to three-factor models, crucial for medical research reliability. New methods provide point and confidence interval estimates for complex subject, rater, and occasion interactions.

More Related Videos

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

Related Experiment Videos

Last Updated: Jun 4, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Reliability measures are essential for assessing consistency in data collection.
  • Existing reliability measures are well-established for two-factor models.
  • Complex research designs often involve multiple sources of variation.

Purpose of the Study:

  • To extend point and confidence interval estimation of the intraclass correlation coefficient (ICC).
  • To address models with three crossed random factors: subjects, raters, and occasions.
  • To provide robust reliability estimates for intricate medical research scenarios.

Main Methods:

  • Utilized analysis of variance (ANOVA) techniques for estimation.
  • Employed Monte Carlo Markov chain (MCMC) methods for robust estimation.
  • Extended established statistical frameworks to accommodate three-factor models.

Main Results:

  • Successfully developed methods for estimating ICC in three-factor models.
  • Provided both point estimates and confidence intervals for reliability.
  • Demonstrated the applicability of ANOVA and MCMC approaches.

Conclusions:

  • The proposed methods offer enhanced reliability assessment for complex designs.
  • Findings are particularly relevant for medical research involving subjects, raters, and repeated measures.
  • The study advances the statistical methodology for evaluating measurement consistency.