Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

A new approach for interval estimation and hypothesis testing of a certain intraclass correlation coefficient: the

Lili Tian¹, Joseph C Cappelleri

¹Department of Statistics, Biostatistics Division, University of Florida, Gainesville 32610, USA. ltian@biostat.ufl.edu

Statistics in Medicine

|June 24, 2004

Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The one-month impact of influenza infection on patient-reported symptom burden among symptomatic U.S. adults with a test-confirmed illness: a longitudinal study.

BMC infectious diseases·2026

Same author

Treatment preferences of people with hemophilia and caregivers: a plain language summary.

Therapeutic advances in hematology·2026

Same author

Understanding Patient and Gastroenterologist Preferences at the Time of Treatment Escalation to First-Line Advanced Therapy in Ulcerative Colitis: A Discrete Choice Experiment in Five European Countries.

United European gastroenterology journal·2026

Same author

Impact of Comorbidities on Clinical Outcomes and Quality of Life of Patients With Hormone Receptor-Positive/Human Epidermal Growth Factor Receptor 2-Negative (HR+/HER2-) Advanced Breast Cancer Treated With Palbociclib in the POLARIS Study.

Cancer medicine·2026

Same author

Assessment of long COVID symptom burden in patients testing positive for SARS-CoV-2 at a nationwide retail pharmacy.

PloS one·2026

Same author

Treatment satisfaction, disease severity, and health-care use in patients with axial spondyloarthritis in the United States and Europe.

Rheumatology (Oxford, England)·2026

This study introduces a new method for assessing interrater reliability using generalized confidence intervals (GCI) and generalized P-values. The GCI approach offers a flexible way to estimate confidence intervals and test hypotheses for intraclass correlation coefficients.

Area of Science:

Statistics
Biostatistics
Psychometrics

Background:

Interrater reliability is crucial for study consistency.
Traditional methods for intraclass correlation coefficient (ICC) estimation have limitations.
Random selection of raters and subjects requires robust statistical approaches.

Purpose of the Study:

To develop and evaluate a novel method for interval estimation and hypothesis testing of the ICC.
To compare the performance of the generalized confidence interval (GCI) approach with the modified large sample (MLS) approach.
To provide a unified framework for inference on interrater reliability.

Main Methods:

Utilizing generalized confidence intervals (GCI) and generalized P-values.
Conducting a simulation study to assess coverage probabilities.

Related Experiment Videos

Comparing GCI with the modified large sample (MLS) method.

Main Results:

Both GCI and MLS approaches showed conservative coverage probabilities.
GCI provided coverage closer to nominal for two-sided intervals compared to MLS.
GCI demonstrated ease in generating P-values, unlike the MLS approach.

Conclusions:

The GCI approach is a viable and flexible tool for confidence interval estimation and hypothesis testing in interrater reliability studies.
GCI offers advantages in providing P-values, enhancing its utility for statistical inference.
This method is well-suited for situations involving random effects in reliability studies.