Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Mixed-effect models to assess consistency and reliability across multiple evaluations.

Tzu-Cheg Kao1, Yvonne Sparling, James Rochon

  • 1Division of Epidemiology and Biostatistics, Department of Preventive Medicine and Biometrics, Uniformed Services University of the Health Sciences, Bethesda, Maryland 20814, USA. tkao@usuhs.mil

Journal of Biopharmaceutical Statistics
|August 19, 2003
PubMed
Summary

This study introduces a method to assess consistency and reliability in clinical trials using intraclass correlation (ICC). It applies mixed-effects models to evaluate paired data, ensuring reliable measurements in research.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Risk of First Adjustment Disorder in U.S. Army Soldiers.

Military medicine·2026
Same author

Association of Social Network Size and Attachment Style With Future Suicide Attempt Among US Army Soldiers.

Clinical psychology & psychotherapy·2026
Same author

Suicidal Behavior in US Army Special Operations Forces.

JAMA network open·2025
Same author

Risk of Suicide Attempt in US Army Infantry, Combat Engineer, and Combat Medic Soldiers.

Military medicine·2025
Same author

Undetected suicide attempts among U.S. soldiers: results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).

Psychological medicine·2024
Same author

Cognition and saccadic eye movement performance are impaired in chronic rhinosinusitis.

International forum of allergy & rhinology·2024

Area of Science:

  • Biostatistics
  • Clinical Trial Methodology
  • Reliability Analysis

Background:

  • Consistency and reliability are critical issues in applied clinical trials.
  • Existing literature addresses these concerns, but specific methods for continuous variables are detailed here.
  • The need for robust statistical approaches to evaluate measurement consistency is paramount.

Purpose of the Study:

  • To describe a statistical process for assessing the consistency of mean and variance between evaluations for continuous random variables.
  • To derive and apply the intraclass correlation (ICC) for evaluating the consistency of paired data distributions.
  • To provide a practical framework, illustrated with real-world data, for reliability assessment in clinical studies.

Main Methods:

  • Utilized mixed-effects linear models to analyze paired data.

Related Experiment Videos

  • Derived the intraclass correlation (ICC) as a measure of consistency.
  • Applied these methods to dietary recall data from the Girls health Enrichment Multi-site Studies (GEMS).

    • Main Results:

    • Demonstrated a process to statistically evaluate if the mean and variance remain consistent across evaluations.
    • Successfully applied ICC to assess the reliability of paired measurements in the GEMS dataset.
    • The proposed methods offer a quantitative approach to reliability in clinical trial data.

    Conclusions:

    • The described statistical procedures, including ICC and mixed-effects models, effectively assess the consistency of continuous variables in clinical trials.
    • The methodology is applicable to paired data and can be generalized to incorporate additional design factors and covariates.
    • This work provides valuable tools and insights for improving the reliability and validity of clinical research findings.