Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Assessing rater agreement using marginal association models.

Susan M Perkins1, Mark P Becker

  • 1Division of Biostatistics, Indiana University, 1050 Wishard Blvd., RG 4101, Indianapolis, IN 46202-2872, USA. sperkin1@iupui.edu

Statistics in Medicine
|July 12, 2002
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Sport-Related Head Exposure Characteristics and Health Outcomes in Former Collegiate Athletes: A CARE Consortium Study.

Neurology·2026
Same author

Reporting Guidelines for Music-Based Interventions: An Update and Validation Study: Secondary publication.

Global advances in integrative medicine and health·2025
Same author

Reporting Guidelines for Music-Based Interventions Checklist: Explanation and Elaboration Guide: Secondary publication.

Global advances in integrative medicine and health·2025
Same author

The cumulative effects of a collegiate athletic career on general health measures: findings from the CARE Consortium.

Brain injury·2025
Same author

Effect of Personalized Risk Messages on Uptake of Colorectal Cancer Screening : A Randomized Controlled Trial.

Annals of internal medicine·2025
Same author

Reporting guidelines for music-based interventions checklist: Explanation and elaboration guide.

Integrative medicine research·2025
Same journal

Interpretable Bayesian Modeling for Multireader Multicase Studies: Addressing Overdispersion and Limited Sample Size in Diagnostic Enhancement Evaluation.

Statistics in medicine·2026
Same journal

Adaptive Sequential Multiple Hypotheses Testing for Concomitant Vaccine Safety Surveillance.

Statistics in medicine·2026
Same journal

Novel Distance Regression for Repeated Outcomes With Missing Data: Applications to Longitudinal and Crossover Studies of Microbiome Beta-Diversity.

Statistics in medicine·2026
Same journal

Optimal Weighted Tests for Replication Studies and the 'Two-Trials Rule' With Multiple Hypotheses.

Statistics in medicine·2026
Same journal

Identifiable Copula-Double-Cox Models: A Fully Parametric Framework for Dependent Right-Censored Survival Data.

Statistics in medicine·2026
Same journal

Moving From Individualized Risk-Based Prevention to Benefit-Based Prevention: Estimating Individualized Life-Years Gained From Prevention Services as a Basis for Eligibility.

Statistics in medicine·2026
See all related articles

New statistical models enhance rater agreement assessment for ordered scales. They analyze response frequencies and category-specific agreement, improving reliability in subjective evaluations.

Area of Science:

  • Statistics
  • Psychometrics
  • Data Analysis

Background:

  • Assessing rater agreement is crucial for reliable data, especially with ordered or partially ordered scales.
  • Existing models may not fully capture nuanced aspects of agreement, such as response distribution and category-specific concordance.

Purpose of the Study:

  • To introduce novel statistical models for evaluating rater agreement.
  • To address both overall response frequencies and specific category agreement among raters.

Main Methods:

  • Development of models for ordered or partially ordered rating scales.
  • Simultaneous modeling of univariate marginal responses and bivariate marginal associations in K-way contingency tables.
  • Utilizing generalized log non-linear models for association analysis.

Related Experiment Videos

Main Results:

  • The models effectively differentiate between overall rater response frequencies and pairwise category agreement.
  • Univariate marginals assess overall response distribution, while bivariate marginals evaluate category-wise agreement.
  • Generalized log non-linear models aid in assessing category distinguishability.

Conclusions:

  • The proposed models offer a comprehensive framework for rater agreement assessment.
  • They provide valuable insights into both general and specific concordance among raters.
  • These methods enhance the reliability and validity of assessments using ordered rating scales.