Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

On assessing interrater agreement for multiple attribute responses.

L L Kupper1, K B Hafner

  • 1Department of Biostatistics, School of Public Health, University of North Carolina, Chapel Hill 27599-7400.

Biometrics
|September 1, 1989
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

National study of physical and sexual assault among women with disabilities.

Injury prevention : journal of the International Society for Child and Adolescent Injury Prevention·2008
Same author

Predictors of occupational exposure to styrene and styrene-7,8-oxide in the reinforced plastics industry.

Occupational and environmental medicine·2006
Same author

Air samples versus biomarkers for epidemiology.

Occupational and environmental medicine·2005
Same author

On the importance of exposure variability to the doses of volatile organic compounds.

Toxicological sciences : an official journal of the Society of Toxicology·2004
Same author

Stressful life events and physical abuse among pregnant women in North Carolina.

Maternal and child health journal·2001
Same author

Simultaneous assessment of occupational exposures from multiple worker groups.

The Annals of occupational hygiene·2001
Same journal

Fast penalized generalized estimating equations for large longitudinal functional datasets.

Biometrics·2026
Same journal

Causally-interpretable random-effects meta-analysis.

Biometrics·2026
Same journal

Statistical inference for mean function of partially observed functional time series.

Biometrics·2026
Same journal

Subgroup identification via Interaction Tree and Mixed Model for Repeated Measures with application to Alzheimer's disease.

Biometrics·2026
Same journal

Finite mixtures of linear quantile regressions with concomitant variables: a solution to endogeneity in longitudinal data modeling.

Biometrics·2026
Same journal

Discussion on "INTACT: a method for integration of longitudinal physical activity data from multiple sources" by Jingru Zhang, Erjia Cui, Hongzhe Li, and Haochang Shou.

Biometrics·2026
See all related articles

New methods assess interrater agreement for multiple nominal attributes. A chance-corrected concordance statistic using a hypergeometric model is proposed for evaluating rater consistency.

Area of Science:

  • Statistics
  • Psychometrics
  • Data Analysis

Background:

  • Assessing interrater agreement is crucial for reliability in various fields.
  • Existing methods may not adequately handle multiple nominal attributes or chance agreement.
  • Multiple attribute response data presents unique challenges for agreement analysis.

Purpose of the Study:

  • To develop novel methods for quantifying interrater agreement with multiple nominal attributes.
  • To introduce a new concordance statistic that accounts for chance agreement.
  • To provide statistical inference procedures for the proposed agreement measure.

Main Methods:

  • Development of a two-rater concordance statistic for multiple attribute nominal data.
  • Correction for chance agreement using an underlying hypergeometric model.

Related Experiment Videos

  • Illustrative numerical examples and comparisons with existing statistics like kappa.

    • Main Results:

    • A new, chance-corrected statistic for interrater agreement on multiple nominal attributes is derived.
    • The proposed methodology provides a statistically sound approach to assess rater consistency.
    • The new statistic offers a valuable alternative to existing agreement measures, particularly for complex response structures.

    Conclusions:

    • The developed methods offer a robust approach to measuring interrater agreement for complex nominal data.
    • The hypergeometric-based concordance statistic effectively corrects for chance agreement.
    • This methodology enhances the reliability assessment of ratings characterized by multiple attributes.