Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Interval estimation under two study designs for kappa with binary classifications

C A Hale1, J L Fleiss

  • 1Columbia University, Division of Biostatistics, New York, New York 10032-3799.

Biometrics
|June 1, 1993
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

ON THE METHODS AND THEORY OF CLUSTERING.

Multivariate behavioral research·2016
Same author

A simple approximation for calculating sample sizes for comparing independent proportions.

Biometrics·2015
Same author

Managed care 1: an opportunity for nursing.

British journal of nursing (Mark Allen Publishing)·2014
Same author

Absorbability and cost effectiveness in calcium supplementation.

Journal of the American College of Nutrition·2001
Same author

Dynamic localization cycle of the cell division regulator MinE in Escherichia coli.

The EMBO journal·2001
Same author

ZipA-induced bundling of FtsZ polymers mediated by an interaction between C-terminal domains.

Journal of bacteriology·2000

This study adapts Cornfield's method for confidence intervals of the agreement measure kappa. The adapted method demonstrated superior performance in simulations for assessing inter-rater reliability.

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Assessing agreement between raters is crucial in various fields.
  • Existing methods for confidence intervals of the kappa statistic have limitations.
  • The kappa statistic measures inter-rater reliability for categorical items.

Purpose of the Study:

  • To adapt Cornfield's test-based method for confidence intervals of the kappa statistic.
  • To compare the performance of these new intervals with existing methods.
  • To evaluate interval performance under different study designs for inter-rater agreement.

Main Methods:

  • Adapted Cornfield's test-based method for confidence intervals of kappa.
  • Utilized simulation studies to compare interval performance.

Related Experiment Videos

  • Evaluated intervals under two distinct study designs involving dichotomous ratings.

    • Main Results:

    • Lower bounds derived from the adapted Cornfield method achieved nominal coverage probability more frequently than other proposed intervals.
    • The adapted method showed improved accuracy in estimating the confidence intervals for kappa.
    • Performance was assessed across scenarios with consistent and varying rater pairs.

    Conclusions:

    • Cornfield's test-based method provides a robust approach for constructing confidence intervals for kappa.
    • The adapted method offers a more reliable way to quantify inter-rater agreement.
    • This approach enhances the statistical rigor in studies relying on the kappa measure.