Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A simple approach to interrater agreement.

C O Archer, J M Messick

    Journal of Psychiatric Nursing and Mental Health Services
    |June 1, 1976
    PubMed
    Summary

    A straightforward method for calculating interrater reliability was developed. This approach uses consensus and individual ratings within an experimental design, relying on simple calculations for agreement measurement.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Brachial plexus neuropathy following attempt at subclavian vein catheterization. Case report.

    Regional anesthesia·1996
    Same author

    Analgesia after thoracotomy: effects of epidural fentanyl concentration/infusion rate.

    Anesthesia and analgesia·1995
    Same author

    [Postoperative pain management].

    Masui. The Japanese journal of anesthesiology·1995
    Same author

    Epidural analgesia shortens postoperative ileus after ileal pouch-anal canal anastomosis.

    American journal of surgery·1995
    Same author

    ASA monitoring standards and magnetic resonance imaging.

    Anesthesia and analgesia·1994
    Same author

    A prospective randomized comparison of epidural infusion of fentanyl and intravenous administration of morphine by patient-controlled analgesia after radical retropubic prostatectomy.

    Mayo Clinic proceedings·1992

    Area of Science:

    • Psychometrics
    • Statistical Methods

    Background:

    • Assessing the consistency of ratings between different observers (interrater reliability) is crucial in various research fields.
    • Existing methods for measuring interrater agreement can be complex or require specific experimental setups.

    Purpose of the Study:

    • To introduce a simple and accessible method for computing interrater agreement.
    • To provide a reliable measure of consistency when multiple raters are involved.

    Main Methods:

    • The proposed method utilizes an experimental design incorporating both individual rater judgments and a consensus rating.
    • Calculations involve basic counting and percentage derivations.
    • An overall agreement index is derived using a straightforward weighted average.

    Main Results:

    • The method provides a quantifiable measure of interrater reliability.
    • The computational requirements are minimal, making it easy to implement.

    Conclusions:

    • This simple method offers an effective way to determine interrater reliability.
    • The approach is practical for studies requiring assessment of agreement between observers.

    Related Experiment Videos