Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Considerations in the choice of interobserver reliability estimates.

D P Hartmann1

  • 1University of Utah.

Journal of Applied Behavior Analysis
|April 1, 1977
PubMed
Summary

Accurate treatment studies require two interobserver reliability measures: trial and composite scores. Understanding percentage agreement versus correlational methods is crucial for reliable data acquisition.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Social behaviour and illness information interact to influence the peer acceptance of children with chronic illness.

British journal of health psychology·2003
Same author

Differentiating lymphoblastic lymphoma and Ewing's sarcoma: lymphocyte markers and gene rearrangement.

Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc·2001
Same author

Endoscopic mapping and surrogate markers for better surveillance in Barrett esophagus. A study of 700 biopsy specimens.

American journal of clinical pathology·2000
Same author

Qualitative mapping of Barrett's metaplasia: a prerequisite for intervention trials.

Gastrointestinal endoscopy·1999
Same author

Posttherapy surveillance of B-cell precursor acute lymphoblastic leukemia. Value of polymerase chain reaction and limitations of flow cytometry.

American journal of clinical pathology·1999
Same author

Precursor B-Lymphoblastic lymphoma presenting as a solitary bone tumor and mimicking Ewing's sarcoma: a report of four cases and review of the literature.

The American journal of surgical pathology·1998

Area of Science:

  • Psychometrics
  • Clinical Research Methodology

Background:

  • Treatment studies often rely on observers for data collection.
  • Assessing the consistency of observer judgments is critical for study validity.

Purpose of the Study:

  • To differentiate between trial reliability and composite score reliability in observer-based studies.
  • To present and compare two primary methods for calculating interobserver reliability: percentage agreement and correlational measures.

Main Methods:

  • Description of two distinct types of interobserver reliability: trial reliability and composite unit reliability.
  • Explanation of two approaches to estimating interobserver reliability: percentage agreement and correlational methods.

Main Results:

  • Discusses the interpretation of reliability estimates.
  • Identifies factors influencing the magnitude of reliability values.
  • Outlines the advantages and limitations of both percentage agreement and correlational approaches.

Conclusions:

  • Highlights the necessity of considering different reliability types in observer-dependent research.
  • Emphasizes the importance of understanding the nuances of various reliability metrics for accurate data interpretation.

Related Experiment Videos