Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Observer agreement, credibility, and judgment: some considerations in presenting observer agreement data.

T R Kratochwill1, R J Wetzel

  • 1The University of Arizona.

Journal of Applied Behavior Analysis
|April 1, 1977
PubMed
Summary

Graphical and statistical indices are judgmental aids for observer agreement in interval recording. Plotting data aids researchers, while special estimates and correlational statistics better serve research consumers.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Sertraline treatment of 5 children diagnosed with selective mutism: a single-case research trial.

Journal of child and adolescent psychopharmacology·2000
Same author

Self-reported fears in Hispanic youth with mental retardation: a preliminary study.

Mental retardation·1998
Same author

Self-reported fears in children with and without mental retardation.

Mental retardation·1997
Same author

Applied behavior analysis and school psychology.

Journal of applied behavior analysis·1994
Same author

Behavior analysis of residential program development.

Research in developmental disabilities·1992
Same author

Teaching parents to teach their children: applications in the pediatric setting.

Journal of pediatric psychology·1981

Area of Science:

  • Behavioral Science
  • Applied Behavior Analysis

Background:

  • Observer agreement is crucial for data reliability in applied behavior analysis.
  • Current methods for representing observer agreement include graphical and statistical indices, termed 'judgmental aids'.

Purpose of the Study:

  • To evaluate the utility of graphical and statistical indices for representing observer agreement data.
  • To discuss the advantages and limitations of these indices for both researchers and research consumers.

Main Methods:

  • Analysis of graphical plotting of observer agreement data.
  • Review of conventional statistical aids for observer agreement.
  • Examination of alternative agreement estimates (e.g., percent occurrence, nonoccurrence) and correlational statistics (e.g., Kappa, Phi).

Related Experiment Videos

Main Results:

  • Plotting observer agreement data serves as a useful supplement for researchers.
  • Conventional statistical aids have limitations for research consumers.
  • Special agreement estimates and correlational statistics offer improved utility for research consumers.

Conclusions:

  • Graphical data presentation is valuable for researchers but less so for consumers.
  • Alternative statistical methods are recommended for enhancing the interpretability of observer agreement for research consumers in applied behavior analysis.