Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A probability-based formula for calculating interobserver agreement.

A R Yelton1, B G Wildman, M T Erickson

  • 1Reidsville School.

Journal of Applied Behavior Analysis
|April 1, 1977
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The mediating role of hyperactivity and inattention on sex differences in paediatric injury risk.

Child: care, health and development·2011
Same author

Maternal distress, child behaviour, and disclosure of psychosocial concerns to a paediatrician.

Child: care, health and development·2004
Same author

Mother and child perceptions of child functioning: relationship to maternal distress.

Family process·2001
Same author

Use of child reports of daily functioning to facilitate identification of psychosocial problems in children.

Archives of family medicine·2000
Same author

Brief report: parent report about health care use: relationship to child's and parent's psychosocial problems.

Journal of pediatric psychology·1999
Same author

Relationships among parental reports of child, parent, and family functioning.

Family process·1999
Same journal

Latency and persistence of renewal in an intensive outpatient clinic.

Journal of applied behavior analysis·2026
Same journal

The effect of varied versus constant high-probability instructional sequences on cooperation.

Journal of applied behavior analysis·2026
Same journal

Relations between heart rate and precursors: A replication and extension of prior research.

Journal of applied behavior analysis·2026
Same journal

Integrating five linear trend techniques into performance-criteria-based effect size measurements: Impressions and recommendations.

Journal of applied behavior analysis·2026
Same journal

Functional analysis and treatment of higher level restricted repetitive behavior displayed by individuals with autism.

Journal of applied behavior analysis·2026
Same journal

Contingency drives children's vocal behavior.

Journal of applied behavior analysis·2026
See all related articles

Assessing observer agreement is crucial for reliable interval data. A new probability-based method improves upon traditional percent agreement by accounting for chance occurrences and non-occurrences.

Area of Science:

  • Behavioral Science
  • Data Analysis
  • Psychometrics

Background:

  • Observer agreement estimates are vital for validating interval data.
  • Traditional methods like percent agreement have significant limitations.
  • Percent agreement is sensitive to behavior frequency and non-occurrence data.

Purpose of the Study:

  • To introduce and explain an alternative method for assessing observer agreement.
  • To address the weaknesses of percent agreement, particularly its failure to account for chance agreement.
  • To provide a more robust measure of reliability for interval data.

Main Methods:

  • A novel statistical method is presented to calculate the exact probability of observed agreements occurring by chance.
  • This method incorporates agreements on both the occurrence and non-occurrence of behaviors.

Related Experiment Videos

  • It provides a more rigorous assessment compared to simple percentage agreement.

    • Main Results:

    • The proposed method offers a more accurate estimation of observer agreement.
    • It corrects for chance agreements, providing a more conservative and reliable reliability index.
    • The calculation considers both positive and negative agreement instances.

    Conclusions:

    • The presented probability-based method offers a superior alternative to percent agreement for assessing observer reliability.
    • This approach enhances the validity and trustworthiness of interval data in research.
    • Accurate observer agreement measurement is fundamental for reproducible scientific findings.