Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Overt versus covert assessment of observer reliability.

M R Weinrott, R R Jones

    Child Development
    |June 1, 1984
    PubMed
    Summary

    Observer reliability in behavioral coding decreases without a partner. Even experienced observers show lower covert reliability, suggesting a lapse in attention rather than fatigue, especially with complex coding systems.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Active Suppression of Quantum Dephasing in Resonantly Driven Ensembles.

    Physical review letters·2024
    Same author

    Angle-dependent strong-field ionization of halomethanes.

    The Journal of chemical physics·2019
    Same author

    Identifying Spatial Variation Along the HIV Care Continuum: The Role of Distance to Care on Retention and Viral Suppression.

    AIDS and behavior·2018
    Same author

    High-energy electron emission from metallic nano-tips driven by intense single-cycle terahertz pulses.

    Nature communications·2016
    Same author

    RESPONSE BIASES AND TRAIT DESCRIPTIVE ADJECTIVES.

    Multivariate behavioral research·2016
    Same author

    Ionization of excited atoms by intense single-cycle THz pulses.

    Physical review letters·2014

    Area of Science:

    • Behavioral observation
    • Psychological research methods
    • Observer reliability

    Background:

    • Accurate behavioral event recording is crucial for research validity.
    • Observer reliability can be influenced by various factors, including the presence of other observers.

    Purpose of the Study:

    • To investigate whether observers make less reliable behavioral recordings when a calibrating observer is absent.
    • To differentiate between overt and covert observer reliability assessments.

    Main Methods:

    • Experienced observers at 4 research sites coded videotapes of family interactions.
    • Behavioral coding used site-specific multicategory systems.
    • Overt reliability was assessed via simultaneous coding by observer pairs.
    • Covert reliability was assessed by independent coding without prior knowledge of comparison.

    Main Results:

    • Overt intraclass correlations (ICCs) were high across most behaviors and systems.
    • Covert ICCs were significantly lower than overt ICCs.
    • Reliability decline was evident within the first 10 minutes of coding sessions, indicating it's not solely due to fatigue.

    Conclusions:

    • Observers tend to adopt a less attentive state when coding alone, impacting reliability.
    • This effect is more pronounced with complex coding systems.
    • The absence of a partner significantly reduces observer reliability in behavioral research.

    Related Experiment Videos