Related Experiment Video
Updated: Jul 19, 2026

Measuring Light-Switching Behavior Using an Occupancy and Light Data Logger
Published on: January 16, 2020
Interpreting kappa in observational research: baserate matters
Cornelia Taylor Bruckner1, Paul Yoder
1Sonoma State University, Rohner Park, CA 94928-2152, USA. corneliabruckner@sonoma.edu
Abstract:
Kappa (Cohen, 1960) is a popular agreement statistic used to estimate the accuracy of observers. The response of kappa to differing baserates was examined and methods for estimating the accuracy of observers presented. Results suggest that setting a single value of kappa as "minimally acceptable" (i.e., a criterion value) is not useful in ensuring adequate accuracy of observers. Instead, researchers should use the best estimate of the true baserate of the target behavior and the obtained kappa to estimate the accuracy of observers. Investigators can then compare the estimated accuracy of observers to a preselected criterion level. Guidelines are given for selecting a criterion accuracy level.
Related Concept Videos
Naturalistic Observations
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Statistical Significance
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Theory of Attribution II: Kelley's Covariation Theory
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
