Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.4K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.4K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.8K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.8K
One-Way ANOVA01:18

One-Way ANOVA

10.5K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
10.5K
Test for Homogeneity01:23

Test for Homogeneity

2.2K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.2K
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

752
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
752
One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

6.3K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
6.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The cardio-pulmonary renal triad of dyspnea, functional impairment and organ dysfunction - A co-relational study.

Bioinformation·2026
Same author

Reducing social media use via contingency management: A replication and extension.

Journal of applied behavior analysis·2026
Same author

A Retrospective Consecutive Controlled Case Series Analysis of the Assessment and Treatment of Elopement in Children with Autism in an Inpatient Setting.

Behavior analysis in practice·2026
Same author

Why innovations in policing don't work or don't translate: An implementation science survey of US police leaders.

Police practice & research : an international journal·2025
Same author

Caregiver ECHO: A Model for Delivering Virtual Behavior Management Education to Families of Children With Neurodevelopmental Disorders.

American journal on intellectual and developmental disabilities·2025
Same author

A Preliminary Evaluation of the Feasibility and Efficacy of Mantra-Like Phrase Recitation in Improving Mental Health in Autistic Adults.

Advances in neurodevelopmental disorders·2025

Related Experiment Video

Updated: Nov 20, 2025

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

7.1K

Interobserver agreement: A preliminary investigation into how much is enough?

Nicole L Hausman1, Noor Javed2, Molly K Bednar2

  • 1Department of Behavioral Psychology, Kennedy Krieger Institute and the Department of Psychiatry and Behavioral Sciences, the Johns Hopkins University School of Medicine.

Journal of Applied Behavior Analysis
|January 22, 2021
PubMed
Summary

Interobserver agreement (IOA) consistency is crucial for behavioral data. This study found that the number of sessions with IOA did not significantly impact coefficients, suggesting data consistency is key, not session quantity.

Keywords:
data collectioninterobserver agreementreliability

More Related Videos

Comparison of Agreement and Accuracy using Binocular Wavefront Optometer with Autorefractor and Phoropter
05:14

Comparison of Agreement and Accuracy using Binocular Wavefront Optometer with Autorefractor and Phoropter

Published on: September 16, 2025

376
Coordinate Mapping of Hyolaryngeal Mechanics in Swallowing
14:13

Coordinate Mapping of Hyolaryngeal Mechanics in Swallowing

Published on: May 6, 2014

18.6K

Related Experiment Videos

Last Updated: Nov 20, 2025

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

7.1K
Comparison of Agreement and Accuracy using Binocular Wavefront Optometer with Autorefractor and Phoropter
05:14

Comparison of Agreement and Accuracy using Binocular Wavefront Optometer with Autorefractor and Phoropter

Published on: September 16, 2025

376
Coordinate Mapping of Hyolaryngeal Mechanics in Swallowing
14:13

Coordinate Mapping of Hyolaryngeal Mechanics in Swallowing

Published on: May 6, 2014

18.6K

Area of Science:

  • Behavioral science
  • Clinical psychology
  • Research methodology

Background:

  • Interobserver agreement (IOA) is vital for ensuring the reliability and consistency of behavioral data in research and clinical practice.
  • While guidelines for IOA exist, the impact of the total number of sessions assessed for IOA on the resulting coefficient remains unclear.

Purpose of the Study:

  • To investigate whether the total number of sessions included in interobserver agreement (IOA) analysis affects the IOA coefficient.
  • To compare IOA coefficients obtained from reanalyzed functional analysis data at various session cutoffs with original IOA values.

Main Methods:

  • Reanalyzed existing functional analysis data by calculating IOA at different session cutoffs.
  • Compared IOA coefficients derived from these reanalyses with the initially calculated IOA.
  • Examined the influence of the overall rate of responding on IOA.

Main Results:

  • No significant differences in IOA were found across various session cutoffs when using highly trained observers in a structured clinical setting.
  • IOA coefficients were sensitive to the overall rate of responding within the functional analysis.
  • The amount of sessions used for IOA assessment did not appear to be as critical as the consistency of the collected data.

Conclusions:

  • Findings suggest that for practitioners using trained observers in clinical settings, the number of sessions contributing to IOA may be less critical than the overall consistency of the behavioral data.
  • These results provide preliminary support for the idea that data consistency is a more important factor in IOA than the sheer quantity of sessions analyzed.
  • The study highlights the importance of considering the rate of responding when interpreting IOA in functional analyses.