Related Experiment Video
Updated: Jun 9, 2026
07:51
Video Movement Analysis Using Smartphones (ViMAS): A Pilot Study
Published on: March 14, 2017
Interobserver agreement when using a four-point mobility scoring system to score dairy cattle from video footage
James P Wilson1, Vivi Thorup2, Nick J Bell3
1Department of Livestock and One Health, Institute of Infection, Veterinary and Ecological Sciences, University of Liverpool, Neston, UK.
The Veterinary Record
|June 8, 2026
Summary
Mobility scoring in cows showed poor agreement among experienced observers, highlighting a need for standardized lameness assessment procedures. This impacts the reliability of bovine mobility evaluations.
Area of Science:
- Veterinary Medicine
- Animal Science
- Animal Welfare
Background:
- Investigated interobserver agreement in bovine mobility scoring among experienced researchers from different institutions.
- Assessed the reliability of a four-point mobility score used in lameness evaluations.
Purpose of the Study:
- To quantify the level of agreement between experienced observers when assessing cow mobility using video footage.
- To identify potential inconsistencies in lameness scoring practices.
Main Methods:
- 10 experienced observers evaluated video clips of 207 cows across nine farms using a four-point mobility score.
- Interobserver agreement was measured using Gwet's agreement coefficient (AC1) and Fleiss' kappa.
Main Results:
- Lameness prevalence estimates varied widely (36.2%–57.0%) between observers.
- Pairwise agreement (Gwet's AC1) ranged from 35.6% to 74.5%, with overall agreement being poor (Fleiss' κ = 0.28).
- Three observers scored below 60% agreement, indicating significant variability.
Conclusions:
- Despite observer experience and standardized video conditions, significant interobserver variability exists in mobility scoring.
- Standardized procedures for lameness outcome assessments are urgently needed for researchers and field assessors.
- Current methods may not accurately reflect real-world scoring conditions, impacting animal welfare assessments.
