Related Experiment Video
Updated: Apr 24, 2026

Assessing the Accuracy of Fitness Smartwatch Data for Cardiovascular and Physical Activity Monitoring: A Validation Study in Digital Health
Published on: February 21, 2025
Real-Time Versus Video-Recorded Step Count Validation Among Young Adults
Sicong Ren1, Mariya Boikova2, Cayla R McAvoy1
1Department of Epidemiology and Community Health, University of North Carolina at Charlotte, Charlotte, NC, USA.
Background:
Consumer Technology Association guidelines recommend two independent researchers review video recordings of treadmill bouts to verify accuracy of the number of steps taken. Performing multiple post hoc validation checks requires significant resources for personnel time and costs, but it is unknown if the burden is necessary. The purpose of this study was to evaluate accuracy and efficiency of step counts assessed during direct observation compared with multiple reviews of video recordings.
Methods:
Participants ages 18-20 years (n = 72) completed up to twelve 5-min, zero-incline treadmill bouts, speeds ranging 0.2-2.7 m/s (0.5-6.0 mph). Directly observed steps were counted and hand-tallied in real-time. A sex-age stratified random sample of 30 participants' bouts were selected for analysis. Two independent researchers recounted steps from video recordings, producing three independent counts. Intraclass correlation coefficient determined interrater reliability. Mean average percent deviation computed deviation magnitude among the three counts. Correlation tests determined the relationship between absolute count differences and average counts for each pairwise comparison.
Results:
Interrater reliability was excellent with intraclass correlation coefficients ≥ .995 (p < .001) across all speeds. Average mean average percent deviation was 0.29% with bout-specific deviations ranging from 0.10% to 0.54%, indicating < 1% difference among the three counts for all bouts.
Conclusions:
A single real-time step count represents a sufficient and efficient approach to measure steps taken in a controlled treadmill setting, while video recounts serve as back-up to allay potential data loss concerns and/or for random selection verification. These data-driven findings are useful for optimizing personnel time and reducing costs associated with collecting quality data in large-scale treadmill-based step-counting studies.

