Related Experiment Video
Updated: Jul 11, 2025

Collecting Sleep, Circadian, Fatigue, and Performance Data in Complex Operational Environments
Published on: August 8, 2019
Comparing actigraphy and diary to measure daily and average sleep in firefighters: a Bland-Altman analysis
Ryan Marmis1, Logan McGoldrick-Ruth1, Monica R Kelly2,3,4
1Department of Physiology, University of Arizona, Tucson, Arizona.
Study Objectives:
This study sought to examine the relationship between actigraphy and the Consensus Sleep Diary to contribute information on their concurrent validity in a sample of career firefighters.
Methods:
Sixty firefighters were recruited from a large, urban fire department in the southwest United States that utilizes a fire-based emergency medical services system and a 5/6 shift schedule. A total of 329 differences were recorded during participants' 6-day between-shift recovery period. Data was collected utilizing the two most common forms of sleep analysis in an outpatient setting, wrist actigraphy (Actiwatch-2) and the Consensus Sleep Diary. Nine major sleep indices were computed: wake time after sleep onset, total sleep time, sleep onset latency, sleep offset, in-bed time, lights-off time, out-of-bed time, wake time, and sleep efficiency.
Results:
Firefighters overestimated sleep efficiency and underestimated wake after sleep onset by values that were greater than the American Academy of Sleep Medicine a priori clinical significance thresholds. All indices showed very broad limits of agreement. For example, the 95% confidence interval for diary and actigraphic total sleep time estimates fell within a 4.7-hour range.
Conclusions:
Firefighters receiving recovery sleep between tours demonstrated significantly large disagreements between their daily self-reported sleep and measured actigraphic sleep. Sleep findings from actigraphic and Consensus Sleep Diary sleep assessments in this population should be interpreted cautiously until each method is compared against other reliable sleep analysis methods. Currently it is unclear if clinicians are using properly validated tools when diagnosing shift work disorder or other sleep disorders in firefighters.
Citation:
Marmis R, McGoldrick-Ruth L, Kelly MR, Haynes PL. Comparing actigraphy and diary to measure daily and average sleep in firefighters: a Bland-Altman analysis. J Clin Sleep Med. 2024;20(4):497-503.

