Validation of Deep Learning-based Sleep State Classification

Deep learning methods have been developed to classify sleep states of mouse electroencephalogram (EEG) and electromyogram (EMG) recordings with accuracy reported as high as 97%. However, when applied to independent datasets, with a variety of experimental and recording conditions, sleep state classification accuracy often drops due to distributional shift. Mixture z-scoring, a pre-processing standardization of EEG/EMG signals, has been suggested to account for these variations. This study sought to validate mixture z-scoring in combination with a deep learning method on an independent dataset. The open-source software Accusleep, which implements mixture z-scoring in combination with deep learning via a convolutional neural network, was used to classify sleep states in 12, three-hour EEG/EMG recordings from mice sleeping in a head-fixed position. Mixture z-scoring with deep learning classified sleep states on two independent recordings with 85-92% accuracy and a Cohen's κ of 0.66-0.71. These results validate mixture z-scoring in combination with deep learning to classify sleep states with the potential for widespread use.