Insights on Using Time-of-Flight Camera for Recovering Cardiac Pulse From Chest Motion in Depth Videos

In this article, we introduce a novel use of depth camera to extract cardiac pulse signal from human chest area, in which the depth information is obtained from a near infrared sensor using time-of-flight technology. We successfully isolate weak chest motion due to heartbeat by processing a sequence of depth images without raising privacy concern. We discuss motion sensitivity in depth video with examples from actuator simulation and human chest motion. Compared to other imaging modalities, the depth image intensity can be directly used for micromotion reconstruction. To deal with the challenges of recovering heartbeat from the chest area, we develop a set of coherent processing techniques to suppress the unwanted motion interference from breathing motion and involuntary body motion and eventually obtain clean cardiac pulse signal. We, thus, derive inter-beat-interval, showing high consistency to the contact photoplethysmography. Additionally, we develop a graphical interpretation of the most and the less pulsatile principal components in eigen space. For validation, we test our method on ten healthy human subjects with different resting heart rates. More importantly, we conduct a set of experiments to study the robustness and weakness of our methods, including extended range, multi-subject, thickness of clothes and generation to other measurement site.