Combining Video Magnification with Machine Learning-Based Source Identification for Contactless Heart Rate Monitoring

Conventional contact-based monitoring of heart rate (HR) presents challenges such as patient discomfort, skin irritation, and poor long-term adherence, motivating the development of contactless, video-based sensing systems. This study proposes a robust hybrid framework combining advanced signal processing with machine learning to enhance HR estimation accuracy from facial video. The methodology integrates a two-stage geometric stabilization pipeline with dense facial tessellation to mitigate motion. Eulerian Video Magnification (EVM) amplifies subtle color variations, followed by chrominance-based Region of Interest (ROI) filtering. Signal recovery utilizes a sliding-window Principal Component Analysis (PCA) for local coherence, followed by Second-Order Blind Identification (SOBI), with a Light Gradient Boosting Machine (LightGBM) classifier employed to automatically identify physiological sources. Validated on the challenging COHFACE dataset, the approach achieves a Mean Absolute Error (MAE) of 1.50 bpm, a Root Mean Square Error (RMSE) of 3.07 bpm, and a Pearson Correlation Coefficient (PCC) of 0.97 on the test set. The method demonstrates robustness across diverse lighting conditions, outperforming traditional algorithms and achieving parity with state-of-the-art deep learning models, while offering an interpretable solution for contactless health monitoring.