Multi-modal Biometrics Based Implicit Driver Identification System Using Multi-TF Images of ECG and EMG

As security is emphasized inside and outside the vehicle, research on driver identification technology using bio-signals is being actively studied. The bio-signals acquired by the behavioral characteristics of the driver include artifacts generated according to the driving environment, which could potentially degrade the accuracy of the identification system. Existing driver identification systems either remove the normalization process of bio-signals in the preprocessing stage or use artifacts included in a single bio-signals, resulting in low identification accuracy. To solve these problems in a real situation, we propose a driver identification system that converts ECG and EMG signals obtained from different driving conditions into 2D spectrograms through multi-TF image and uses multi-stream CNN. The proposed system consists of a preprocessing phase of ECG and EMG signals, a multi-TF image conversion process, and a driver identification stage using a multi-stream-based CNN. Under all driving conditions, the driver identification system reached an average accuracy of 96.8% and an F1 score of 0.973, which overperformed the existing driver identification systems by more than 1%.