Physiological Time-Series Fusion With Hybrid Attention for Adaptive Recognition of Pain

Automatic pain assessment is an application in healthcare serving personalized pain care, and patients cannot self-report pain. Pain at the present is inferred from physiological dynamics at the present and in the near past. However, heterogeneous pain responses cross-subject and cross-type hinder accurate recognition of pain. This work solves the adaptive pain recognition problem across pain types. We concrete the adaptivity problem into recognizing both phasic/short and tonic/long pain from the physiological sequences of the same length. The adaptivity of the proposed solution (TCAtt-PainNet) was ensured by hybrid temporal-channel attention when fusing multivariate time-series of electrocardiogram (ECG) and galvanic skin response (GSR) features. The attention was obtained by learning the dependencies between the point at present and the sequence in the near past, where sequence point temporal attention was constructed via modified self-attention, and the following feature channel attention was constructed by squeeze-and-excitation temporal attention weighted deep feature sequence. The proposed solution successfully enhanced recognition adaptivity by addressing relevant information only from long input sequences when testing with tonic and phasic pain databases, making progress towards automatic pain assessment for real application scenarios with attributes unknown pain.