Identification of drug use degree by integrating multi-modal features with dual-input deep learning method

Most of studies on drug use degree are based on subjective judgments without objective quantitative assessment, in this paper, a dual-input bimodal fusion algorithm is proposed to study drug use degree by using electroencephalogram (EEG) and near-infrared spectroscopy (NIRS). Firstly, this paper uses the optimized dual-input multi-modal TiCBnet for extracting the deep encoding features of the bimodal signal, then fuses and screens the features using different methods, and finally fused deep encoding features are classified. The classification accuracy of bimodal is found to be higher than that of single modal, and the classification accuracy is up to 89.9%.