Optimized deep intelligent parameter efficient fine-tuning protein language model system for predicting...

Protein dephosphorylation is essential for regulating cellular processes, and accurate prediction of dephosphorylation sites is crucial for understanding protein function and signaling mechanisms. Existing predictive methods often lack flexibility and fail to capture complex sequence dependencies across diverse proteins.

A novel Termite Life Cycle Boltzmann Machine (TLCBM) integrated with Low-Rank Adaptation (LoRA), forming a protein language model that efficiently learns high-dimensional sequence representations. TLCBM-LoRA leverages a sliding window to extract local sequence contexts while simultaneously modeling long-range dependencies, focusing on key residues tyrosine (Y), serine (S), and threonine (T). The model achieves high predictive performance, with accuracy of 0.92 and 0.96, MCC of 0.91 and 0.94, specificity of 0.92 and 0.97, sensitivity of 0.93 and 0.95, and ROC_AUC of 0.95 and 0.98 for Y and ST residues, respectively. Compared to the traditional model, 3% performance was improved for the proposed system. The results demonstrate that TLCBM-LoRA is a flexible and powerful tool for enhanced protein sequence analysis and dephosphorylation site recognition.