DSA-DeepFM: a dual-stage attention-enhanced DeepFM model for predicting anticancer synergistic drug combinations
Yuexi Gu1, Yongheng Sun1, Louxin Zhang2
1School of Mathematics and Statistics, Xi'an Jiaotong University, Shaanxi 710049, People's Republic of China.
Motivation:
Drug combinations are crucial in combating drug resistance, reducing toxicity, and improving therapeutic outcomes in disease management. Because a large number of drugs are available, the potential combinations increase exponentially, making it impractical to rely solely on biological experiments to identify synergistic combinations. Consequently, machine learning methods are increasingly being used to find synergistic drug combinations. Most existing methods focus on predictive performance through auxiliary data or complex models, but neglecting underlying biological mechanisms limits their accuracy in predicting synergistic drug combinations.
Results:
We present DSA-DeepFM, a deep learning model that integrates a dual-stage attention (DSA) mechanism with Factorization Machines (FMs) to predict synergistic two-drug combinations by addressing complex biological feature interactions. The model incorporates categorical and auxiliary numerical inputs to capture both field-aware and embedding-aware patterns. These patterns are then processed by a deep FM module, which captures low- and high-order feature interactions before making the final predictions. Validation testing demonstrates that DSA-DeepFM significantly outperforms traditional machine learning and state-of-the-art deep learning models. Furthermore, t-SNE visualizations confirm the discriminative power of the model at various stages. Additionally, we use our model to identify eight novel synergistic drug combinations, underscoring its practical utility and potential for future applications.
Availability And Implementation:
Source code is available at https://github.com/gracygyx/DSA-DeepFM.
Insights
Machine learning models can predict synergistic drug combinations by analyzing complex biological interactions. DSA-DeepFM, a novel deep learning approach, accurately identifies novel synergistic drug pairs, outperforming existing methods.
Area of Science:
- Computational biology
- Pharmacology
- Machine learning
Background:
- Drug combinations are essential for overcoming drug resistance and enhancing therapeutic outcomes.
- The vast number of potential drug combinations necessitates computational approaches beyond traditional experimental methods.
- Existing machine learning models often overlook biological mechanisms, limiting their predictive accuracy for synergistic drug combinations.
Purpose of the Study:
- To develop a deep learning model, DSA-DeepFM, that accurately predicts synergistic two-drug combinations by integrating biological feature interactions.
- To improve the prediction of synergistic drug combinations by incorporating both categorical and numerical data.
- To address the limitations of current methods by considering complex biological mechanisms.
Main Methods:
- Developed DSA-DeepFM, a deep learning model combining a dual-stage attention (DSA) mechanism with Factorization Machines (FMs).
- Integrated categorical and auxiliary numerical inputs to capture field-aware and embedding-aware patterns.
- Utilized a deep FM module to process feature interactions for prediction.
Main Results:
- DSA-DeepFM significantly outperformed traditional machine learning and state-of-the-art deep learning models in predicting synergistic drug combinations.
- t-SNE visualizations confirmed the model's discriminative power.
- Identified eight novel synergistic drug combinations, demonstrating practical utility.
Conclusions:
- DSA-DeepFM offers a powerful and accurate approach for predicting synergistic drug combinations.
- The model's ability to integrate complex biological interactions enhances its predictive performance.
- The identified novel synergistic combinations highlight the model's potential for drug discovery and development.
Related Concept Videos
Combination Therapies and Personalized Medicine
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
Combined Effects of Drugs: Synergism
Such synergistic combinations...
Combined Effects of Drugs: Antagonism
The most common type is receptor antagonism, where one drug acts as an antagonist to block the effects of another drug by...
Targeted Cancer Therapies
There are several types of targeted therapies against...


