DDQN-based optimal targeted therapy with reversible inhibitors to combat the Warburg effect

We cover the Warburg effect with a three-component evolutionary model, where each component represents a different metabolic strategy. In this context, a scenario involving cells expressing three different phenotypes is presented. One tumour phenotype exhibits glycolytic metabolism through glucose uptake and lactate secretion. Lactate is used by a second malignant phenotype to proliferate. The third phenotype represents healthy cells, which performs oxidative phosphorylation. The purpose of this model is to gain a better understanding of the metabolic alterations associated with the Warburg effect. It is suitable to reproduce some of the clinical trials obtained in colorectal cancer and other even more aggressive tumours. It shows that lactate is an indicator of poor prognosis, since it favours the setting of polymorphic tumour equilibria that complicates its treatment. This model is also used to train a reinforcement learning algorithm, known as Double Deep Q-networks, in order to provide the first optimal targeted therapy based on experimental tumour growth inhibitors as genistein and AR-C155858. Our in silico solution includes the optimal therapy for all the tumour state space and also ensures the best possible quality of life for the patients, by considering the duration of treatment, the use of low-dose medications and the existence of possible contraindications. Optimal therapies obtained with Double Deep Q-networks are validated with the solutions of the Hamilton-Jacobi-Bellman equation.