Optimal treatment strategy of cancers with intratumor heterogeneity

Intratumor heterogeneity hinders the success of anti-cancer treatment due to the interaction between different types of cells. To recapitulate the communication of different types of cells, we developed a mathematical model to study the dynamic interaction between normal, drug-sensitive and drug-resistant cells in response to cancer treatment. Based on the proposed model, we first study the analytical conclusions, namely the nonnegativity and boundedness of solutions, and the existence and stability of steady states. Furthermore, to investigate the optimal treatment that minimizes both the cancer cells count and the total dose of drugs, we apply the Pontryagin's maximum(or minimum) principle (PMP) to explore the combination therapy strategy with either quadratic control or linear control functionals. We establish the existence and uniqueness of the quadratic control problem, and apply the forward-backward sweep method (FBSM) to solve the optimal control problems and obtain the optimal therapy scheme.