Protocol-constrained AI enhances tacrolimus dosing accuracy in kidney transplant care

Tacrolimus dosing after kidney transplantation is complex, highly individualized, and prone to variability, which can impact graft outcomes. While machine learning (ML) approaches have been used primarily to predict tacrolimus concentrations, large language models (LLMs) may enable protocol-constrained clinical decision support by generating dosing recommendations aligned with established treatment guidelines.

We developed TacroDose AI, a protocol-constrained LLM based on GPT-4, to generate tacrolimus dosing recommendations aligned with institutional guidelines. Using 300 structured simulated clinical scenarios, we evaluated protocol adherence, error patterns, and reproducibility of model-generated dosing recommendations. Following review of initial outputs, a refined prompt (TacroAI 2.0) was implemented to strengthen protocol constraints and structured output verification, and performance was reassessed.

TacroDose AI achieved 72.9% protocol adherence, with 27.1% protocol deviations, including 13.9% sentinel errors with potential clinical significance. Prompt refinement substantially improved performance: TacroAI 2.0 achieved 91.7% adherence, reduced sentinel errors to 1.0%, and improved reproducibility from 77.3 to 86.7% (all p < 0.01). Although rounding discrepancies increased, these represented minor numerical differences without clinical relevance. Performance improvements were observed across subtherapeutic, therapeutic, and supratherapeutic tacrolimus scenarios.

Protocol-constrained LLMs can produce guideline-concordant tacrolimus dosing recommendations with high adherence and improved reliability in simulated clinical settings. These findings highlight a potential framework for integrating generative AI with rule-based clinical protocols to support safe medication management. With further validation using real-world data, such systems could be integrated into electronic health records to support clinician-supervised, protocol-based immunosuppressive dosing in transplant care.