The use of artificial intelligence in medicine requires software user interfaces that ensure usability, transparency, and compliance with the European AI Act. The proposed framework defines minimum technical requirements for each usage phase, from data input to model interpretation, promoting safety, explainability, and human oversight, elements still underdeveloped in clinical practice.