MEL-IA: An Interoperable AI System for Multimodal Skin Lesion Classification in Hospital Settings

Skin cancer represents a growing healthcare challenge, motivating the development of AI sytems that can support lesion assessment while integrating efficiently into clinical workflows. This study presents MEL-IA (MobilE skin Lesion dIAgnosis), an interoperable AI system designed for automated skin lesion classification and full integration with hospital information systems.

The system combines dermatoscopic images and structured clinical metadata using an EfficientNet-B4 - based multimodal model trained on the ISIC 2019 BCN_20000 and MSK subsets. Internal robustness was assessed through stratified 5-fold cross-validation, and external generalization was evaluated on the independent HAM10000 dataset. Interoperability and operational performance were validated through deployment in a real hospital environment using HL7, DICOM, PACS, and HIS/RIS systems.

We evaluated internal robustness using stratified five‑fold cross‑validation, with global accuracy of 0.86, macro F1-score of 0.85, and AUC values above 0.97. The external evaluation showed that the model generalizes well under different acquisition conditions, achieving an accuracy of 0.84 and balanced accuracy of 0.65, with sensitivities of 0.60 for melanoma 0.72 for basal cell carcinoma. The multimodal model outperformed the image model baseline across all classes. Technical deployment confirmed full interoperability, > 99% successful study integration, and near real time processing.

MEL-IA provides multimodal skin lesion classification capabilities and integrates smoothly into hospital infrastructures based on standards. The results demonstrate technical feasibility, interoperability, and operational viability for deployment within dermatology oriented clinical workflows. Further clinical validation studies are warranted to assess the system's impact on diagnostic decision-making and patient outcomes.