AI-Assisted Detection Support for Middle Ear Diseases Using Multimodal Large Language Models

Middle ear diseases, such as otitis media and middle ear effusion, are difficult to accurately detect in primary care. We developed an AI-powered system using Azure OpenAI's GPT-4 Vision, the first multimodal large language model (LLM) applied to analyze otoscopic images and detect ten middle ear conditions. Built with a Model-View-Controller (MVC) architecture, the system processes images in under 5 seconds and provides bilingual (English and Chinese) detection reports with confidence scores and treatment recommendations. This scalable solution integrates advanced image analysis and natural language generation to enhance workflows in telemedicine and primary care settings.