Innovating global regulatory frameworks for generative AI in medical devices is an urgent priority

Area of Science:

• Biomedical Engineering
• Artificial Intelligence in Medicine
• Regulatory Science

Background:

• Generative AI (GenAI) and large language models (LLMs) are increasingly integrated into healthcare.
• This integration presents novel opportunities and significant challenges for medical device development and oversight.

Purpose of the Study:

• To analyze the risks associated with GenAI and LLM-based medical devices.
• To evaluate the limitations of existing medical device regulatory frameworks for these advanced technologies.
• To advocate for enhanced global collaboration in regulatory science research.

Main Methods:

• Perspective piece synthesizing current knowledge and identifying regulatory gaps.
• Analysis of GenAI/LLM risks in healthcare contexts.
• Review of existing medical device regulations.

Main Results:

• GenAI and LLMs introduce unique risks to medical devices, including issues of bias, data privacy, and performance variability.
• Current regulatory frameworks are often insufficient to address the dynamic and adaptive nature of GenAI/LLM medical devices.
• A need for multidisciplinary input and global regulatory harmonization is identified.

Conclusions:

• Innovative regulatory strategies are essential for the safe and effective deployment of GenAI and LLM-based medical devices.
• Global collaboration in regulatory science research is vital to address challenges and ensure equitable access.
• Future research should focus on adaptive regulatory approaches tailored to AI technologies in healthcare.