A qualitative survey on perception of medical students on the use of large language models for educational purposes

Large language models (LLMs)-based chatbots use natural language processing and are a type of generative artificial intelligence (AI) that is capable of comprehending user input and generating output in various formats. They offer potential benefits in medical education. This study explored the student's feedback on the utilization of LLMs in medical education. We conducted an in-depth interview with open-ended questions with Indian medical students via telephone conversation. The recording (average time: 55.28 ± 18.04 min) was transcribed and thematically analyzed to find major themes and subthemes. We used QDA Miner Lite v.2.0.8 (Provalis Research, Montreal, Canada) for the thematic analysis of the text. A total of 25 students from eight Indian states studying from the first to final year of studies participated in this study. Three major themes were identified: usage scenario, augmented learning, and limitation of LLMs. Students use LLMs for clarifying complex topics, searching for customized answers, solving multiple-choice questions, making simplified notes, and streamlining assignments. While they appreciated the ease of access, ready reference for getting clarity on doubts, lucid explanation of questions, and time-saving aspects of LLMs, concerns were raised regarding erroneous results, limited usage due to reliability and privacy issues, and the overreliance on chatbots for educational needs. Hence, they emphasized the need for training for the integration of LLM in medical education. In conclusion, according to students' perception, LLMs have the potential to enhance medical education. However, addressing challenges and leveraging the strengths of LLMs are crucial for optimizing their integration into medical education.NEW & NOTEWORTHY The study demonstrates the student's perspective on the role of large language models (LLM)-based chatbots in medical education. Students' responses generated three major themes of various usage scenarios, how LLMs can enhance learning, and the ethical considerations in the integration of LLMs into medical curricula. By identifying both the benefits and limitations of LLMs in medical education, the study offers insights for educators and policymakers to navigate the complexities of LLM in educational settings.