The role of generative AI tools in case-based learning and teaching evaluation of medical biochemistry

Medical biochemistry, a fundamental course in medical education, has a complex and expanding knowledge base. Traditional teaching methods often fail to meet students' needs for in-depth understanding and personalized learning. Students can become overwhelmed by the vast array of biochemical concepts, reactions, and molecular structures.

This study aims to explore the potential of generative AI tools as teaching assistants in medical biochemistry, particularly in CBL (Case-Based Learning) settings where their application is currently limited.

We conducted a comparative study involving a control group (N = 40) and an experimental group (N = 39) to assess the impact of AI tools on CBL learning. We analyzed students' performance and compared evaluations of their work by both teachers and AI tools. Additionally, a questionnaire was used to gauge the effects of AI tools on case study learning.

The experimental group using AI tools showed significantly better performance than the control group. The former completed case assignments faster (2.6 h vs. 5.5 h, P < 0.05) and achieved higher exam scores (77.3 ± 4.3 vs. 66.5 ± 5.4, P < 0.05). AI-based grading on students' assignments closely matched teachers' evaluations on them (P > 0.05), demonstrating reliability in assessment. Students rated AI highly for basic knowledge acquisition (Q4M = 9.18) but noted limitations in complex clinical reasoning (Q11M = 4.20) and innovative thinking (Q12M = 3.90). Key concerns of using AI included that AI reduced interaction between teachers and students (Q1M = 7.17) and standardized AI outputs led to homogenized learning (Q6M = 6.56). Despite these drawbacks, students' acceptance of AI increased significantly after the trial (5.5 to 7.6, P < 0.05).

Generative AI tools have significantly enhanced learning efficiency and performance in CBL teaching of medical biochemistry, shortened task completion time and improved examination scores. Although there are limitations in the cultivation of innovative thinking and interaction between teachers and students, students' acceptance of AI has increased. Therefore, AI should serve as a supplement to traditional teaching to balance the learning efficiency and creative thinking of students.