Comparison of Artificial Intelligence Chatbots and Dental Students on Context of Dental Trauma

Daily use of chatbots has become widespread in dental education just as in every other field. Dental students consult them when performing tasks and studying for exams. This study aims to test comprehension abilities and knowledge of 5 different chatbots (Gemini 1.5/1.5Pro, ChatGPT 4.0/4.0o, and Deepseek) and compare them with students' at the topic of dental trauma.

The questionnaire is designed as 25 multiple-choice questions according to International Association of Dental Traumatology guideline and it's divided to three groups as 'indication and description', 'intervention and treatment' and 'splint and follow up times'. The prepared questions in the survey were asked to five different chatbots (Gemini 1.5/1.5Pro, ChatGPT 4.0/4.0o and Deepseek) and 4th/5th (n = 134) year dental students. The accuracy percentages were calculated by the answers of the students and chatbots. While examining Skewness and Kurtosis test for data distribution, ANOVA test was used to assess the differences between the participant.

After achievement test adjustments the highest mark of total questionnaire is received by the 5th graders (69.96%) and it's followed by the ChatGPT 4.0 and Gemini 1.5 Pro (68.75%) with the same score. Other chatbots couldn't be successful to reach out the level of knowledge of 5th or 4th graders (65.85%).

The speed and efficiency of artificial intelligence bots in providing information are undeniable. However, as the results of this study indicate that all the information they provide is not accurate, it is important to examine the sources of these responses and verify the information with multiple references.