Exploring Artificial Intelligence-Generated Feedback for Pharmacy Students

The integration of artificial intelligence (AI) into educational environments is accelerating, with growing interest in its potential to enhance learning outcomes. This pilot study aimed to assess student perceptions regarding the quality and educational impact of AI-generated feedback.

Second-professional-year pharmacy students (n = 148) enrolled in a drug literature evaluation course received AI-generated feedback for a draft assignment which required students to critically evaluate a recently published journal article. Feedback was generated by an AI assistant that offered iterative feedback based on the assignment rubric. After the activity, students completed an electronic survey instrument evaluating the AI feedback regarding its alignment with rubric criteria, accuracy, clarity, and tone. Student perceptions of the feedback's impact on learning were also assessed.

A total of 148 students (100%) completed the activity and responded to at least one item of the survey tool. Most students agreed with the AI-generated feedback for each section of the assignment in regard to clarity (61.5% to 76.2%) and tone (66.9% to 74.3%), with lower agreement related to alignment with the rubric (33.8% to 60.4%) and accuracy (34.5% to 54.2%). Students also expressed concern about the reliability of AI feedback (71.2%) and risk for plagiarism (50%).

AI-generated feedback was positively received in some areas. However, students expressed apprehension regarding its accuracy, reliability, and potential accusation of plagiarism. These findings suggest further refinement is necessary to enhance AI trustworthiness and educational value in academic settings.