Comparing ChatGPT Feedback and Peer Feedback in Shaping Students' Evaluative Judgement of Statistical Analysis: A...

Higher Degree by Research (HDR) students in language and education disciplines, particularly those enrolled in thesis-only programmes, are increasingly expected to interpret complex statistical data. However, many lack the analytical skills required for independent statistical analysis, posing challenges to their research competence. This study investigated the pedagogical potential of ChatGPT-4o feedback and peer feedback in supporting students' evaluative judgement during a 14-week doctoral-level statistical analysis course at a research-intensive university. Thirty-two doctoral students were assigned to receive either ChatGPT feedback or peer feedback on a mid-term assignment. They were then required to complete written reflections. Follow-up interviews with six selected participants revealed that each feedback modality influenced their evaluative judgement differently across three dimensions: hard (accuracy-based), soft (value-based), and dynamic (process-based). While ChatGPT provided timely and detailed guidance, it offered limited support for students' confidence in verifying accuracy. Peer feedback promoted critical reflection and collaboration but varied in quality. We therefore argue that strategically combining ChatGPT feedback and peer feedback may better support novice researchers in developing statistical competence in hybrid human-AI learning environments.