Clinitalk: evaluation of a web-based feedback platform supporting consultation skill development in UK GP training

Consultation skills are central to general practice and the MRCGP Simulated Consultation Assessment (SCA). Clinitalk is a digital platform enabling GP trainees to record and reflect on consultations, supported by AI-generated feedback to facilitate deliberate practice.

To evaluate Clinitalk using Kirkpatrick's four-level model of training evaluation, focusing on user satisfaction, learning outcomes, behavioural change, and alignment with professional standards.

This descriptive evaluation analysed anonymised data from over 13,000 Clinitalk recordings from GP trainees across the UK. Quantitative metrics included clinician talk time, open-to-closed question ratio, timing of management initiation, and consulting behaviour ratings. Qualitative feedback from trainees, trainers, and RCGP examiners was analysed using inductive thematic analysis. User surveys assessed helpfulness and SCA preparedness.

At Kirkpatrick Level 1 (Reaction), surveys (n = 124) reported mean helpfulness of 9.3/10, with all users feeling better prepared for the SCA. At Level 2 (Learning), qualitative analysis identified increased self-awareness, enhanced patient-centredness, and improved understanding of consultation structure. At Level 3 (Behaviour), average clinician talk time reduced by 18% over 20 months, management was initiated 1.1 minutes earlier, and higher open-to-closed question ratios correlated with lower talk time and improved tailored management ratings. RCGP examiner review showed 96.4% agreement with Clinitalk's ratings.

Clinitalk is associated with positive outcomes across the first three Kirkpatrick levels. Digital feedback tools may enhance reflective practice, promote patient-centred care, and support equitable GP training in resource-constrained settings.