Implementation and evaluation of a Tele-OSCE in oral and maxillofacial surgery - a pilot report

The ongoing changes in learning and education towards digitalisation have been rapidly accelerated by the COVID-19 pandemic. Especially in dental education where contact to the oral cavity is an integral part of training the chosen digital examination methods and training formats must undergo high requirements to full fill the goal of a real alternative to face-to-face exams. Therefore, this study compared student performance in a newly developed Tele-OSCE with a prior OSCE examinations in presence within an oral- and maxillofacial surgery curriculum.

Study participants were fourth-year (in a five year curriculum) dental students and board certified maxillofacial surgeons (examiners) that took part in a newly developed Tele-OSCE that comprised three five-minute stations (structured facial examination, management mandibular fracture and squamous cell carcinoma) using the zoom® software. Student performance was measured using validated OSCE-Checklists and compared to a previous OSCE examination from the winter term 2019 with the same OSCE stations that was conducted in presence. Significant differences were tested using the Mann-Whitney U test. Furthermore, the new Tele-OSCE was evaluated by students and examiners using previously developed questionnaires.

Sixty-six dental students (study group: n=34, summer term 2021, control group: n=32 winter term 2019) and nine examiners participated in the study. Compared to previous non-pandemic OSCEs, there were no significant (p=0.53) differences in overall student performance. Evaluation of the Tele-OSCE showed that the demonstration and rating of practical skills was limited due to missing standard patients or phantoms, however, students did not fear to be misjudged. The demonstration and rating of anamnestic and consultation competencies was seen as unproblematic by students and examiners.

This pilot-study showed the feasibility of a Tele-OSCE as a formative examination in dental education. However, both students and examiners felt that the demonstration and assessment of practical skills was limited due the new examination format. Nevertheless, Tele-OSCEs might offer an alternative to enable students to complete their dental training.