Development of computer-based OSCE re-examination system for minimizing inter-examiner discrepancy

The validity of objective structured clinical examination (OSCE) in evaluating clinical skills has been confirmed in a number of studies. However, inter-examiner reliability has been noted as a concern by many educators. To minimize discrepancy between examiners, in application of the OSCE, we have developed an OSCE attitude and skill test re-examination system. Student performance was digitally, filmed and stored as electronic files. When results showed inter-examiner discrepancy, those items were automatically extracted in the form of a re-examination sheet to allow student re-evaluation by a third examiner in reference to the relevant film files. This system facilitates feedback to each examiner and examinee, offering a potentially useful tool for attitude and skill education.