Testing the interrater reliability of integrated interpretations using a problem-solving model

[Purpose] A method for evaluating integrated interpretation skills, which is an important educational goal in clinical practice, is yet to be established. This study examined the interrater reliability of a problem-solving model that was developed as a novel assessment method. [Participants and Methods] Three students created problem-solving models using fictitious case data. Ten clinical practice supervisors with at least 3 years of experience were asked to score the models, and the intraclass correlation coefficient (2, 1) was calculated. [Results] The intraclass correlation coefficient was 0.88, which indicates a good result. [Conclusion] Good interrater reliability was obtained using the problem-solving model, which suggests that this model may be used to assess integrated interpretation skills in clinical practice.