An evaluation system for postgraduate pediatric residency programs: report of a 3-year experience

The way a postgraduate medical training program is organized and the capacity of faculty members to function as tutors and to organize effective professional experiences are among the elements that affect the quality of training. An evaluation system designed to target these elements has been implemented within the framework of the Pediatric Residency Program of the University of Padua (Italy). The aim of this report is to describe some aspects of the experience gained in the first 3 years of implementation of the system (2013-2015). Data were collected using four validated questionnaires: the "Resident Assessment Questionnaire", the "Tutor-Assessment Questionnaire", the "Rotation-Assessment Questionnaire", and the "Resident Affairs Committee-Assessment Questionnaire". The response rate was 72% for the "Resident Assessment Questionnaires"; 78% for the "Tutor-/Rotation-Assessment Questionnaires" and 84% for the "Resident Affair Committee-Assessment Questionnaires". The scores collected were validated by psychometric tests.

The high rates of completed questionnaires returned and the psychometric validation of the results collected indicate that the evaluation system reported herein can be effectively implemented. Efforts should be made to refine this system and, more importantly, to document its impact in improving the Pediatric Residency Program. What is known: • The elements that influence the quality of postgraduate training programs and the knowledge, performance, and competences of residents must be regularly assessed. • Comprehensive evaluation systems for postgraduate residency programs are not universally implemented also because quite often common guidelines and rules, well-equipped infrastructures, and financial resources are missing. What is new: • We show the feasibility of implementing an evaluation system that targets some of the key elements of a postgraduate medical training program in Italy, a European country in which the regulations governing training programs and, notably, the evaluation of residents are still being developed.