Surgery resident selection and evaluation. A critical incident study

This article reports a study of the process of selecting and evaluating general surgery residents. In personnel psychology terms, a job analysis of general surgery was conducted using the Critical Incident Technique (CIT). The researchers collected 235 critical incidents through structured interviews with 10 general surgery faculty members and four senior residents. The researchers then directed the surgeons in a two-step process of sorting the incidents into categories and naming the categories. The final essential categories of behavior to define surgical competence were derived through discussion among the surgeons until a consensus was formed. Those categories are knowledge/self-education, clinical performance, diagnostic skills, surgical skills, communication skills, reliability, integrity, compassion, organization skills, motivation, emotional control, and personal appearance. These categories were then used to develop an interview evaluation form for selection purposes and a performance evaluation form to be used throughout residency training. Thus a continuum of evaluation was established. The categories and critical incidents were also used to structure the interview process, which has demonstrated increased interview validity and reliability in many other studies. A handbook for structuring the interviews faculty members conduct with applicants was written, and an interview training session was held with the faculty. The process of implementation of the structured selection interviews is being documented currently through qualitative research.