Related Experiment Video
Updated: May 12, 2026
06:28
E-Patient Counseling Trial (E-PACO): Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
Dutch postgraduate GP selection procedure; reliability of interview assessments
Margit I Vermeulen1, Marijke M Kuyvenhoven, Nicolaas P A Zuithoff
1Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, The Netherlands. M.I.Vermeulen@umcutrecht.nl
BMC Family Practice
|March 30, 2013
Summary
Selection interviews for general practice (GP) training demonstrate satisfactory reliability with two assessors. Candidate qualities, not individual characteristics, predict admission, regardless of application number.
Area of Science:
- Medical Education
- Healthcare Professional Training
- Selection Procedures
Background:
- Semi-structured interviews are central to Dutch postgraduate general practice (GP) training selection.
- Assessments of personal qualities are conducted independently by staff, trainers, and trainees.
- The study aimed to enhance the selection procedure by examining interview reliability.
Purpose of the Study:
- To evaluate the inter-rater reliability of GP training selection interviews with varying numbers of assessors.
- To determine the predictive validity of candidate characteristics and qualities for admission into GP training.
- To assess if these factors differ between first-time and repeat applicants.
Main Methods:
- An observational study included 394 candidates in the Utrecht selection procedure (2008-2010).
- Data on candidate characteristics and qualities were collected.
- Inter-rater reliability (ICC) was estimated for interview groups of two or three assessors; factors influencing admission were analyzed.
Main Results:
- Of 365 eligible candidates, 206 (56.4%) were admitted to GP training.
- Inter-rater reliability was satisfactory (ICC: 0.78–0.84), with a slight decrease when reducing assessors from three to two.
- Candidate qualities significantly predicted admission, while individual characteristics did not; results were consistent for first-time and repeat applicants.
Conclusions:
- Selection interviews using two assessors provide adequate reliability for GP training admissions.
- Admission is primarily predicted by assessed candidate qualities, not individual characteristics.
- The predictive validity of interviews is consistent across first-time and repeat applicants.
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
02:16Surveys
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
01:22Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.