Effectiveness of problems used in problem-based learning

Where problem-based learning (PBL) is the main method used in medical curricula, the literature suggests that it is crucial that the problems used are effective in facilitating students to identify relevant learning issues. These learning issues guide the students' studying. The present investigation explores the extent to which students identify relevant issues following exposure to prepared paper problems. In the preparatory year, in an Introduction to Medicine module, four groups of students were exposed to six themes (Health Care System, Environment and Health, Alternative and Islamic Medicine, Chronic Illness, Infectious Diseases, and Prevention and Health Promotion). Each group had two facilitators per theme. Having discussed the prepared problems, the students identified learning issues which were collected for the purpose of the study. Two content experts, using a Likert scale, analysed learning issues for their concordance to staff objectives per theme. Kappa coefficients were computed for the six PBL themes in order to assess inter-rater agreement. Learning issues identified as having no relationship to theme objectives were further analysed for their relevance to theme objectives. No objective was totally omitted by any student group. There was a 100% concordance of objectives to learning issues demonstrated over four themes. The relationship of learning issues to theme objectives ranged from 55-85% in the theme on health care system, and 73-94% in the theme on environment and health. Irrelevant learning issues were identified in the first two PBL themes addressed. Kappa coefficients over the six PBL themes varied from 0.49 to 0.82.