Developing evidence-based resources for evaluating postgraduate trainees in the biomedical sciences

Area of Science:

• Biomedical Sciences
• Higher Education
• Program Evaluation

Background:

• Postgraduate trainees significantly contribute to institutional academic strength through research, innovation, and mentorship.
• Effective program evaluation is essential for ensuring postgraduate training programs meet their objectives.

Purpose of the Study:

• To develop evidence-based evaluation tools for federally funded biomedical training programs.
• To enhance program evaluation capacity across institutions by creating shareable resources.

Main Methods:

• A multi-phased, sequential exploratory mixed-methods approach was employed.
• Data were collected via document analysis, focus groups, interviews, and surveys from trainees, employers, leaders, and program directors.
• Inductive coding and descriptive analysis were used to identify key themes.

Main Results:

• Two main categories emerged: Trainee Skills (6 themes) and Program Characteristics (6 themes).
• Program directors identified a need for improved evaluation of communication, social/behavioral skills, collaboration, training environment, trainee outcomes, and offered opportunities.
• Evidence-based evaluation tools, including surveys and interview scripts, were developed.

Conclusions:

• The study successfully identified critical areas for postgraduate biomedical training program evaluation.
• Developed resources are available on a public website to support program directors in enhancing their evaluation capacity.
• This initiative aims to standardize and improve the quality of program evaluation in federally funded biomedical training programs.