A Mixed-Methods Analysis of the Outcomes of a Peer Review Mentoring Program

Area of Science:

• Pharmacy Education
• Scholarly Publishing
• Peer Review Training

Background:

• Effective peer review is crucial for pharmacy education.
• Developing skilled peer reviewers is essential for manuscript quality.
• The AJPE Reviewer Mentorship Program (RMP) was implemented to address this need.

Purpose of the Study:

• To assess the impact of the AJPE RMP on mentee review quality and quantity.
• To understand mentee perceptions of the AJPE RMP's design and implementation.

Main Methods:

• Mixed-methods approach utilizing retrospective quantitative data (reviews completed, editor ratings) and qualitative data (focus groups).
• Quantitative data analyzed descriptively and with Wilcoxon signed rank test.
• Qualitative data from focus groups were transcribed and thematically analyzed.

Main Results:

• Mentee reviews, invitations, and ratings showed an upward trend but lacked statistical significance.
• Qualitative themes revealed increased mentee confidence and skill development.
• Strong mentor engagement was identified as critical, with suggestions for more interaction opportunities.

Conclusions:

• The AJPE RMP positively influences peer reviewer capabilities and confidence, primarily evidenced through qualitative feedback.
• While quantitative metrics did not reach statistical significance, the program shows promise in enhancing peer review skills.
• Mentee feedback provides valuable insights for refining the RMP for future iterations.