Development and psychometric evaluation of the Implementation Science Research Project Appraisal Criteria (ImpResPAC)...

Area of Science:

• Implementation Science
• Research Methodology
• Health Services Research

Background:

• High-quality implementation research requires robust appraisal criteria.
• Existing guidance like the Implementation Science Research development (ImpRes) tool aids design but lacks a quantitative appraisal method.
• A need exists for standardized tools to evaluate the methodological rigor of implementation research.

Purpose of the Study:

• To develop and validate the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool.
• ImpResPAC is designed as a quantitative instrument to assess the conceptual and methodological quality of implementation research protocols.
• The tool aims to support grant reviewers and educators in evaluating research proposals.

Main Methods:

• A three-stage sequential mixed-methods design will be employed.
• Stage 1: Mapping core domains from the ImpRes tool and literature to ImpResPAC.
• Stage 2: International expert group refinement of ImpResPAC (content, scoring, instructions). Stage 3: Psychometric evaluation (scaling assumptions, reliability, validity) using 50 protocols from *Implementation Science*.

Main Results:

• The development protocol for the ImpResPAC tool is presented.
• The study will systematically refine and psychometrically evaluate the ImpResPAC tool.
• Application to 50 research protocols will assess its performance.

Conclusions:

• The ImpResPAC tool is anticipated to provide a comprehensive, transparent, and fair appraisal of implementation research quality.
• This will enhance the likelihood of funding methodologically sound research.
• ImpResPAC is expected to contribute to advancing the field of implementation science.