Content validation of a quantitative stakeholder engagement measure

Area of Science:

• Social Sciences
• Research Methodology

Background:

• Developing standardized measures for stakeholder engagement in research is crucial.
• Understanding the impact of engagement on scientific discovery and processes requires reliable assessment tools.

Purpose of the Study:

• To conduct content validation and item reduction of a quantitative measure of research engagement.
• To refine a measurement tool using a stakeholder-engaged approach.

Main Methods:

• A five-round modified Delphi process was employed to achieve consensus on measurement items.
• Web-based surveys were used for rounds 1-3 and 5, with an in-person meeting for round 4.
• Panelists received individualized and aggregate feedback after initial survey rounds.

Main Results:

• The number of items in the research engagement measure was reduced from 48 to 32.
• Items were modified, added, dropped, and reallocated across eight engagement principles.
• The final measure includes three to five items per engagement principle.

Conclusions:

• Validated, quantitative measures of stakeholder engagement are essential for research.
• Accurate assessment tools are necessary to evaluate the relationship between engagement and research outcomes.
• This refined measure provides a reliable instrument for assessing research engagement.