Delphi research: issues raised by a pilot study.

Area of Science:

• Healthcare Research Methodology
• Qualitative Research Methods
• Consensus Building Techniques

Background:

• The Delphi method, while widely used, lacks extensive academic discussion on effective piloting strategies.
• Effective piloting is essential for managing the complexities of Delphi studies for both researchers and expert panellists.

Purpose of the Study:

• To explore critical issues and best practices in the pilot stage of a three-round Delphi study.
• To address the gap in the literature regarding the piloting of Delphi research.

Main Methods:

• A pilot Delphi study was conducted to test initial questions, measurement approaches, and administrative processes for a larger study on therapeutic nursing in acute mental health wards.
• A literature review of health care Delphi pilot studies published between 2001 and 2011 was performed, including ten relevant papers.

Main Results:

• Pilot studies are valuable for developing and refining first-round questions in Delphi research.
• Piloting allows for the testing of measurement methods, consensus thresholds, and feedback mechanisms for subsequent rounds.
• Pilot testing also helps in refining recruitment strategies to prevent delays between study rounds.

Conclusions:

• Pilot studies offer essential guidance for various aspects of Delphi research, including question development, measurement, and consensus definition.
• Researchers utilizing the Delphi method should prioritize and publish detailed accounts of their pilot study methodologies.
• Thorough pilot testing supports the successful involvement of diverse participants, such as service users and professionals.