Related Experiment Video
Updated: Jun 21, 2026
06:16
Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
Using the Delphi method to engage stakeholders: a comparison of two studies.
1University of Northern Colorado, McKee Hall 531, Campus Box 124, Greeley, CO 80639, USA. monicageist@comcast.net
Evaluation and Program Planning
|July 8, 2009
Summary
The Delphi method effectively engages stakeholders in evaluation framing. Both paper-and-pencil and web-based formats yielded comparable data quality, though paper-and-pencil showed higher participation rates.
Area of Science:
- Program Evaluation
- Social Sciences
- Community Engagement
Background:
- Stakeholder involvement is crucial for impactful evaluation results.
- The Delphi method offers a structured approach to consensus-building.
- Traditional methods may face barriers like geography and time.
Purpose of the Study:
- To compare the effectiveness of two Delphi method formats: paper-and-pencil versus web-based.
- To assess stakeholder participation and data quality in evaluation framing.
- To determine the suitability of the Delphi method for inclusive evaluation processes.
Main Methods:
- The study employed the Delphi method, a consensus-building technique using iterative surveys and controlled feedback.
- Two versions were compared: a traditional paper-and-pencil postal mail format and a modern web-based, real-time computer format.
- Both formats were applied during the evaluation framing phase for a non-profit community-based organization.
Main Results:
- Participation rates were higher for the paper-and-pencil version of the Delphi method.
- The quantity and quality of data collected were comparable across both the paper-and-pencil and web-based formats.
- The Delphi method successfully facilitated stakeholder involvement without requiring face-to-face meetings.
Conclusions:
- The Delphi method is a viable tool for engaging diverse stakeholders in evaluation framing, overcoming logistical challenges.
- While the paper-and-pencil format may encourage greater participation, the web-based version offers comparable data outcomes.
- Both formats support the core strengths of the Delphi method in achieving consensus and gathering valuable evaluation insights.
More Related Videos
Related Concept Videos
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:15Study Design in Statistics
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
02:07Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:22Case Studies
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.