Related Experiment Video
Updated: Jan 27, 2026

Using Learning Outcome Measures to assess Doctoral Nursing Education
Published on: June 21, 2010
Delphi procedure in core outcome set development: rating scale and consensus criteria determined outcome selection
Dorien De Meyer1, Jan Kottner2, Hilde Beele3
1Department of Public Health and Primary Care, Skin Integrity Research Group (SKINT), University Centre for Nursing and Midwifery, Ghent University, Ghent, Belgium.
Choosing the right rating scale and consensus criteria is crucial for core outcome set development. A nine-point scale may be better for initial consensus, while a three-point scale is suitable for final decisions.
Area of Science:
- Health Research Methodology
- Clinical Trial Design
- Patient-Reported Outcomes
Background:
- Core outcome set development is essential for standardizing outcome measurement in clinical research.
- Delphi studies are commonly used to achieve consensus on core outcomes.
- The choice of rating scales and consensus criteria can impact the selection of outcomes.
Purpose of the Study:
- To compare a three-point versus a nine-point Likert scale for consensus in a Delphi study.
- To evaluate the influence of different consensus criteria on outcome selection in core outcome set development.
Main Methods:
- A randomized controlled trial with 1:1 allocation was used for the first Delphi round.
- Participants rated 58 outcomes using either a three-point or a nine-point Likert scale.
- Consensus criteria included proportions, central tendency, and variance.
Main Results:
- The nine-point scale identified nearly twice as many "critical" outcomes as the three-point scale (24 vs. 13).
- Stricter consensus criteria and combined criteria resulted in fewer "critical" outcomes.
- Fifty-seven participants were involved in rating the outcomes.
Conclusions:
- Rating scale format and consensus criteria significantly influence outcome selection in Delphi studies.
- A nine-point scale may be beneficial for initial consensus building.
- A three-point scale may be more appropriate for finalizing consensus on core outcomes.
Related Concept Videos
Predicting Reaction Outcomes
Outcomes of Glycolysis
Cellular respiration can occur aerobically (with oxygen) or anaerobically (without oxygen). In the presence of oxygen, cellular respiration starts with glycolysis and continues with pyruvate...
Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Rate-Determining Steps
In a multistep reaction mechanism, one of the elementary steps progresses significantly slower than the others. This slowest step is called the rate-limiting step (or rate-determining step). A reaction cannot proceed faster than its slowest step, and hence, the rate-determining step limits the overall reaction rate.
The concept of rate-determining step can be understood from the analogy of a 4-lane freeway with a short-stretch of traffic-bottleneck caused due to...
Criteria for Causality: Bradford Hill Criteria - II
Criteria for Causality: Bradford Hill Criteria - I

