Related Experiment Video
Updated: May 30, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Assessment of a novel hybrid Delphi and Nominal Groups technique to evaluate quality indicators
Sheryl Davies1, Patrick S Romano, Eric M Schmidt
1Center for Primary Care and Outcomes Research, Stanford University CHP/PCOR, 117 Encina Commons, Stanford, CA 94305-6019, USA. smdavies@stanford.edu
Objective:
To test the implementation of a novel structured panel process in the evaluation of quality indicators.
Data Source:
National panel of 64 clinicians rating usefulness of indicator applications in 2008-2009.
Study Design:
Hybrid panel combined Delphi Group and Nominal Group (NG) techniques to evaluate 81 indicator applications.
Principal Findings:
The Delphi Group and NG rated 56 percent of indicator applications similarly. Group assignment (Delphi versus Nominal) was not significantly associated with mean ratings, but specialty and research interests of panelists, and indicator factors such as denominator level and proposed use were. Rating distributions narrowed significantly in 20.8 percent of applications between review rounds.
Conclusions:
The hybrid panel process facilitated information exchange and tightened rating distributions. Future assessments of this method might include a control panel.
Related Concept Videos
Quality Assurance
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Qualitative Analysis
For instance, group IV...
Qualitative Analysis
There are two main approaches to qualitative analysis:...
Methods of Medium Optimization
Friedman Two-way Analysis of Variance by Ranks