Related Experiment Video
Updated: Nov 28, 2025

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Nature and Predictors of Response Changes in Modified-Delphi Panels
Dmitry Khodyakov1, Christine Chen1
1RAND Corporation, Santa Monica, CA, USA.
Participants frequently changed their responses in modified-Delphi panels, with discussion engagement significantly influencing these shifts. Understanding these changes is key for effective group consensus building.
Area of Science:
- Decision Science
- Social Psychology
- Research Methodology
Background:
- Modified-Delphi panels are used for group consensus.
- Understanding response dynamics after group feedback is crucial.
Purpose of the Study:
- To quantify response changes in modified-Delphi panels after group feedback and discussion.
- To identify factors influencing the direction and likelihood of these changes.
Main Methods:
- Analysis of 1846 response changes from 55 participants across two online modified-Delphi panels.
- Utilized mixed-effect logistic and multinomial logistic regression models.
- Group consensus was defined by the median response.
Main Results:
- Participants altered an average of 49% of their responses.
- 47% of all responses were changed, with 28% moving toward consensus and 19% away.
- Objective measures of discussion engagement significantly predicted response changes.
Conclusions:
- Exposure to diverse perspectives and articulation of viewpoints drives response modification.
- Discussion engagement is a critical factor in modified-Delphi panel outcomes.
More Related Videos
06:16Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
13:54A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM
Published on: August 18, 2023
Related Concept Videos
Response Surface Methodology
The process of RSM involves several key steps:
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Social Proof
Predicting Reaction Outcomes
Self-Report Tests of Personality
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...