Related Experiment Video
Updated: Jun 25, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Expert opinion in decision-making: a systematic review of methods and the INTEGRITY framework for incorporating
Lesley Uttley1, Louise Falzon2, Nicholas Latimer2
1School of Medicine and Population Health, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK. l.uttley@sheffield.ac.uk.
Abstract:
Experts and their opinions can play a pivotal role in research for decision-making, particularly where empirical data are limited or uncertain. However, the methods by which expert input is solicited, synthesised, and applied in research often lack consistency and transparency. The absence of cross-disciplinary guidelines for how expert opinion should be gathered, integrated into research, and utilised in decision-making leaves the process vulnerable to conflicts of interest, interpersonal dynamics, and researcher discretion. Using health technology assessment (HTA) as a case study, we conducted a systematic review of empirical studies examining the use of expert opinion in research for decision-making. Twenty-three studies were included, from which six broad categories of expert consultation methods were identified, ranging from informal individual consultation to structured expert elicitation protocols. Considerable variation was observed in both the methodological rigour and transparency with which expert consultation was conducted and reported. Drawing on the review findings, we propose a preliminary conceptual framework (INTEGRITY) that synthesises psychosocial, methodological and reporting factors to promote transparency, rigour, inclusivity and objectivity when incorporating expert consultation into research. For low-stakes exploratory judgements, informal consultation may be sufficient. For high-stakes policy or resource-allocation decisions that require quantitative estimates, structured and transparent approaches such as formal elicitation protocols should be considered to support inclusive, objective, rigorous, and transparent use of expert judgement in research.
Related Concept Videos
Ethical Dilemmas II
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Ethics in Research
Introspection
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...