Related Experiment Video
Updated: Aug 17, 2025

Virtual Prism Adaptation Therapy: Protocol for Validation in Healthy Adults
Published on: February 12, 2020
Validation of the GetReal Trial Tool - Facilitating discussion and understanding more pragmatic design choices and
Daniel Boateng1, Thomas Kumke2, Robin Vernooij3
1Julius Global Health, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands.
Background:
The GetReal Trial Tool is a decision support tool to assess the impact of design choices on generalizability of clinical trials to routine clinical practice, while taking into account the risk of bias, precision, acceptability and operational feasibility. This study describes the validation of the GetReal Trial Tool.
Methods:
Twelve experts took part in the GetReal Trial tool validation using the protocols of 6 trials conducted with pragmatic elements. The tool entails 7 domains with a total of 43 questions. A pooled Kappa statistic (95% CI) using random effects model was estimated using Open Meta (analyst) software. The possible operational challenges were collated and discussed with the trialists that conducted the trials.
Results:
Agreement in the design choices made for the trial protocols was >50% for all the trials and all teams reached consensus during discussion. The pooled Kappa statistic (95% CI) was 0.236 (0.154-0.318). The GetReal Trial tool highlighted several operational challenges, of which almost half had been experienced previously by the trialists. Out of 25 additional operational challenges mentioned by the trialists, 76% were already highlighted by the tool. The tool was considered helpful to optimize trials right from the design stage.
Conclusion:
The GetReal Trial Tool helps to scrutinize the choice of study design in the light of Real World Evidence generation. The tool identifies most of the operational challenges experienced by trialists to date. The tool serves the intended purpose of facilitating discussion and understanding more pragmatic design choices and their implications.
More Related Videos
07:43Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
Published on: August 4, 2023
08:33A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Related Concept Videos
Design Example: Managing Concrete Workability
Experimental Designs
Design Consideration
The factor of safety is another key...
Reliability and Validity
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...