Related Experiment Video
Updated: Jun 1, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Using e-mail recruitment and an online questionnaire to establish effect size: A worked example.
Helen M Kirkby1, Sue Wilson, Melanie Calvert
1MRC Midlands Hub for Trials Methodology Research (HTMR), School of Health and Population Science, University of Birmingham, Edgbaston, B15 2TT, UK. s.Wilson@bham.ac.uk.
Estimating effect size for sample size calculations can be challenging. This study demonstrates that expert opinion, gathered via a simple online survey, provides a feasible method for determining effect size when prior data is unavailable.
Area of Science:
- Clinical Trials Methodology
- Biostatistics
- Health Services Research
Background:
- Sample size calculations are crucial for clinical trial design.
- Effect size estimations are often unavailable for novel interventions or populations.
- Expert opinion offers a potential solution for estimating effect sizes in such scenarios.
Purpose of the Study:
- To report a strategy for gathering expert opinion to estimate effect size.
- To assess the feasibility of using expert opinion for sample size calculations.
- To inform sample size determination when empirical data is lacking.
Main Methods:
- Researchers in clinical trial design and analysis were recruited via email.
- An online questionnaire was used to collect expert opinions on a hypothetical intervention (electronic participant information sheet).
- Participants indicated desired recruitment rate increases to consider adopting the intervention, analyzed using descriptive statistics.
Main Results:
- A 33% response rate was achieved from 115 potential participants.
- Respondents desired recruitment rate increases ranging from 6.9% to 28.9% based on baseline rates.
- The collected expert opinions were successfully applied to sample size calculations for a research protocol.
Conclusions:
- Expert opinion can be efficiently collected using simple email recruitment and online surveys.
- This method provides a practical approach to estimating effect sizes when previous research data is absent.
- The gathered opinions were valuable for informing sample size calculations in a PhD study.
Related Concept Videos
Surveys
Group Design
Statistical Significance
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Margin of Error
Sample Size Calculation
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
