Sample size estimation for local hypothesis testing of functional data in medical studies: method comparison, recommendations, and a web application
Related Experiment Video
Updated: Jan 24, 2026

Computerized Adaptive Testing System of Functional Assessment of Stroke
Published on: January 7, 2019
Mohammad Reza Seydi1, Johan Strandberg2, Todd C Pataky3
1Department of Statistics, Umeå School of Business and Economics, Umeå University, Umeå, Sweden. mohammad.seydi@umu.se.
Abstract:
BACKGROUND: Recent medical studies have shown an increasing interest in inferential methods for analysing functional data, while statistical power analysis for sample size planning for such data is less explored. As a result, researchers often rely on classical scalar approaches to estimate sample size, despite working with functional data. This can substantially underestimate the required sample sizes. Moreover, there are no guidelines to assist researchers in planning, conducting, and reporting sample size estimation for studies analysing functional data. METHODS: Two functional data sets from medical sciences are used in a simulation study to explore a functional approach for sample size planning. These data represent two distinct patterns in mean function differences. Six well-known local inferential methods are evaluated for two-population comparisons of functional data. The evaluation focuses on the sample sizes required to achieve the target statistical power, under different data characteristics and assuming equal group sizes and stationary noise in the data generation process. We have also developed an interactive web-based application that helps researchers in performing a priori power analysis by allowing them to explore how changes in data characteristics affect statistical power, and consequently, the required sample size. RESULTS: Our comparison revealed distinct patterns in the estimated sample sizes for different data characteristics and inferential methods. Even when based on the same baseline data, the required sample sizes to achieve a target statistical power of 0.80 differed noticeably, ranging from very small to moderately large sample sizes, depending on the mean function pattern, underlying noise characteristics, and inferential approach. CONCLUSIONS: Overall, our results emphasise the importance of appropriate sample size planning and inferential method selection for valid inference in medical studies that include functional data analysis. Based on these findings, we provide guidance for researchers to follow, from study design conception through to reporting.
Related Concept Videos
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Types of Hypothesis Testing
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
Errors In Hypothesis Tests
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...

