Enhancing interpretability for Bayesian basket trial designs by effective sample size

There is growing interest in utilizing Bayesian approaches to borrow information across tumor types in basket trials. Several innovative designs, primarily extensions of the Bayesian hierarchical model (BHM), have been proposed to dynamically borrow information based on observed data. However, there is no recognized solution to quantify the degree of information borrowing in such a context, posing a great challenge for non-statisticians to understand these complex designs.

The tool of effective sample size (ESS) is leveraged to Bayesian basket trials and several ESS-based borrowing strategies are proposed. The mean squared error (MSE), which explicitly accounts for the trade-off between estimation bias and variance reduction, is selected as the target measure for deriving ESS. Through a reanalysis of the RAGNAR study as well as simulation studies, the interpretability of ESS is demonstrated at both the analysis and design stages of basket trials.

ESS reflects the impact of information borrowing on MSE and intuitively characterizes the degree of borrowing. It aligns with the type I error rate and power, showing potential as a valuable complement in statistical analyses and simulation studies.

Quantifying the degree of information borrowing by ESS can greatly help trialists design Bayesian basket trials, reasonably evaluate and interpret the results of Bayesian analyses, conduct sensitivity analyses, and ultimately borrow proper amount of information in basket trials.