Related Experiment Video
Updated: May 1, 2026
05:37
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
2.3K
Combining test statistics and models in bootstrapped model rejection: it is a balancing act
Rikard Johansson, Peter Strålfors, Gunnar Cedersund1
1Department of Biomedical Engineering (IMT), Linköping University, Linköping, Sweden. gunnar.cedersund@liu.se.
BMC Systems Biology
|April 19, 2014
Summary
Combining statistical tests using bootstrapping can be unreliable. A novel two-dimensional parametric bootstrapping method offers consistent and powerful model rejection, outperforming simpler approaches for systems biology.
Area of Science:
- Systems Biology
- Computational Biology
- Statistical Modeling
Background:
- Model rejection is crucial in systems biology for validating mechanistic assumptions against experimental data.
- Traditional statistical tests like chi-square (χ2) and Durbin-Watson (DW) often fail due to unmet assumptions.
- Bootstrapping offers an alternative for empirical distribution calculation but is computationally intensive and its extension to joint distributions is underexplored.
Purpose of the Study:
- To investigate reliable methods for combining bootstrapped statistical tests in model rejection.
- To develop and evaluate a novel two-dimensional (2D) parametric bootstrapping approach for enhanced statistical power and consistency.
- To compare the performance of various 2D bootstrapping strategies, including 2D χ2vsχ2 and bootstrapped log-likelihood ratio (LHR).
Main Methods:
- Evaluation of simplistic combinations of bootstrapped tests (e.g., max/min p-values) for model rejection.
- Development and application of a 2D parametric bootstrapping framework.
- Comparison of 2D χ2vsχ2 tests with varying complexity of a secondary 'help' model.
- Assessment of the bootstrapped log-likelihood ratio (LHR) as a powerful 1D approach derived from 2D distributions.
Main Results:
- Simple combinations of bootstrapped tests yield inconsistent results (overly conservative or liberal).
- The proposed 2D parametric bootstrapping approach demonstrates consistency and superior power compared to individual tests.
- A 2D χ2vsχ2 test using an appropriate 'help' model shows high efficacy.
- The bootstrapped LHR emerges as the most powerful method when a suitable 'help' model is identified, due to its dimensionality and information retention.
Conclusions:
- Established guidelines for effectively combining statistical tests within a bootstrap framework.
- Demonstrated the advantage of incorporating a second model in specific bootstrapping scenarios.
- Provided deeper insights into the log-likelihood ratio (LHR) for nonlinear and non-nested models.
- Highlighted the value of advanced bootstrapping methods for prioritizing accuracy and statistical power in complex biological modeling.
Related Concept Videos
01:24Bootstrapping
789
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
789
01:02Quantifying and Rejecting Outliers: The Grubbs Test
4.0K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.0K
01:16Statistical Hypothesis Testing
6.0K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
6.0K
01:09Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
6.2K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
6.2K
01:14Decision Making: Traditional Method
4.4K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.4K
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
729
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
729