Related Experiment Video
Updated: Feb 12, 2026

A Standardized Protocol for Preference Testing to Assess Fish Welfare
Published on: February 22, 2020
On Abandoning Hypothesis Testing in Environmental Standard Compliance Assessment
Song S Qian1, Robert J Miltner2
1Department of Environmental Sciences, The University of Toledo, 2801 West Bancroft Street, MS# 604, Toledo, OH, 43606-3390, USA. song.qian@utoledo.edu.
Hypothesis testing is inefficient for environmental compliance assessment due to small sample sizes and high data variability. A shift to statistical estimation offers a more effective probabilistic approach for water quality monitoring.
Area of Science:
- Environmental Science
- Environmental Monitoring
- Statistical Analysis
Background:
- Environmental standard compliance assessments often rely on hypothesis testing.
- Typical environmental assessments use small sample sizes and face high natural variability in water quality constituents.
- These conditions significantly reduce the statistical power of hypothesis tests.
Purpose of the Study:
- To argue for the abandonment of hypothesis testing in environmental standard compliance assessment.
- To highlight the inefficiencies and limitations of current hypothesis testing practices.
- To propose an alternative statistical estimation approach for improved environmental monitoring.
Main Methods:
- Analysis of basic characteristics of statistical significance tests.
- Illustration of problems using two case examples of environmental compliance assessment.
- Comparison of hypothesis testing with a statistical estimation approach.
Main Results:
- Hypothesis testing in environmental assessments often has low statistical power, leading to inefficient noncompliance detection.
- Detected noncompliance is frequently attributed to sampling or other errors rather than actual environmental issues.
- Current practices of assessing compliance water by water are insufficient to resolve these inherent problems.
Conclusions:
- The hypothesis testing framework is inadequate for environmental standard compliance assessment.
- A statistical estimation approach, utilizing probabilistic methods, is recommended for more effective environmental monitoring.
- Leveraging information from similar water assessments can enhance the reliability of compliance evaluations.
Related Concept Videos
Types of Hypothesis Testing
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
Errors In Hypothesis Tests
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...

