The Heuristic Value of p in Inductive Statistical Inference
Joachim I Krueger1, Patrick R Heck1
1Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, ProvidenceRI, United States.
Frontiers in Psychology
|June 27, 2017
Summary
The p-value, a key metric in Null Hypothesis Significance Testing (NHST), offers a useful heuristic for inductive inference but has limitations. Researchers should supplement p-values with other statistics for robust data interpretation.
Area of Science:
- Statistics
- Scientific Inference
- Research Methodology
Background:
- The p-value is a common output of statistical methods, representing the probability of observed data under a null hypothesis.
- Null Hypothesis Significance Testing (NHST) is a widely used inferential framework.
- The p-value has faced considerable scrutiny regarding its interpretation and utility.
Purpose of the Study:
- To evaluate the predictive accuracy of p-values for the probability of a hypothesis being true.
- To assess the p-value's ability to predict the reproducibility of significant results.
- To investigate the impact of sample size on inferential accuracy, bias, and error.
Main Methods:
- The study employed a series of simulation experiments.
- These simulations explored the behavior of p-values under varying conditions.
Main Results:
- P-values function effectively as heuristic cues in inductive inference.
- However, the usefulness of p-values has identifiable limitations.
- Sample size significantly influences inferential accuracy, bias, and error.
Conclusions:
- While generally useful, p-values alone are insufficient for comprehensive inductive inference.
- Researchers should consider supplementing p-values with other statistical measures.
- Effect size estimates, Bayes factors, and other statistics can enhance data interpretation and communication.
Related Concept Videos
01:09Decision Making: P-value Method
7.0K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
7.0K
01:10P-value
9.1K
P-value is one of the most crucial concepts in statistics.
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
9.1K
00:59Inductive Reasoning
68.8K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
68.8K
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
544
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
544
01:14Decision Making: Traditional Method
5.6K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.6K
01:24Testing a Claim about Population Proportion
4.0K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
4.0K