Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

162
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
162
Decision Making: P-value Method01:09

Decision Making: P-value Method

5.6K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.6K
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

2.0K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.0K
Statistical Significance01:50

Statistical Significance

20.3K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.3K
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

268
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
268

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cannabis use and progression to regular tobacco use among United States youth and young adults: evidence from the Population Assessment of Tobacco and Health (PATH) study, 2017-2021.

Tobacco control·2025
Same author

Pheochromocytoma-Induced Hypertension After Traumatic Brain Injury.

Cureus·2023
Same author

Actigraphic and nursing sleep log measures in moderate-to-severe traumatic brain injury: Identifying discrepancies in total sleep time.

PM & R : the journal of injury, function, and rehabilitation·2022
Same author

Comparison of the APAS Independence Automated Plate Reader System with the Manual Standard of Care for Processing Urine Culture Specimens.

Microbiology spectrum·2022
Same author

Homoscedasticity: an overlooked critical assumption for linear regression.

General psychiatry·2019
Same author

Relationship between Omnibus and Post-hoc Tests: An Investigation of performance of the F test in ANOVA.

Shanghai archives of psychiatry·2018
Same journal

Associations between wearable-device-measured daytime and nighttime light exposures and dementia risk: A prospective cohort study.

General psychiatry·2026
Same journal

Correction to "Resting-state connectivity and tobacco smoking in clinical high-risk for psychosis (NAPLS-3)".

General psychiatry·2026
Same journal

Resilient interpersonal pathways from loneliness to suicidal ideation among Chinese transgender women during global health crises.

General psychiatry·2026
Same journal

Exercise type, dose and mental health outcomes in youth: Which types and doses are sufficient?

General psychiatry·2026
Same journal

Depression meets obesity: Co-occurrence patterns, temporal trends and socioeconomic correlates across 199 countries and territories.

General psychiatry·2026
Same journal

Bilateral repetitive transcranial magnetic stimulation modulates the hemispheric imbalance in major depressive disorder.

General psychiatry·2026
See all related articles

Related Experiment Video

Updated: Aug 26, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.0K

Post-hoc power analysis: a conceptually valid approach for power based on observed study data.

Natalie E Quach1, Kun Yang1, Ruohui Chen1

  • 1Division of Biostatistics and Bioinformatics, Herbert Wertheim School of Public Health and Human Longevity Science, UC San Diego, La Jolla, California, USA.

General Psychiatry
|October 3, 2022
PubMed
Summary
This summary is machine-generated.

Post-hoc power analysis is conceptually flawed for assessing true statistical power. This study proposes an alternative formulation to address journal concerns about study reliability and sample size validity.

Keywords:
BiostatisticsObservational Studies as TopicPower, PsychologicalStatistics as Topic

More Related Videos

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

661
The Power of Interstimulus Interval for the Assessment of Temporal Processing in Rodents
10:27

The Power of Interstimulus Interval for the Assessment of Temporal Processing in Rodents

Published on: April 19, 2019

7.0K

Related Experiment Videos

Last Updated: Aug 26, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.0K
Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

661
The Power of Interstimulus Interval for the Assessment of Temporal Processing in Rodents
10:27

The Power of Interstimulus Interval for the Assessment of Temporal Processing in Rodents

Published on: April 19, 2019

7.0K

Area of Science:

  • Biostatistics
  • Clinical Trial Design
  • Scientific Publishing

Background:

  • Power analysis is crucial for prospective study planning, including clinical trials.
  • Journals increasingly request post-hoc power analyses for already analyzed data, raising conceptual concerns.
  • Previous simulations indicate post-hoc power estimates do not reflect true power and vary widely.

Purpose of the Study:

  • To address the conceptual limitations of post-hoc power analysis.
  • To provide a valid statistical approach for journal concerns regarding data reliability and sample size.
  • To propose an alternative formulation of power analysis for manuscript evaluation.

Main Methods:

  • Review of existing power analysis paradigms and their limitations.
  • Analysis of journal requirements for post-hoc power and reliability assessments.
  • Development of a revised power analysis framework through theoretical formulation.

Main Results:

  • Post-hoc power analysis is demonstrated as conceptually invalid for determining true statistical power.
  • The reliability of statistical findings is significantly influenced by sample size.
  • A new formulation of power analysis is proposed to align with journal concerns.

Conclusions:

  • The current power analysis framework is inadequate for evaluating the reliability of published statistical findings.
  • A conceptually sound alternative power analysis formulation is presented.
  • This revised approach aims to better address journal inquiries regarding study reproducibility and sample size adequacy.