Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

280
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
280
Hypothesis: Accept or Fail to Reject?01:17

Hypothesis: Accept or Fail to Reject?

28.3K
The outcome of any hypothesis testing leads to rejecting or not rejecting the null hypothesis. This decision is taken based on the analysis of the data, an appropriate test statistic, an appropriate confidence level, the critical values, and P-values. However, when the evidence suggests that the null hypothesis cannot be rejected, is it right to say, 'Accept' the null hypothesis?
There are two ways to indicate that the null hypothesis is not rejected. 'Accept' the null...
28.3K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

290
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
290
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

2.1K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.1K
Ranks01:02

Ranks

285
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
285
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Evaluating methylphenidate as a potential treatment for cocaine use disorder: a propensity score-matched study.

The American journal of drug and alcohol abuse·2026
Same author

Evaluating the Impact of Blood-Brain Barrier-Penetrant ACE Inhibitors on HIV-Associated Neurocognitive Disorders.

Journal of acquired immune deficiency syndromes (1999)·2026
Same author

DEAD-Box Helicase 3 Modulates the Non-Coding RNA Pool in Ribonucleoprotein Condensates During Stress Granule Formation.

Non-coding RNA·2025
Same author

AI-based mining of biomedical literature: Applications for drug repurposing for the treatment of dementia.

Artificial intelligence in medicine·2025
Same author

Single-particle tracking of genetically encoded nanoparticles: Optimizing expression for cytoplasmic diffusion studies.

Biophysical journal·2025
Same author

Identification of EcoHIV-Infected Cells in Microglia-Manipulated Transgenic Mice.

Journal of visualized experiments : JoVE·2025

Related Experiment Video

Updated: Sep 5, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

559

Large-Scale Validation of Hypothesis Generation Systems via Candidate Ranking.

Justin Sybrandt1, Michael Shtutman2, Ilya Safro1

  • 1Clemson University, School of Computing, Clemson, USA.

Proceedings : ... IEEE International Conference on Big Data. IEEE International Conference on Big Data
|July 5, 2022
PubMed
Summary
This summary is machine-generated.

Automated hypothesis generation systems need better validation. We developed a new framework to numerically evaluate these systems, successfully identifying a novel link between HIV-associated neurodegenerative disease and DDX3.

Keywords:
Applied Data ScienceHypothesis GenerationLiterature Based DiscoveryScientific Text Mining

More Related Videos

Drug Repurposing Hypothesis Generation Using the "RE:fine Drugs" System
05:10

Drug Repurposing Hypothesis Generation Using the "RE:fine Drugs" System

Published on: December 11, 2016

9.7K
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.6K

Related Experiment Videos

Last Updated: Sep 5, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

559
Drug Repurposing Hypothesis Generation Using the "RE:fine Drugs" System
05:10

Drug Repurposing Hypothesis Generation Using the "RE:fine Drugs" System

Published on: December 11, 2016

9.7K
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.6K

Area of Science:

  • Computational biology
  • Bioinformatics
  • Scientific discovery

Background:

  • Automated hypothesis generation (HG) systems accelerate research by identifying novel scientific connections.
  • Current validation methods for HG systems are often time-consuming, expensive, and difficult to scale.
  • A standardized, numerical evaluation framework is needed to rigorously assess HG system performance.

Purpose of the Study:

  • To introduce a novel numerical evaluation framework for validating automated hypothesis generation systems.
  • To develop new metrics for quantifying hypothesis plausibility from topic models.
  • To demonstrate the framework's utility in identifying biologically relevant research candidates.

Main Methods:

  • Developed a numerical evaluation framework using thousands of validation hypotheses to rank HG system outputs by plausibility.
  • Introduced novel metrics to assess hypothesis plausibility based on topic model system outputs.
  • Deployed the validation framework within the MOLIERE HG system to identify candidate genes for HAND.

Main Results:

  • The proposed framework provides a scalable and efficient method for validating HG systems.
  • Novel metrics were developed to quantify hypothesis plausibility from topic models.
  • The MOLIERE system, using this framework, identified candidate genes for HIV-associated neurodegenerative disease (HAND).
  • Laboratory experiments confirmed a new association between HAND and Dead Box RNA Helicase 3 (DDX3).

Conclusions:

  • The developed numerical evaluation framework offers a robust and scalable approach to HG system validation.
  • This method aids in prioritizing research candidates and can lead to significant discoveries.
  • The discovery of a new link between HAND and DDX3 highlights the practical utility of the validation framework.