Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Trial and Error and Algorithm

Trial and Error and Algorithm

A problem-solving strategy is a plan of action used to find a solution. Different strategies have distinct action plans. Trial and error involves trying different solutions until one works. For instance, to fix a broken printer, you might check ink levels, ensure the paper tray isn't jammed, and verify the printer's connection to your laptop. This method can be time-consuming but is commonly used. Thomas Edison, for example, used trial and error to find a suitable filament for the light...

Data Validation

Data Validation

Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Accuracy and Errors in Hypothesis Testing

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...

Statistical Analysis: Overview

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...

Accuracy and Precision

Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. Highly accurate...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

On the state of protein function prediction: a report on the fourth CAFA challenge.

bioRxiv : the preprint server for biology·2026

Same author

How Not to be Seen: Predicting Unseen Enzyme Functions using Contrastive Learning.

bioRxiv : the preprint server for biology·2026

Same author

A PLUM Job: Peptide modeLs for Understanding and engineering antiMicrobial therapeutics.

bioRxiv : the preprint server for biology·2026

Same author

Exceptional Longevity Modifying Allele APOE2 Promotes DNA Signaling Pathways Resisting Cellular Senescence in Human Neurons.

Aging cell·2026

Same author

Advances in Protein Function Prediction from the Fifth CAFA Challenge.

bioRxiv : the preprint server for biology·2026

Same author

LAFA: A Framework for Reproducible Longitudinal Assessment of Protein Function Annotation Models.

ArXiv·2026

Same journal

Trust, Reproducibility, and Progress: The Roles of Independent Blind Prediction and Assessment and Benchmarking in Computational Biology.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing·2026

Same journal

The Evolving Cyberinfrastructure at the National Institutes of Health to Support Data and AI in Biomedical Research.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing·2026

Same journal

Applications of AI & ML in Biomanufacturing of Cell and Gene Therapies.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing·2026

Same journal

AI for Health: Leveraging Artificial Intelligence to Revolutionize Healthcare.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing·2026

Same journal

Workshop Introduction: Advances of AI Methods in Single Cell Spatial Omics.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing·2026

Same journal

DRIVE-KG: Enhancing variant-phenotype association discovery in understudied complex diseases using heterogeneous knowledge graphs.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Nov 14, 2025

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

Establishing the reliability of algorithms.

Lara Mangravite¹, Sean D Mooney, Iddo Friedberg

¹Sage Bionetworks, Seattle, WA, USA, lara.mangravite@sagebionetworks.org.

Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing

|March 10, 2021

Summary

This summary is machine-generated.

This workshop addresses the critical need to evaluate computational algorithm reliability in biomedical research. It focuses on methods to quantify algorithm accuracy and ensure trustworthy scientific outcomes from complex data.

More Related Videos

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit

Published on: September 8, 2023

Related Experiment Videos

Last Updated: Nov 14, 2025

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit

Published on: September 8, 2023

Area of Science:

Computational Biology
Biomedical Informatics
Data Science in Healthcare

Background:

Increasing volumes of biomedical data offer opportunities but also highlight limitations in current scientific knowledge and healthcare operations.
The research ecosystem often prioritizes insights over rigorous algorithm evaluation, leading to scientific outcomes of uncertain reliability.
Challenges include self-assessment bias and the significant impact of data context on algorithm performance in dynamic biological and medical settings.

Purpose of the Study:

To address the proliferation of scientific outcomes with unknown reliability due to inadequate algorithm evaluation.
To explore emerging approaches for quantifying the accuracy and reliability of computational algorithms in biomedical research.
To foster a community focus on robust algorithm assessment and operationalization.

Main Methods:

Focus on emerging researcher-driven approaches for quantifying algorithm accuracy.
Emphasis on evaluating algorithm performance across diverse data contexts, including real-world, non-clinical settings.
Discussion of strategies to mitigate self-assessment bias and address data heterogeneity.

Main Results:

Identification of key challenges in algorithm selection and use, including self-assessment bias and context-dependent performance.
Highlighting the risks associated with applying algorithms to data outside their intended training scope, especially in real-world scenarios.
The workshop aims to consolidate community efforts towards reliable algorithm assessment.

Conclusions:

There is a pressing need for standardized methods to evaluate the reliability of computational algorithms in the life sciences.
Addressing data context and self-assessment bias is crucial for ensuring the trustworthiness of algorithm-driven biomedical research.
Developing and adopting robust evaluation frameworks will enhance the operationalization and impact of computational tools in healthcare and life sciences.