Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Data Validation01:15

Data Validation

162
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
162

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Longitudinal analysis of CYFRA 21-1 levels in patients with pulmonary nodules: Differential trajectories between benign and malignant cases.

PloS one·2026
Same author

Charting Cervical Spinal Cord Morphometry Across the Lifespan.

bioRxiv : the preprint server for biology·2026
Same author

Missing infrastructure for real-world predictive AI impact.

BMJ health & care informatics·2026
Same author

Regulating digital surgery to balance safety and innovation: a SAGES white paper.

Surgical endoscopy·2026
Same author

Towards Conversational AI for Disease Management.

Nature·2026
Same author

What are the ethical, legal and social considerations for recording, sharing and utilizing surgical videos? A thematic analysis and framework to guide stakeholders.

Surgical endoscopy·2026
Same journal

Spatio-DARLIN enables robust and efficient in situ lineage tracing in mice at single-cell resolution.

Nature methods·2026
Same journal

EasyGrid: a versatile platform for automated cryo-EM sample preparation and quality control.

Nature methods·2026
Same journal

Cloud-based microscope enables live neuroimaging for 24 h and beyond with worldwide access.

Nature methods·2026
Same journal

Deep molecular profiling in three dimensions.

Nature methods·2026
Same journal

3D pathology-guided microdissection.

Nature methods·2026
Same journal

Challenges and recommendations in establishing national human diversity genomic projects.

Nature methods·2026
See all related articles

Related Experiment Video

Updated: Jul 3, 2025

Measuring the Shape and Size of Activated Sludge Particles Immobilized in Agar with an Open Source Software Pipeline
09:27

Measuring the Shape and Size of Activated Sludge Particles Immobilized in Agar with an Open Source Software Pipeline

Published on: January 30, 2019

7.1K

Metrics reloaded: recommendations for image analysis validation.

Lena Maier-Hein1,2,3,4,5, Annika Reinke6,7,8, Patrick Godau9,10,11

  • 1German Cancer Research Center (DKFZ) Heidelberg, Division of Intelligent Medical Systems, Heidelberg, Germany. l.maier-hein@dkfz-heidelberg.de.

Nature Methods
|February 12, 2024
PubMed
Summary
This summary is machine-generated.

Flaws in machine learning (ML) algorithm validation hinder biomedical progress. Metrics Reloaded offers a framework and tool for problem-aware metric selection, improving ML translation in medical imaging.

More Related Videos

Using Computer Vision Libraries to Streamline Nuclei Quantification
06:25

Using Computer Vision Libraries to Streamline Nuclei Quantification

Published on: June 6, 2025

158
Automated Quantification and Analysis of Cell Counting Procedures Using ImageJ Plugins
11:01

Automated Quantification and Analysis of Cell Counting Procedures Using ImageJ Plugins

Published on: November 17, 2016

47.1K

Related Experiment Videos

Last Updated: Jul 3, 2025

Measuring the Shape and Size of Activated Sludge Particles Immobilized in Agar with an Open Source Software Pipeline
09:27

Measuring the Shape and Size of Activated Sludge Particles Immobilized in Agar with an Open Source Software Pipeline

Published on: January 30, 2019

7.1K
Using Computer Vision Libraries to Streamline Nuclei Quantification
06:25

Using Computer Vision Libraries to Streamline Nuclei Quantification

Published on: June 6, 2025

158
Automated Quantification and Analysis of Cell Counting Procedures Using ImageJ Plugins
11:01

Automated Quantification and Analysis of Cell Counting Procedures Using ImageJ Plugins

Published on: November 17, 2016

47.1K

Area of Science:

  • Biomedical Image Analysis
  • Machine Learning Validation

Background:

  • Inadequate performance metrics in ML algorithm validation impede scientific progress and clinical translation in biomedical image analysis.
  • Current validation practices often fail to align with specific domain interests, leading to unreliable assessments of ML model performance.

Purpose of the Study:

  • To introduce Metrics Reloaded, a comprehensive framework for guiding researchers in selecting appropriate validation metrics for ML algorithms.
  • To address the critical issue of flawed ML algorithm validation in biomedical image analysis.

Main Methods:

  • Developed through a multistage Delphi process by an international consortium.
  • Introduced the 'problem fingerprint' concept for structured problem representation relevant to metric selection.
  • Implemented the framework as an accessible online tool, Metrics Reloaded.

Main Results:

  • The Metrics Reloaded framework guides users in selecting and applying suitable validation metrics, highlighting potential pitfalls.
  • The framework is applicable to various image analysis tasks, including image-level classification, object detection, semantic segmentation, and instance segmentation.
  • Demonstrated applicability across diverse biomedical use cases.

Conclusions:

  • Metrics Reloaded promotes standardized and problem-aware validation methodologies in machine learning.
  • The framework and associated tool enhance the reliability and translation of ML techniques in biomedical image analysis.