Related Concept Videos
Propagation of Uncertainty from Random Error
Uncertainty: Overview
Propagation of Uncertainty from Systematic Error
Uncertainty: Confidence Intervals
The Uncertainty Principle
Uncertainty in Measurement: Accuracy and Precision
You might also read
Related Articles
Articles linked to this work by shared authors, journal, and citation graph.
Enhancing molecular property prediction through data integration and consistency assessment.
Practically Significant Method Comparison Protocols for Machine Learning in Small Molecule Drug Discovery.
Uncertainty Quantification in Molecular Machine Learning for Property Predictions under Data Shifts.
Raquel Parrondo-Pizarro1,2, Jessica Lanini1, Raquel Rodríguez-Pérez1
1Novartis Biomedical Research, Novartis Campus, Basel 4002, Switzerland.
Machine learning (ML) models predict drug properties, but quantifying prediction uncertainty is key. Combining data and model-based uncertainty metrics with error models significantly improves reliability in molecular property prediction.
More Related Videos
11:22Using Three-color Single-molecule FRET to Study the Correlation of Protein Interactions
Published on: January 30, 2018
12:05A Simple, Robust, and High Throughput Single Molecule Flow Stretching Assay Implementation for Studying Transport of Molecules Along DNA
Published on: October 1, 2017
Area of Science:
- Computational chemistry
- Drug discovery
- Machine learning applications
Background:
- Machine learning (ML) models are vital for predicting compound properties in drug discovery.
- Accurate prediction requires quantifying the uncertainty (UQ) of ML model outputs.
- Existing UQ methods lack consistent superior performance across diverse datasets.
Purpose of the Study:
- To benchmark various uncertainty quantification (UQ) strategies for ML-based prediction of absorption, distribution, metabolism, and excretion (ADME) properties.
- To evaluate UQ method performance under data shifts using the UNIQUE framework.
- To identify robust UQ approaches for reliable molecular property prediction.
Main Methods:
- Comprehensive benchmarking of UQ strategies using in-house and public datasets.
- Application of the UNIQUE (UNcertaInty QUantification bEnchmarking) framework.
- Evaluation of UQ performance under various data shift scenarios.
Main Results:
- Data-based (e.g., chemical distance) and model-based (e.g., prediction variance) UQ metrics capture complementary uncertainty aspects.
- Combining diverse UQ metrics through error models, which predict ML model error, yields superior uncertainty estimates.
- Error models demonstrate robustness and high-quality uncertainty estimation even with data shifts.
Conclusions:
- Combining diverse UQ metrics and error modeling offers a promising strategy to enhance reliability in molecular property prediction.
- Standardized evaluation setups and assessment under data shifts are crucial for future UQ method development.
- This work provides a foundation for advancing UQ in cheminformatics and drug discovery.
