Related Experiment Video
Updated: Jun 13, 2026

05:25
Setup and Execution Of the Blindfolded Code Training Exercise
Published on: March 29, 2019
The SAMPL2 blind prediction challenge: introduction and overview
Matthew T Geballe1, A Geoffrey Skillman, Anthony Nicholls
1OpenEye Scientific Software Inc., Santa Fe, NM 87508, USA. mattg@eyesopen.com
Journal of Computer-Aided Molecular Design
|May 11, 2010
Summary
The SAMPL2 challenge assessed computational methods for predicting molecular interactions in water. Results show current methods struggle with transfer energies and tautomer ratios, highlighting areas for improvement in computational chemistry.
Area of Science:
- Computational chemistry
- Physical chemistry
- Molecular modeling
Background:
- Molecular interactions with aqueous environments are crucial for chemical processes.
- Accurately predicting transfer energies and tautomer ratios in solution is computationally challenging.
- The SAMPL (Statistical Assessment of the Modeling of Proteins and Ligands) challenge aims to evaluate computational methods.
Purpose of the Study:
- To blind-assess the accuracy of computational methods for predicting transfer energies and tautomer ratios.
- To identify strengths and weaknesses in current computational approaches for molecular interactions in solution.
- To provide a benchmark for future method development in computational chemistry.
Main Methods:
- The SAMPL2 (Statistical Assessment of the Modeling of Proteins and Ligands) challenge involved blind prediction of transfer energies and tautomer ratios.
- Over 60 prediction sets were submitted by participants.
- Participants also attempted to estimate the error in their predictions.
Main Results:
- The blind assessment revealed limitations in current computational methods for predicting transfer energies.
- Predicting tautomer ratios in solution also proved challenging for most participants.
- Estimating prediction errors was difficult for the majority of participants, indicating a need for better uncertainty quantification.
Conclusions:
- Current computational methods have significant room for improvement in predicting molecular transfer energies and tautomer ratios in aqueous solutions.
- The SAMPL2 results highlight specific areas where computational chemistry methods are underperforming.
- Further development is needed to enhance the accuracy and reliability of computational predictions for molecular interactions in solution.
Related Concept Videos
Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
Blinding
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
Prediction Intervals
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
The...
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
The...
Sampling Theorem
In signal processing, the analysis of continuous-time signals, denoted as x(t), often involves sampling techniques to convert these signals into discrete-time signals. This process is essential for digital representation and manipulation. A critical component in sampling is the train of impulses, characterized by the sampling interval and the sampling frequency. The relationship between these parameters and the original signal's properties dictates the success of the sampling process.
Hindsight Biases
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
Sample Size Calculation
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
