作为实证模型质量和排名指标的AlphaFold2准确度自我估计的基准测试:与独立模型质量评估计划的比较
Nicholas S Edmunds1, Ahmet G Genc1, Liam J McGuffin1
1School of Biological Sciences, University of Reading, Whiteknights, Reading, RG6 6EX, United Kingdom.
Bioinformatics (Oxford, England)
|August 8, 2024
概括
AlphaFold2模型质量评分 (plDDT,pTM) 准确预测三级结构,但对四级结构的准确性较低. 像ModFOLDdock这样的独立工具可以提高多链蛋白模型的排名.
科学领域:
- 计算生物学 计算生物学
- 结构生物信息学 结构生物信息学
- 蛋白质建模的模型
背景情况:
- AlphaFold2显著提升了蛋白质结构预测准确度.
- 预测和观察到的模型质量评估 (MQA) 成绩之间存在着持续的差距.
- 在CASP15.15中观察到AlphaFold2的四元模型准确性预测的变化.
研究的目的:
- 为了比较AlphaFold2的plDDT和pTM得分与三级和四级模型的观察到的lDDT和TM得分.
- 为了评估plDDT和pTM在不同评分范围和在定制的AlphaFold2条件下的可靠性.
- 为了评估plDDT和pTM的排名准确性,与独立的MQA程序ModFOLD9和ModFOLDdock对比.
主要方法:
- 对plDDT和pTM与第三级和第四级模型观察到的lDDT和TM-score进行比较分析.
- 使用真正率 (TPR) 评估模型排名准确性.
- 通过自定义模板回收来评估AlphaFold2的性能.
主要成果:
- plDDT准确预测了三级模型质量 (皮尔森r=0.97).
- 对于plDDT (r=0.67) 和pTM (r=0.70),四边形结构预测的准确性降低,在一些质量较低的模型中预测过度.
- 与AlphaFold2的pTM (TPR=0.34) 和oligo-lDDT.相比,ModFOLDdock提高了多链模型排名 (TPR=0.43),而AlphaFold2的pTM (TPR=0.34) 和oligo-lDDT.
- 定制模板回收增加了plDDT和pTM的变化,特别是在四级结构中.
结论:
- 虽然AlphaFold2在三级结构质量评估方面表现出色,但其四级结构评估需要改进.
- 像ModFOLDdock这样的独立MQA工具为多链蛋白模型提供了增强的排名功能.
- 定制AlphaFold2,如模板回收,可以影响得分可靠性,特别是在复杂的四元组件.
相关概念视频
Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K
Expected Frequencies in Goodness-of-Fit Tests
2.5K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.5K
Goodness-of-Fit Test
3.3K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.3K
Improving Translational Accuracy
9.6K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
9.6K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
47
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
47
Accuracy and Errors in Hypothesis Testing
184
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
184


