A quantitative reliability metric for querying large database
Zewei Chen1, Peter de Boves Harrington1, Preshious Rearden2
1Chemistry Laboratories, Department of Chemistry and Biochemistry, Ohio University, Athens, OH 45701, USA.
Abstract:
A redesigned quantitative reliability metric based on the F-distribution (QRMf) is reported for evaluating the reliability of library search. The QRMf provides orthogonal information to the comparison metric (e.g., dot product) and yields a probabilistic result. An intralibrary search can be considered as an idealized search because the top hit, i.e., the closest matching object, will match perfectly. If the search of an unknown object yields the same hit list as the intralibrary search, it would indicate good reliability. For each object in the hit list, a QRMf compares the order of an intralibrary and interlibrary search results and calculates a variance of interlibrary similarity metrics between the records of the intralibrary search and records in the corresponding positions of the interlibrary search. This variance that measures the discordance of the intra and interlibrary search can simply be compared to the variance of the similarity metrics within the interlibrary search results. The ratio of these variances follows an F-distribution that can be used to determine if the discordance is statistically significant and generates the probability based on the cumulative distribution function. The QRMf works for both similarity and dissimilarity and can be used for any queried object and comparison metric that is searched against a database. In this work, the QRMf was used along with the dot product similarity to query the mass spectra of novel synthetic opioids measured by gas chromatography-mass spectrometry (GC/MS). An automated pipeline was devised that used a basis set correction to assist peak detection. The basis was constructed by mass spectra obtained from the blank measurement preceding the analytical run to remove interferences from column bleed and septum degradation. After peak detection, the pipeline applied multivariate curve resolution to the chromatographic peak window to remove background components from the mass spectra. The corrected mass spectra were searched against a customized library for identification. The QRMf can be used along with the similarity metric to detect misidentifications and assist in finding the correct identification when it is not the closest match.
Related Concept Videos
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Detection of Gross Error: The Q Test
Quantifying and Rejecting Outliers: The Grubbs Test
Reliability and Validity
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Estimation of the Physical Quantities


