Related Experiment Video
Updated: Jul 31, 2026
12:27
Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
R-NN curves: an intuitive approach to outlier detection using a distance based method.
Rajarshi Guha1, Debojyoti Dutta, Peter C Jurs
1Department of Chemistry, Pennsylvania State University, University Park, Pennsylvania 16802, USA.
Journal of Chemical Information and Modeling
|July 25, 2006
Summary
We developed R-NN curves to analyze chemical structure libraries and detect outliers. This method visualizes compound distribution in descriptor space, aiding in identifying sparse regions and unusual molecules.
Area of Science:
- Cheminformatics
- Computational Chemistry
- Data Analysis
Background:
- Chemical libraries are crucial for virtual screening and QSAR modeling.
- Understanding compound distribution in descriptor space is vital for library analysis.
- Current methods for outlier detection can be complex and less intuitive.
Purpose of the Study:
- To present a novel, simple approach for analyzing the spatial distribution of compounds within chemical libraries.
- To introduce R-NN curves as a tool for both general library analysis and specific outlier detection.
- To provide a visual and numerical method for identifying compounds in sparse regions of descriptor space.
Main Methods:
- Utilizing counts of neighbors within increasing radii to generate R-NN curves.
- Analyzing the spatial distribution of compounds based on molecular descriptors.
- Theoretically justifying the logistic model behavior of R-NN curves in 2D descriptor spaces.
- Developing a numerical characterization of R-NN curves for quantitative outlier identification.
Main Results:
- R-NN curves effectively visualize compound distribution in descriptor space.
- The method successfully identifies compounds located in sparse regions.
- R-NN curves demonstrate a logistic model behavior, theoretically supported for 2D cases.
- A numerical characterization allows for single-plot outlier identification.
Conclusions:
- R-NN curves offer a straightforward and effective method for analyzing chemical library distributions.
- The approach facilitates the detection of outliers and compounds in sparse regions.
- This technique is applicable to high-dimensional data sets in cheminformatics.
Related Concept Videos
01:12What Are Outliers?
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
00:57Modified Boxplots
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
01:08Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
01:00Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
01:02Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
01:29Distance Problem
When an object's velocity changes over time, the total distance traveled can be determined by summing small displacement intervals over short increments. This approach approximates the true distance through numerical summation and the use of integral calculus. An estimate of the total displacement can be obtained by measuring velocity at regular intervals and multiplying each value by the corresponding time step.If a runner accelerates over the first three seconds of a race, speed measurements...