坐标异常值检测和维度估计,以改进生物数据集的MDS嵌入
Wanxin Li1, Jules Mirone2,3, Ashok Prasad4
1Department of Computer Science, University of British Columbia, Vancouver, BC, Canada.
Frontiers in bioinformatics
|August 28, 2023
概括
本研究介绍了DeCOr-MDS,这是一种强大的方法来检测和纠正数据中的直角异常值. 这提高了复杂的生物数据集的维度减少和数据可视化.
科学领域:
- 计算生物学 计算生物学
- 数据科学数据科学数据科学
- 统计 统计 统计 统计
背景情况:
- 多维缩放 (MDS) 是一种常见的缩小维度的技术.
- 正角异常值可以显著扭曲MDS嵌入,影响数据分析.
- 现有的方法对此类异常值缺乏稳定性.
研究的目的:
- 开发一种强大的多维缩放 (MDS) 方法,能够检测和纠正正向的异常值.
- 为了提高复杂数据集的维度减少的准确性和可靠性.
- 为改善生物研究中的数据清理和可视化提供一个工具.
主要方法:
- 引入DeCOr-MDS (使用MDS检测和纠正正角异常值).
- 利用由数据点形成的简单的几何和统计学.
- 使用合成数据集和现实世界生物数据进行验证.
主要成果:
- DeCOr-MDS有效地识别和纠正正向的异常值.
- 与传统的MDS相比,证明了更好的尺寸缩小性能.
- 成功应用于各种生物数据集,包括癌细胞数据,微生物群数据和单细胞RNA测序数据.
结论:
- 在存在直角异常值的情况下,DeCOr-MDS提供了一个强大的解决方案来减少维度.
- 该方法增强了大规模生物数据的数据清理和可视化能力.
- 这种方法在生物信息学和数据分析中具有广泛的应用.
相关概念视频
What Are Outliers?
3.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.9K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Outliers and Influential Points
4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Detection of Gross Error: The Q Test
6.2K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.2K
Two-Dimensional Microscopy in Microbiology
79
Two-dimensional (2D) microscopy encompasses a range of optical techniques that capture images within a single focal plane, offering detailed representations of microscopic structures. These techniques are essential in biological and medical research, enabling the visualization of cellular and subcellular structures with different levels of contrast and specificity.There are several major types of 2D microscopy, each with strengths and applications.Bright-Field MicroscopyBright-field microscopy...
79


