在顺序数据中检测和评估集群
Alexander Van Werde1, Albert Senen-Cerda1,2, Gianluca Kosmella1,3
1Department of Mathematics & Computer Science, TU/e, Eindhoven, The Netherlands.
概括
基于区块马尔科夫链的顺序数据的新集群算法,成功地从现实世界,高维数据集中提取低维表示. 这些模型揭示了对动物运动和DNA序列等复杂过程的洞察力.
科学领域:
- 数据科学数据科学数据科学
- 计算生物学 计算生物学
- 生物信息学是一种生物信息学.
背景情况:
- 序列数据在各个领域普遍存在,由于高维度,稀疏性和噪音而存在挑战.
- 从复杂的顺序过程中提取有意义的见解需要强大的方法来处理数据依赖.
研究的目的:
- 在真实世界的序列数据上,评估来自区块马尔科夫链理论的新型集群算法.
- 为了确定这些算法是否可以有效地从稀疏的高维序列生成有用的低维表示.
主要方法:
- 应用针对顺序数据设计的新聚类算法.
- 在各种现实世界数据集中进行实证研究,包括动物运动 (GPS),DNA序列,文本和财务数据.
- 对提取的低维表示的分析,以测试它们编码顺序结构的能力,并揭示底层过程特征.
主要成果:
- 算法成功地从各种现实世界的序列数据中提取了低维表示.
- 这些表示有效地捕获了数据集内固有的顺序结构.
- 所识别的表示提供了对正在研究的复杂过程的新见解.
结论:
- 基于马尔科夫区块链的集群算法有效地从复杂的现实世界序列数据中提取有意义的低维表示.
- 这种方法提供了一种有希望的方法,可以在处理顺序信息的领域获得更深入的理解.
- 该研究验证了这些算法的实用性超出了合成数据,证明了它们在实际场景中的适用性.
相关概念视频
Cluster Sampling Method
12.7K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
12.7K
RNA-seq
10.4K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
10.4K
Sampling Plans
261
Sampling is a crucial step in analytical chemistry, allowing researchers to collect representative data from a large population. Common sampling methods include random, judgmental, systematic, stratified, and cluster sampling.
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
261
Steps in Outbreak Investigation
199
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
199
Detection of Gross Error: The Q Test
6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K


