将非结构化数据与最接近邻居的变进行表征
Leonardo G J M Voltarelli1, Arthur A B Pessa1, Luciano Zunino2,3
1Departamento de Física, Universidade Estadual de Maringá, Maringá PR 87020-900, Brazil.
Chaos (Woodbury, N.Y.)
|May 23, 2024
概括
我们介绍了k-最近的邻居顺序,这是分析复杂的非结构化数据的新方法. 这种以物理学为灵感的技术增强了模式检测,并为各种数据集提供了卓越的噪声弹性.
科学领域:
- 复杂系统分析 复杂系统分析
- 信息理论 信息理论
- 数据科学数据科学数据科学
背景情况:
- 变是一种强大的物理灵感工具,用于分析复杂的数据集.
- 目前的应用主要局限于结构化数据,如时间序列和图像.
- 存在对非结构化,高维数据适用的方法的需求.
研究的目的:
- 为分析非结构化数据引入k-最近邻方方位 (kNN-PE).
- 为了证明kNN-PE能够识别数据中的模式,无论其配置或维度如何.
- 增强序列方法在更广泛的数据分析方面的能力.
主要方法:
- 构建k-最近邻图来定义数据关系.
- 在这些图表上使用随机走路来提取顺序模式.
- 根据这些顺序模式的分布计算kNN-PE.
主要成果:
- kNN-PE准确地识别了非结构化数据模式中的变化.
- 该方法在精度上超越了传统的测量方法,如空间自相关性.
- kNN-PE自然结合了振幅和时间间隔信息,提高了噪声弹性.
结论:
- kNN-PE显著扩大了顺序方法对非结构化数据的适用性.
- 这项创新增强了对复杂,高维数据集的模式分析.
- 开辟了对不同数据类型的顺序的新研究途径.
相关概念视频
Entropy
29.4K
Salt particles that have dissolved in water never spontaneously come back together in solution to reform solid particles. Moreover, a gas that has expanded in a vacuum remains dispersed and never spontaneously reassembles. The unidirectional nature of these phenomena is the result of a thermodynamic state function called entropy (S). Entropy is the measure of the extent to which the energy is dispersed throughout a system, or in other words, it is proportional to the degree of disorder of a...
29.4K
Ranks
236
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
236
Entropy and the Second Law of Thermodynamics
2.8K
The second law of thermodynamics can be stated quantitatively using the concept of entropy. Entropy is the measure of disorder of the system.
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
2.8K
Entropy and Solvation
7.0K
The process of surrounding a solute with solvent is called solvation. It involves evenly distributing the solute within the solvent. The rule of thumb for determining a solvent for a given compound is that like dissolves like. A good solvent has molecular characteristics similar to those of the compound to be dissolved. For example, polar solutions dissolve polar solutes, and apolar solvents dissolve apolar solutes. A polar solvent is a solvent that has a high dielectric constant (ϵ...
7.0K
Entropy Change in Reversible Processes
2.5K
In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
2.5K
Unusual Results
3.2K
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
3.2K


