使用固定半径方法对k-最近邻居搜索的随机方法
Brahian Cano Urrego1, Alexander Alsup1, Jeffrey A Thompson1
1Department of Biostatistics & Data Science, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66106 USA.
概括
这项研究引入了一种新的随机方法来优化k-最近邻居 (kNN) 搜索,显著减少大数据集的计算负载. 与传统的粗暴武力方法相比,这种方法提高了可扩展性和准确性.
科学领域:
- 计算机科学 计算机科学
- 机器学习 机器学习
- 数据挖掘 数据挖掘
背景情况:
- k-最近邻居 (kNN) 搜索是计算密集的,特别是在大型数据集.
- 现有的方法通常依赖于基于规则的系统,缺乏数据驱动的随机方法.
- 优化kNN搜索对于高效的机器学习模型性能至关重要.
研究的目的:
- 开发一种用于优化kNN搜索的随机方法.
- 为了减少粗暴力量kNN搜索的计算负担.
- 为了提高kNN搜索大数据集的可扩展性,同时保持准确性.
主要方法:
- 利用数据结构和概率假设来定义kNN搜索的有限样本空间.
- 采用固定半径搜索查询观察,随机地与所需的邻居数量联系在一起.
- 使用训练集中的一部分,而不是整个数据集用于邻居识别.
主要成果:
- 随机方法显著优于粗暴力量方法,特别是在大型训练和查询集中.
- 在阿尔茨海默病数据集上,总经过的时间改善了27.57倍.
- 理论计算复杂性分析支持该方法的效率增长.
结论:
- 拟议的随机方法为大规模应用提供了传统的kNN搜索方法的可行和准确的替代方案.
- 这种方法有效地减少了计算负载,而不会影响搜索准确度.
- 这些发现对提高处理大数据的机器学习算法的效率有影响.
更多相关视频
相关概念视频
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
1.1K
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
1.1K
Radius of Gyration of an Area
2.7K
The second moment of area, also known as the moment of inertia of area, is a crucial factor in understanding an object's resistance against bending deformation, or stiffness. To accurately estimate the second moment of area along any axis, one needs to concentrate all areas associated with that object into a thin strip, which should be placed parallel to that particular axis.
2.7K
Linearization and Approximation
18
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
18
Distance Problem
22
When an object's velocity changes over time, the total distance traveled can be determined by summing small displacement intervals over short increments. This approach approximates the true distance through numerical summation and the use of integral calculus. An estimate of the total displacement can be obtained by measuring velocity at regular intervals and multiplying each value by the corresponding time step.If a runner accelerates over the first three seconds of a race, speed measurements...
22
Cluster Sampling Method
14.0K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
14.0K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
292
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
292


