对于超高维量子回归的特征分割算法
Jiawei Wen1, Songshan Yang2, Christina Dan Wang3
1Meta Platforms Inc., 1 Hacker Way, Menlo Park, CA 94025, USA.
概括
我们开发了一种新的三块ADMM算法,用于超高维的惩罚性定量回归 (PQR). 这种高效,可并行的方法克服了存储和可扩展性问题,在模拟和现实数据分析中超越现有算法.
科学领域:
- 计算统计学 计算统计学
- 高维数据分析 高维数据分析
背景情况:
- 处罚定量回归 (PQR) 面临着使用超高维预测器的计算挑战.
- 现有的算法在高维度的存储和可扩展性方面扎.
- 乘数的标准交替方向方法 (ADMM) 可能无法在超高维度的PQR中收.
研究的目的:
- 为超高维的PQR提出一个高效且可并行算法.
- 解决现有方法的融合和可扩展性限制.
- 确定新算法的理论收率.
主要方法:
- 开发了一种针对超高维度PQR的新型三块ADMM算法.
- 利用并行计算能力来克服单机的局限性.
- 理论分析以确定算法的收率.
主要成果:
- 拟议的三块ADMM算法证明了效率和并行性.
- 该算法有效地处理大规模数据集中的存储和可扩展性限制.
- 与现有的PQR算法相比,蒙特卡洛模拟显示出更高的性能.
- 新算法的收率在理论上已经确立.
结论:
- 拟议的三块ADMM算法为超高维的PQR提供了一个强大的解决方案.
- 平行计算兼容性提高了它对大数据问题的适用性.
- 经验结果证实了它对当前方法的显著优势.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
2.0K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.0K
Extraction: Partition and Distribution Coefficients
2.9K
The distribution law or Nernst's distribution law is the law that governs the distribution of a solute between two immiscible solvents. This law, also known as the partition law, states that if a solute is added to the mixture of two immiscible solvents at a constant temperature, the solute is distributed between the two solvents in such a way that the ratio of solute concentrations in the solvents remains constant at equilibrium.
For extracting a solute from an aqueous phase into an...
For extracting a solute from an aqueous phase into an...
2.9K
Quartile
4.6K
Quartiles are numbers that separate the data into quarters. Quartiles may or may not be part of the data. To find the quartiles, first, find the median or second quartile. The first quartile, Q1, is the middle value of the lower half of the data, and the third quartile, Q3, is the middle value, or median, of the upper half of the data. To get the idea, consider the same data set:
1; 1; 2; 2; 4; 6; 6.8; 7.2; 8; 8.3; 9; 10; 10; 11.5
The median or second quartile is seven. The lower half of the...
1; 1; 2; 2; 4; 6; 6.8; 7.2; 8; 8.3; 9; 10; 10; 11.5
The median or second quartile is seven. The lower half of the...
4.6K
Modified Boxplots
10.1K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
10.1K
Outliers and Influential Points
4.2K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.2K
Friedman Two-way Analysis of Variance by Ranks
296
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
296


