在GPU上加速近似矩阵乘法
Takuya Okuyama1, André Röhm1, Takatomo Mihana1
1Department of Information Physics and Computing, Graduate School of Information Science and Technology, The University of Tokyo, Tokyo 113-8656, Japan.
Entropy (Basel, Switzerland)
|August 26, 2023
概括
本研究引入了一种改进的蒙特卡洛近似矩阵乘法 (AMM) 方法,用于更快的科学计算. 这种新方法可以在 GPU 上加快自身值计算,而不会增加处理时间.
科学领域:
- 科学计算科学计算
- 数字分析 数字分析
- 高性能计算 高性能计算
背景情况:
- 矩阵乘法对于科学计算至关重要,它会影响自身值计算和优化.
- 像GPU和专用库这样的现有方法加速矩阵产品,但在GPU上加速近似矩阵乘法 (AMM) 仍然未被探索.
研究的目的:
- 为 GPU 加速开发一个优化的增强的蒙特卡罗 AMM 方法.
- 在拟议的AMM方法中提供最佳超参数调整的分析解决方案.
- 为了证明该方法在加速固有值计算方面的有效性.
主要方法:
- 提出了一个新的蒙特卡洛AMM算法,用于并行GPU执行.
- 在AMM方法中获得了优化超参数的分析解决方案.
- 将增强的AMM集成到功率方法中,用于自值计算.
主要成果:
- 与传统的AMM相比,拟议的AMM方法可以提高近似精度,而不会增加计算时间.
- 该方法非常适合GPU并行化和集成到各种算法中.
- 在NVIDIA A100 GPU上对自身值计算的应用将计算时间减半,而不是使用cuBLAS的标准功率方法.
结论:
- 新的AMM方法为GPU上的科学计算提供了显著的加快速度.
- 这项研究弥合了 GPU 上一般矩阵的加速 AMM 的差距.
- 该方法在需要快速矩阵产品的科学和实际计算中显示出更广泛应用的前景.
相关概念视频
Acceleration Vectors
8.1K
In everyday conversation, accelerating means speeding up. Acceleration is a vector in the same direction as the change in velocity, Δv, therefore the greater the acceleration, the greater the change in velocity over a given time. Since velocity is a vector, it can change in magnitude, direction, or both. Thus acceleration is a change in speed or direction, or both. For example, if a runner traveling at 10 km/h due east slows to a stop, reverses direction, and continues their run at 10 km/h...
8.1K
Relative Motion Analysis using Rotating Axes - Acceleration
355
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
355
Fast Decoupled and DC Powerflow
233
The fast decoupled power flow method addresses contingencies in power system operations, such as generator outages or transmission line failures. This method provides quick power flow solutions, essential for real-time system adjustments. Fast decoupled power flow algorithms simplify the Jacobian matrix by neglecting certain elements, leading to two sets of decoupled equations:
233
Relative Motion Analysis - Acceleration
378
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
378
Fast Fourier Transform
378
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
378
Vector Algebra: Method of Components
14.0K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
14.0K


