関連する実験動画

Updated: Sep 10, 2025

Generation and Coherent Control of Pulsed Quantum Frequency Combs
06:42

Generation and Coherent Control of Pulsed Quantum Frequency Combs

Published on: June 8, 2018

9.1K

ModuLoRA: モジュール式量子化器との統合による消費者GPUの2ビットLLMの微調整

Junjie Yin1, Jiahao Dong2, Yingheng Wang3

  • 1Department of Computer Science, Johns Hopkins University.

Transactions on machine learning research
|August 21, 2025
PubMed
まとめ

単一のGPUで2〜4ビット精度で大型言語モデル (LLM) の微調整のためのメモリ効率の良いアルゴリズムであるModuLoRAを紹介します. この方法は,高度な低精度の微調整を可能にし,メモリ使用量を減らすことで競争力のある性能を達成します.

さらに関連する動画

Characterization of Anisotropic Leaky Mode Modulators for Holovideo09:36

Characterization of Anisotropic Leaky Mode Modulators for Holovideo

Published on: March 19, 2016

8.0K
Shaping the Amplitude and Phase of Laser Beams by Using a Phase-only Spatial Light Modulator08:39

Shaping the Amplitude and Phase of Laser Beams by Using a Phase-only Spatial Light Modulator

Published on: January 28, 2019

9.9K

関連する概念動画

Downsampling01:20

Downsampling

When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
252
Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
131
Upsampling01:22

Upsampling

Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
309
Fineness Modulus01:19

Fineness Modulus

The fineness modulus (FM) of aggregate is a numerical index that measures the coarseness or fineness of the particles. It is calculated by adding the cumulative percentages of aggregate retained on each of a specified series of sieves and dividing the sum by 100.
Consider performing sieve analysis on sand through a set of ASTM sieves. The weight of aggregate retained in each sieve and pan placed at the bottom is recorded, as given in Column B of Table 1.
To determine the fineness modulus of...
784
Per-Unit Sequence Models01:26

Per-Unit Sequence Models

An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
116
Improving Translational Accuracy02:07

Improving Translational Accuracy

2.7K