相关实验视频
Updated: Sep 9, 2025

06:42
Generation and Coherent Control of Pulsed Quantum Frequency Combs
Published on: June 8, 2018
9.1K
通过哈达马德不一致和格子代码书来实现更好的LLM量化
Albert Tseng1, Jerry Chee1, Qingyao Sun2
1Department of Computer Science, Cornell University.
概括
QuIP#是一种使用先进技术实现大型语言模型 (LLM) 极端压缩的新型后训练量化方法. 这种仅使用重量方法可以显著减少模型大小,同时保持性能,从而实现高效的部署.
科学领域:
- 人工智能
- 机器学习
- 计算机科学
背景情况:
- 培训后量化 (PTQ) 对于减少大型语言模型 (LLM) 的记忆足迹至关重要.
- 现有的PTQ方法在极端压缩模式下面临挑战 (例如,每重 ≤4位).
研究的目的:
- 介绍QuIP#,一种用于极端LLM压缩的新型仅重量PTQ方法.
- 通过使用三种创新技术实现极端量子化的最新结果.
主要方法:
- 使用随机的哈达马德变换来改进不一致处理.
- 使用基于 E8 格子的硬件高效代码书进行矢量量化.
- 加入微调来增强对原始模型的忠实性.
主要成果:
- 与现有的PTQ方法相比,QuIP#在极端压缩中表现出更高的性能.
- 这种方法为PTQ提供了新的扩展行为.
- 支持快速推断速度.
结论:
- 对于LLM来说,仅重量PTQ的QIP#是一个显著的进步.
- 使用的新技术导致极端压缩的最新结果.
- 提供高压缩LLM有效部署的实际解决方案.
相关概念视频
Lattice Centering and Coordination Number
9.9K
The structure of a crystalline solid, whether a metal or not, is best described by considering its simplest repeating unit, which is referred to as its unit cell. The unit cell consists of lattice points that represent the locations of atoms or ions. The entire structure then consists of this unit cell repeating in three dimensions. The three different types of unit cells present in the cubic lattice are illustrated in Figure 1.
Types of Unit Cells
Imagine taking a large number of identical...
Types of Unit Cells
Imagine taking a large number of identical...
9.9K
Bewley Lattice Diagram
842
The Bewley lattice diagram, developed by L. V. Bewley, effectively organizes the reflections occurring during transmission-line transients. It visually represents how voltage waves propagate and reflect within a transmission line, making it easier to understand the complex interactions that occur.
842
Trends in Lattice Energy: Ion Size and Charge
24.2K
An ionic compound is stable because of the electrostatic attraction between its positive and negative ions. The lattice energy of a compound is a measure of the strength of this attraction. The lattice energy (ΔHlattice) of an ionic compound is defined as the energy required to separate one mole of the solid into its component gaseous ions. For the ionic solid sodium chloride, the lattice energy is the enthalpy change of the process:
24.2K
Hybridization of Atomic Orbitals II
33.7K
sp3d and sp3d 2 Hybridization
33.7K
Quantum Numbers
36.4K
It is said that the energy of an electron in an atom is quantized; that is, it can be equal only to certain specific values and can jump from one energy level to another but not transition smoothly or stay between these levels.
36.4K
Hybridization of Atomic Orbitals I
48.9K
The mathematical expression known as the wave function, ψ, contains information about each orbital and the wavelike properties of electrons in an isolated atom. When atoms are bound together in a molecule, the wave functions combine to produce new mathematical descriptions that have different shapes. This process of combining the wave functions for atomic orbitals is called hybridization and is mathematically accomplished by the linear combination of atomic orbitals. The new orbitals that...
48.9K

