Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Ranks01:02

Ranks

505
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
505
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

1.5K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
1.5K
Mechanism of Breathing I: Inspiration01:30

Mechanism of Breathing I: Inspiration

3.2K
Introduction to Inspiration: The Respiratory System in Action
The respiratory system, an essential network for breathing, comprises the conducting and respiratory zones, each playing a crucial role in the overall process of respiration. Let us explore the detailed mechanism of inspiration, or inhalation, which is the first phase of the respiratory cycle.
Pathway of Air during Inspiration
During inspiration, air enters our body through the nose or mouth and moves through the conducting zone,...
3.2K
Fineness of Cement01:15

Fineness of Cement

518
The fineness of cement directly influences the rate of hydration, as the hydration begins at the surface of the cement particles. In addition to hydration, the fineness of cement is vital for various properties of concrete including workability, gypsum requirement, and long-term behavior. The fineness of cement is represented in terms of the specific surface of cement which is typically measured in square meters per kilogram, with several methods available for this determination.
Direct...
518
Fineness Modulus01:19

Fineness Modulus

1.5K
The fineness modulus (FM) of aggregate is a numerical index that measures the coarseness or fineness of the particles. It is calculated by adding the cumulative percentages of aggregate retained on each of a specified series of sieves and dividing the sum by 100.
Consider performing sieve analysis on sand through a set of ASTM sieves. The weight of aggregate retained in each sieve and pan placed at the bottom is recorded, as given in Column B of Table 1.
To determine the fineness modulus of...
1.5K
Wilcoxon Rank-Sum Test01:21

Wilcoxon Rank-Sum Test

755
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:
755

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Healthcare system cost evaluation of antiviral stockpiling for pandemic influenza preparedness.

Biosecurity and bioterrorism : biodefense strategy, practice, and science·2010
Same author

PDGF-CC blockade inhibits pathological angiogenesis by acting on multiple cellular and molecular targets.

Proceedings of the National Academy of Sciences of the United States of America·2010
Same author

Betulin induces mitochondrial cytochrome c release associated apoptosis in human cancer cells.

Molecular carcinogenesis·2010
Same author

Development of novel 5-fluorouracil carrier erythrocyte with pharmacokinetics and potent antitumor activity in mice bearing malignant ascites.

Journal of gastroenterology and hepatology·2010
Same author

[Effectiveness of educational interventions in children with chronic diseases and their parents].

Zhongguo dang dai er ke za zhi = Chinese journal of contemporary pediatrics·2010
Same author

Genomic identification of a novel mutation in hfq that provides multiple benefits in evolving glucose-limited populations of Escherichia coli.

Journal of bacteriology·2010

相关实验视频

Updated: Feb 3, 2026

Dithranol as a Matrix for Matrix Assisted Laser Desorption/Ionization Imaging on a Fourier Transform Ion Cyclotron Resonance Mass Spectrometer
09:38

Dithranol as a Matrix for Matrix Assisted Laser Desorption/Ionization Imaging on a Fourier Transform Ion Cyclotron Resonance Mass Spectrometer

Published on: November 26, 2013

14.6K

基于矩阵转换的低等级适应 (MTLoRA):一种由大脑启发的方法,用于参数高效的微调.

Yao Liang1, Yuwei Wang2, Yang Li1

  • 1Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China.

Neural networks : the official journal of the International Neural Network Society
|February 1, 2026
PubMed
概括

基于矩阵转换的低级调整 (MTLoRA) 通过在低级子空间中学习数据调整的几何学来提高参数效率的微调. 这种方法提高了大型语言模型的性能和培训稳定性,而不是像LoRA这样的标准方法.

关键词:
精细调整 微调 精细调整大型语言模型.大型模型 大型模型低级别矩阵是低级别的矩阵.具有参数效率的微调.

更多相关视频

Author Spotlight: Streamlining Composite Plant Production via Agrobacterium rhizogenes-Mediated Hairy Root Transformation
04:09

Author Spotlight: Streamlining Composite Plant Production via Agrobacterium rhizogenes-Mediated Hairy Root Transformation

Published on: June 30, 2023

3.0K
Tuning Degradation to Achieve Specific and Efficient Protein Depletion
05:11

Tuning Degradation to Achieve Specific and Efficient Protein Depletion

Published on: July 20, 2019

6.6K

相关实验视频

Last Updated: Feb 3, 2026

Dithranol as a Matrix for Matrix Assisted Laser Desorption/Ionization Imaging on a Fourier Transform Ion Cyclotron Resonance Mass Spectrometer
09:38

Dithranol as a Matrix for Matrix Assisted Laser Desorption/Ionization Imaging on a Fourier Transform Ion Cyclotron Resonance Mass Spectrometer

Published on: November 26, 2013

14.6K
Author Spotlight: Streamlining Composite Plant Production via Agrobacterium rhizogenes-Mediated Hairy Root Transformation
04:09

Author Spotlight: Streamlining Composite Plant Production via Agrobacterium rhizogenes-Mediated Hairy Root Transformation

Published on: June 30, 2023

3.0K
Tuning Degradation to Achieve Specific and Efficient Protein Depletion
05:11

Tuning Degradation to Achieve Specific and Efficient Protein Depletion

Published on: July 20, 2019

6.6K

科学领域:

  • 人工智能的人工智能
  • 机器学习 机器学习
  • 自然语言处理自然语言处理.

背景情况:

  • 像LoRA这样的参数效率微调 (PEFT) 方法可以降低适应大型语言模型 (LLM) 的计算成本.
  • 标准的低等级适配器由于更新固定等级r子空间的局限性,可能会低于完整微调的性能.
  • 需要PEFT技术来提高性能和稳定性,而不会显著增加计算开销.

研究的目的:

  • 引入基于矩阵转换的低等级适应 (MTLoRA),一种新的PEFT方法.
  • 通过在低级子空间内实现数据适应的几何变换来提高LLM微调的性能和稳定性.
  • 为现有的低级适应技术提供一个兼容插头和高效的替代方案.

主要方法:

  • MTLoRA将一个可学习的r x r转换矩阵 (T) 插入到低级更新中 (ΔW=BTA).
  • 为T提出了四个特定的结构 (SHIM,ICFM,CTCM,DTSM),提供了不同的诱导偏差.
  • 优化分析表明T的作用是学习预先条件,增强训练稳定性.

主要成果:

  • MTLoRA在各种任务和模型中持续提高性能,包括GLUE,自然语言生成和多式调节指令.
  • 在使用DeBERTaV3基的GLUE上,MTLoRA比LoRA平均得分提高了2.0分.
  • 在LLaVA-1.5-7B的多式调整中,DTSM变体以最小的可训练参数获得了最佳平均分数,超过了完整的微调.

结论:

  • 在低级子空间内学习几何变换显著提高了LLM微调的有效性和稳定性.
  • MTLoRA为标准LoRA提供了一种实用和高效的替代方案,在可比或较低的计算需求下获得更优异的结果.
  • 拟议的方法推进了大规模人工智能模型的参数效率适应领域.