Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Language and Cognition01:27

Language and Cognition

301
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
301
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

700
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
700
Language Development01:22

Language Development

292
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
292
Self-Evaluation: Self-Enhancement and Self-Verification03:00

Self-Evaluation: Self-Enhancement and Self-Verification

5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K
Elaborative Rehearsals01:07

Elaborative Rehearsals

70
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
70
Self-Schemas02:16

Self-Schemas

30.8K
In general, a schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
30.8K

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Temporal and Behaviour-Aware Multimodal Modelling for Hour-Ahead Hypoglycaemia Prediction During Ramadan Fasting in Type 1 Diabetes.

Sensors (Basel, Switzerland)·2026
Same author

Sustainable E-Health: Energy-Efficient Tiny AI for Epileptic Seizure Detection via EEG.

Biomedical engineering and computational biology·2025
Same author

Graph-Based Electroencephalography Analysis in Tinnitus Therapy.

Biomedicines·2024
Same author

Graphical Insight: Revolutionizing Seizure Detection with EEG Representation.

Biomedicines·2024
Same author

Using Unstated Cases to Correct for COVID-19 Pandemic Outbreak and Its Impact on Easing the Intervention for Qatar.

Biology·2021
Same author

Highly accurate prediction of flammability limits of chemical compounds using novel integrated hybrid models.

PloS one·2019

相关实验视频

Updated: May 20, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

474

有效的自我注意力与智能修剪,以实现可持续的大型语言模型.

Samir Brahim Belhaouari1, Insaf Kraidia2

  • 1Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Ar-Rayyan, Qatar. sbelhaouari@hbku.edu.qa.

Scientific reports
|March 25, 2025
PubMed
概括

本研究为大型语言模型 (LLM) 引入了一种新的压缩方法,大大减少了它们的尺寸和环境影响. 该技术在保持高精度的同时实现了实质性的模型压缩,为更可持续的AI铺平了道路.

关键词:
压缩 压缩是一种压缩.计算需求 计算需求消费 消费 消费 消费 消费大型语言模型 (LLM)修剪 修剪 修剪 修剪专注于自己的注意力

更多相关视频

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.4K
Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

2.5K

相关实验视频

Last Updated: May 20, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

474
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.4K
Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

2.5K

科学领域:

  • 人工智能的人工智能
  • 机器学习 机器学习
  • 自然语言处理自然语言处理.

背景情况:

  • 大型语言模型 (LLM) 提供先进的多任务能力,但受到高计算需求的影响,这导致了能源和水消耗方面的重大环境问题.
  • 内部变压器层是LLMs计算复杂性和资源密度的主要贡献者.

研究的目的:

  • 提出和评估一种创新的压缩方法,以减少大型语言模型 (LLM) 的尺寸和计算足迹.
  • 通过高效的模型压缩来解决与LLMs高能耗和水耗相关的环境影响.

主要方法:

  • 拟议的方法结合了模型压缩的数学和结构技术,专注于变压器层.
  • 前向传播修剪 (FPP) 用于使用重量结和零化压缩嵌入和前向料层.
  • 重量矩阵折叠,结合相同行压缩 (IRC) 和对角重量压缩 (DWC),用于修剪自我注意层矩阵.

主要成果:

  • 压缩方法实现了99%的变压器层的压缩和70%的线性层,导致整体模型压缩约70%.
  • 模型准确性在压缩后保持在几乎原始水平.
  • 适度的压缩速率 (20-40%) 显示出稳定或改进的模型性能,同时显著减少了内存使用和计算需求.

结论:

  • 开发的压缩技术有效地减少了LLM的大小和资源需求,使它们更节能.
  • 这种方法为实现更可持续的人工智能开发和部署提供了可行的途径.
  • 优化的LLM可以实现绩效效益,同时最大限度地减少对环境的影响.