:

Yang Zhang1, Pan He1, Chuanyun Xu1

  • 1School of Computer and Information Science, Chongqing Normal University, Chongqing, China.

PeerJ. Computer science
|September 24, 2025
PubMed
概括

知识蒸有效地将知识从大型教师模型转移到较小的学生模型. 我们的多层次特征对齐知识蒸 (MFAKD) 方法显著提高了学生模型的表现,使他们能够超越教师模型.

相关概念视频

Associative Learning01:27

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
1.2K
Differential Leveling01:12

Differential Leveling

Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
660
Leveling Effect01:29

Leveling Effect

In acid-base chemistry, the leveling effect refers to the limitation imposed by the solvent on the strength of acids and bases in solution. When a base stronger than the solvent's conjugate base is used, it deprotonates the solvent until the base is entirely consumed, making it ineffective against weaker acids. Conversely, an acid stronger than the solvent's conjugate acid protonates the solvent until the acid is depleted, rendering it ineffective against weaker bases. Essentially, the...
1.3K
Introduction and Methods of Leveling01:26

Introduction and Methods of Leveling

Leveling is a surveying procedure used to determine elevation differences between distant points. Elevation refers to the vertical distance above or below a reference datum, typically mean sea level (MSL). In the United States, elevations are often referenced to the mean sea level station at Father Point Rimouski along the St. Lawrence Seaway. To make the datum accessible, permanent markers are established throughout the region. These markers, called benchmarks, have known elevations. If the...
460
Levels of Organization01:09

Levels of Organization

Biological organization is the classification of biological structures, ranging from atoms at the bottom of the hierarchy to the Earth's biosphere. Each level of the hierarchy represents an increase in complexity that builds upon the previous level.
Molecules Are Composed of Atoms, and Biomolecules Are Assembled from Molecules:
The most basic levels include atoms, molecules, and biomolecules. Atoms, the smallest unit of ordinary matter, are composed of a nucleus and electrons. Molecules...
137.9K
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
838