关于加权热联想记忆的多目标超参数优化
Juan Antonio López Rivera1, Carlos Ignacio Hernández Castellanos2, Rafael Morales3
1Bravos Energía, 06100, Mexico City, Mexico.
Scientific reports
|November 5, 2025
概括
自动化算法配置显著提高了权重入联想记忆 (W-EAM) 模型的识别精度. 优化的W-EAM设置,特别是用于手机识别,在基线模型中表现出优越的性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 认知科学 认知科学
背景情况:
- 权重热联想记忆 (W-EAM) 模型以声明式的分布式表示形式存储信息.
- 优化W-EAM性能对于提高其复杂识别任务的能力至关重要.
- 现有的W-EAM实现可能无法在没有系统的参数调整的情况下实现峰值性能.
研究的目的:
- 应用自动算法配置来优化加权热联想记忆 (W-EAM) 模型.
- 为了提高W-EAM在多样化和复杂的数据集中的识别准确性.
- 在一个多目标优化框架中,研究精度和回忆之间的权衡.
主要方法:
- 使用了最先进的超参数调方法:SMAC和SMS-EMOA.
- 评估了数字,字符和墨西哥西班牙语电话识别任务的W-EAM性能.
- 实施了一个循环优化学习方案,以代地改进参数和数据.
主要成果:
- 优化的W-EAM配置在所有测试域中始终优于基线模型.
- 在更复杂的墨西哥西班牙语电话识别任务中观察到显著的性能增长.
- 循环优化学习方法进一步提高了W-EAM的整体效率.
结论:
- 自动算法配置是一种强大的技术,用于推进像W-EAM这样的自适应性内存系统.
- 优化W-EAM参数导致明显提高识别准确性,特别是在具有挑战性的领域.
- 这些发现为寻求有效利用W-EAM的从业者提供了实际见解.
相关概念视频
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
277
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
277
Multi-input and Multi-variable systems
383
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
383
Weighted Mean
6.2K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
6.2K
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
1.1K
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
1.1K
