KE:机器学习模型的知识增强框架
Yijue Wang1, Nidhibahen Shah1, Ahmed Soliman1
1Department of Computer Science, University of Connecticut, Storrs, Connecticut 06269, United States.
The journal of physical chemistry. A
|September 29, 2023
概括
我们引入了知识增强 (KE) 算法,以提高机器学习模型训练效率. 这种方法增强了从较小到较大的模型的知识传输,提高了材料属性预测的性能.
科学领域:
- 材料科学 材料科学 材料科学
- 计算机科学 计算机科学
- 人工智能的人工智能
背景情况:
- 机器学习模型对于预测材料属性至关重要,但需要长时间的训练和超参数调整时间.
- 使用大型模型在复杂的科学和工程问题中实现最佳性能仍然是一个重大挑战.
研究的目的:
- 开发一种新的知识增强 (KE) 算法,以提高机器学习模型培训的效率和性能.
- 解决与科学应用中训练大规模模型相关的计算挑战.
主要方法:
- 建议的知识增强 (KE) 算法将知识从容量较低的模型转移到容量较高的模型.
- 该算法的有效性通过理论分析和实验验证来证明,重点是预测材料带隙.
- 使用OMDB数据集进行实验,以对现有方法进行性能评估.
主要成果:
- 与OMDB数据集上的当前方法相比,知识增强 (KE) 模型显示了至少10.21%的性能改善.
- 该算法成功增强了知识传输,从而提高了培训效率和材料带隙的预测准确性.
结论:
- 知识增强 (KE) 算法提供了一种有前途的方法,可以加速机器学习模型的训练,并提高科学发现的性能.
- 知识增强的通用性意味着它可以广泛应用于各种科学和工程问题,为未来的研究铺平了道路.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
72
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
72
Pharmacokinetic Models: Overview
761
Pharmacokinetic models utilize mathematical analysis to achieve a detailed quantitative understanding of a drug's life cycle within the body. They are instrumental in simulating a drug's pharmacokinetic parameters, predicting drug concentrations over time, optimizing dosage regimens, linking concentrations with pharmacologic activity, and estimating potential toxicity.
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
761
Models of Health Promotion and Illness Prevention I
2.1K
A model is a theoretical way to understand a concept or an idea. Models can overcome barriers to health regardless of diverse economic and cultural backgrounds. In addition, models make the task easier by providing different ways to approach complex issues. There are two major health promotion models: the health belief model and the health promotion model.
The health belief model (HBM) attempts to predict health-related behavior in specific belief patterns. According to the HBM, a person's...
The health belief model (HBM) attempts to predict health-related behavior in specific belief patterns. According to the HBM, a person's...
2.1K
Models, Theories, and Laws
5.4K
Scientists frequently use models to help them comprehend a specific collection of phenomena. In physics, a model is a condensed version of a physical system that is too complex to study thoroughly. One such example is the light wave model; unlike water waves, light waves are typically invisible to us. Nonetheless, it is helpful to think of light as being composed of waves, since investigations show that light behaves like water waves. Since it is impossible to visually see what is genuinely...
5.4K
Machines: Problem Solving I
349
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
349
Mechanistic Models: Overview of Compartment Models
104
Mechanistic models, a category encompassing both physiological and compartmental modeling, differ from empirical models' approaches to incorporating known factors about the systems being modeled. Empirical models describe data with minimal assumptions, while mechanistic models aim to provide a robust description of available data by specifying assumptions and integrating known factors about the system. Compartmental analysis is a key example of a mechanistic model in pharmacokinetics and...
104


