Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Electron Orbital Model01:18

Electron Orbital Model

Orbitals are the areas outside of the atomic nucleus where electrons are most likely to reside. They are characterized by different energy levels, shapes, and three-dimensional orientations. The location of electrons is described most generally by a shell or principal energy level, then by a subshell within each shell, and finally, by individual orbitals found within the subshells.The first shell is closest to the nucleus, and it has only one subshell with a single spherical orbital called the...
Ampere-Maxwell's Law: Problem-Solving01:17

Ampere-Maxwell's Law: Problem-Solving

A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the problem,...
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models01:06

Model Approaches for Pharmacokinetic Data: Distributed Parameter Models

Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
Mathematical Modeling: Problem Solving01:29

Mathematical Modeling: Problem Solving

Mathematical modeling transforms real-world scenarios into mathematical expressions, allowing for structured problem-solving and analysis. This process involves defining the situation, assigning variables to measurable quantities, selecting an appropriate model, and solving the resulting equation. Such models are invaluable in finance, providing precise methods to evaluate investments, loans, and repayment structures.A widely used example is the calculation of fixed monthly payments on a loan,...

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Band Gap Prediction of Two-Dimensional Materials Using a Gradient-Boosted Feature Selection Approach.

Journal of chemical information and modeling·2026
Same author

Machine-Learning Predictions of Photoluminescence in Molecules Exhibiting Thermally Activated Delayed Fluorescence with Implicit Experimental Validation.

Journal of chemical information and modeling·2026
Same author

Automatic Generation of a Mechanical Properties Question-Answering Data Set for Language Model Benchmarking: A Comparative Study of BERT, XLNet, and LLaMA Models.

Journal of chemical information and modeling·2026
Same author

A dataset of Curie and Néel temperatures auto-generated with ChemDataExtractor and the Snowball algorithm.

Scientific data·2025
Same author

Automated Determination of the Molecular Substructure from Nuclear Magnetic Resonance Spectra Using Neural Networks.

Journal of chemical information and modeling·2025
Same author

Autogenerating a Domain-Specific Question-Answering Data Set from a Thermoelectric Materials Database to Enable High-Performing BERT Models.

Journal of chemical information and modeling·2025

相关实验视频

Updated: Jul 26, 2026

Lensless Fluorescent Microscopy on a Chip
11:23

Lensless Fluorescent Microscopy on a Chip

Published on: August 17, 2011

17.6K

对光电子应用程序的语言模型进行经济高效的域适应性培训.

Dingyun Huang1, Jacqueline M Cole1,2

  • 1Cavendish Laboratory, Department of Physics, University of Cambridge, J. J. Thomson Avenue, Cambridge CB3 0HE, U.K.

Journal of chemical information and modeling
|February 11, 2025
PubMed
概括

我们开发了三个光电子专用BERT语言模型,在光电子NLP任务中表现优于一般模型. 具有成本效益的预培训方法显著减少了资源需求.

科学领域:

  • 光电学是指光电子产品.
  • 自然语言处理 (NLP) 是一种自然语言处理.
  • 人工智能 (AI) 是一种人工智能.

背景情况:

  • 预训练语言模型 (PLM) 在NLP和应用中显示出多功能性,例如光电子中的数据挖掘.
  • 变压器的双向编码器表示 (BERT) 是科学领域广泛采用的架构.
  • 一般的NLP模型可能无法完全捕捉光电子学研究文献的细微差别.

研究的目的:

  • 为了引入新的光电子意识的BERT模型 (OE-BERT,OE-ALBERT,OE-RoBERTa).
  • 为了评估他们的表现与一般的英语模型和更大的对应对光电子相关的NLP任务.
  • 为科学NLP展示一个高效的领域适应性预训练 (DAPT) 方法.

主要方法:

  • 开发了三个专门的BERT架构:OE-BERT,OE-ALBERT和OE-RoBERTa.
  • 域适应预训练 (DAPT) 应用到 RoBERTa 进行光电子文本.
  • 在各种光电子 NLP 任务上对模型性能进行比较评估.

主要成果:

  • 在光电子NLP任务中,OE-BERT,OE-ALBERT和OE-RoBERTa模型超过了普通英语BERT模型和更大的模型.
  • 对于RoBERTa的DAPT方法在预训练中实现了显著的计算节约 (>80%).

更多相关视频

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

478
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.4K

相关实验视频

Last Updated: Jul 26, 2026

Lensless Fluorescent Microscopy on a Chip
11:23

Lensless Fluorescent Microscopy on a Chip

Published on: August 17, 2011

17.6K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

478
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.4K
  • 使用具有成本效益的DAPT方法保持或提高了性能.

    • 结论:

    • 特定于光电子的BERT模型为这个领域的NLP任务提供了卓越的性能.
    • 领域适应性预培训是开发专门的科学语言模型的有效和资源高效策略.
    • 开发的模型和数据集是公开的,可供光电子研究社区使用.