显微镜GPT:使用视觉语言转换器从2D材料的显微镜图像生成原子结构字幕
Kamal Choudhary1,2,3
1Material Measurement Laboratory, National Institute of Standards and Technology, Gaithersburg, Maryland 20899, United States.
The journal of physical chemistry letters
|July 1, 2025
概括
显微镜GPT是一种视觉语言模型,可以从显微镜图像中重建原子结构. 材料科学的这一突破加速了用于纳米技术和催化剂的新材料的发现.
科学领域:
- 材料科学 材料科学 材料科学
- 计算材料科学科学 计算材料科学
- 纳米技术纳米技术
背景情况:
- 从显微镜图像中确定完整的原子结构是一个重大挑战.
- 需要自动化方法来加快材料的发现和分析.
研究的目的:
- 介绍MicroscopyGPT,一种新的视觉语言模型 (VLM),用于从扫描传输电子显微镜 (STEM) 图像中预测原子结构.
- 为了证明VLM在将显微镜数据转化为详细的晶体信息方面的能力.
主要方法:
- 开发了MicroscopyGPT,这是一个基于多式模式生成预训练变压器的VLM.
- 在模拟STEM图像的多样化数据集上训练模型,用于大约5000个2D材料.
- 微调了11亿参数的LLaMA模型,以实现高效的训练.
主要成果:
- MicroscopyGPT准确地预测了完整的原子配置,包括晶格参数,元素类型和来自STEM图像的原子坐标.
- 该模型成功地学习了图像特征和晶体表征之间的复杂映射.
结论:
- 显微镜GPT提供了一种强大的自动化方法,用于从显微镜数据中重建原子结构.
- 这种VLM对加速材料发现,纳米技术和催化研究具有广泛的影响.
相关概念视频
Super-resolution Fluorescence Microscopy
7.8K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.8K
Electron Microscope Tomography and Single-particle Reconstruction
2.5K
Transmission electron microscopy (TEM) can be used to determine the 3D structure of biological samples with the help of techniques such as electron microscope tomography and single-particle reconstruction. While single-particle reconstruction can examine macromolecules and macromolecular complexes in vitro conditions only, tomography permits the study of cell components or small cells in vivo.
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...
2.5K
Atomic Force Microscopy
3.6K
Atomic force microscopy (AFM) is a type of scanning probe microscopy that can analyze topographic details of various specimens like ceramics, glass, polymers, and biological samples. AFM offers over 1000 times more resolution than the optical imaging system. Images generated from AFM are three-dimensional surface profiles, offering an advantage over the flat, two-dimensional images from other imaging techniques.
The AFM Probe
The probe is regarded as the heart of any AFM setup and comprises the...
The AFM Probe
The probe is regarded as the heart of any AFM setup and comprises the...
3.6K
Transformers
1.2K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.2K
Atomic Structure
199.8K
Overview
199.8K
Transmission Electron Microscopy
5.9K
In 1931, physicist Ernst Ruska—building on the idea that magnetic fields can direct an electron beam just as lenses can direct a beam of light in an optical microscope—developed the first prototype of the electron microscope. This development led to the development of the field of electron microscopy. In the transmission electron microscope (TEM), electrons are produced by a hot tungsten element and accelerated by a potential difference in an electron gun, which gives them up to 400...
5.9K


