Related Experiment Video
Updated: May 3, 2026

Determining 3D Flow Fields via Multi-camera Light Field Imaging
Published on: March 6, 2013
STEMDiff: A Wavelet-Enhanced Diffusion Model for Physics-Informed STEM Image Generation
Yihui Bao1, Xinyi Lu1, Yanyan Xia1
1School of Information Science and Engineering, East China University of Science and Technology, Shanghai, 200237, P. R. China.
Abstract:
Machine learning has emerged as a powerful tool for analyzing scanning transmission electron microscopy (STEM) images, yet its widespread application remains constrained by the scarcity of annotated training data. While deep generative models offer a promising solution, they typically struggle to reproduce the complex high-frequency components that define experimental STEM images. Here, STEMDiff, a conditional diffusion model that transforms simple binary labels derived from crystal structures into realistic STEM images through a physical information embedding strategy, is proposed. By developing a novel Discrete Wavelet Transform-based skip-connection architecture, the high-frequency bias inherent in diffusion models are addressed, enabling the preservation of experimental noise characteristics. This approach generates images that are quantitatively nearly indistinguishable from experimental data (17 fold improvement over previous methods) while retaining ground truth structural information. Fully convolutional networks trained exclusively on these synthetic images achieve high-precision atomic column detection in experimental STEM images of WSe2 and graphene, despite the presence of substantial background noise and contamination. This approach effectively eliminates the need for laborious manual annotation, providing a scalable solution to the data bottleneck in STEM image analysis. The principles underlying STEMDiff can extend to other scientific imaging modalities, accelerating advancements in materials design for water treatment.
More Related Videos
11:00Experimental Investigation of Secondary Flow Structures Downstream of a Model Type IV Stent Failure in a 180° Curved Artery Test Section
Published on: July 19, 2016
09:04Lens-free Video Microscopy for the Dynamic and Quantitative Analysis of Adherent Cell Culture
Published on: February 23, 2018