Related Experiment Video
Updated: Jul 2, 2025

Analyzing Mitochondrial Morphology Through Simulation Supervised Learning
Published on: March 3, 2023
Denoising diffusion probabilistic models for generation of realistic fully-annotated microscopy image datasets
Dennis Eschweiler1, Rüveyda Yilmaz1, Matisse Baumann1
1RWTH Aachen University, Institute of Imaging and Computer Vision, Aachen, Germany.
Abstract:
Recent advances in computer vision have led to significant progress in the generation of realistic image data, with denoising diffusion probabilistic models proving to be a particularly effective method. In this study, we demonstrate that diffusion models can effectively generate fully-annotated microscopy image data sets through an unsupervised and intuitive approach, using rough sketches of desired structures as the starting point. The proposed pipeline helps to reduce the reliance on manual annotations when training deep learning-based segmentation approaches and enables the segmentation of diverse datasets without the need for human annotations. We demonstrate that segmentation models trained with a small set of synthetic image data reach accuracy levels comparable to those of generalist models trained with a large and diverse collection of manually annotated image data, thereby offering a streamlined and specialized application of segmentation models.

