Cross-modality synthesis of EM time series and live fluorescence imaging

Analyses across imaging modalities allow the integration of complementary spatiotemporal information about brain development, structure, and function. However, systematic atlasing across modalities is limited by challenges to effective image alignment. We combine highly spatially resolved electron microscopy (EM) and highly temporally resolved time-lapse fluorescence microscopy (FM) to examine the emergence of a complex nervous system in Caenorhabditis elegans embryogenesis. We generate an EM time series at four classic developmental stages and create a landmark-based co-optimization algorithm for cross-modality image alignment, which handles developmental heterochrony among datasets to achieve accurate single-cell level alignment. Synthesis based on the EM series and time-lapse FM series carrying different cell-specific markers reveals critical dynamic behaviors across scales of identifiable individual cells in the emergence of the primary neuropil, the nerve ring, as well as a major sensory organ, the amphid. Our study paves the way for systematic cross-modality data synthesis in C. elegans and demonstrates a powerful approach that may be applied broadly.