CODAvision: best practices and a user-friendly interface for rapid, customizable segmentation of medical images

Image-based machine learning tools are powerful resources for analyzing medical images, with deep learning-based semantic segmentation commonly utilized to enable the spatial quantification of structures visible in images. However, dataset generation and training of segmentation algorithms requires advanced programming skills and intricate workflows, limiting their accessibility to scientists without prior coding expertise. Here we present the step-by-step instructions to carry out automatic segmentation of medical images guided by a graphical user interface using the CODAvision algorithm. This workflow simplifies the process of semantic segmentation of microanatomical structures by enabling users to train highly customizable deep learning models without extensive coding expertise. The protocol outlines best practices for creating robust training datasets, configuring model parameters and optimizing performance across diverse biomedical image modalities. CODAvision enhances the usability of the CODA algorithm by streamlining parameter configuration, model training and performance evaluation, automatically generating quantitative results and comprehensive reports. We show the use of CODA to serial histology by demonstrating robust performance across numerous medical image modalities and diverse biological questions. We provide sample results in data types, including histology, magnetic resonance imaging and computed tomography. We demonstrate the diverse use of this tool in applications, including quantification of metastatic burden in in vivo models and deconvolution of spot-based spatial transcriptomics datasets. This protocol is designed for researchers with interest in rapid design of highly customizable semantic segmentation algorithms and a basic understanding of programming and anatomy.