Quantitative performance assessment of Ultivue multiplex panels in formalin-fixed, paraffin-embedded human and murine...

We present a rigorous validation strategy to evaluate the performance of Ultivue multiplex immunofluorescence panels. We have quantified the accuracy and precision of four different multiplex panels (three human and one mouse) in tumor specimens with varying levels of T cell density. Our results show that Ultivue panels are typically accurate wherein the relative difference in cell proportion between a multiplex image and a 1-plex image is less than 20% for a given biomarker. Ultivue panels exhibited relatively high intra-run precision (CV ≤ 25%) and relatively low inter-run precision (CV >> 25%) which can be remedied by using local intensity thresholding to gate biomarker positivity. We also evaluated the reproducibility of cell-cell distance estimates measured from multiplex images which show high intra- and inter-run precision. We introduce a new metric, multiplex labeling efficiency, which can be used to benchmark the overall fidelity of the multiplex data across multiple batch runs. Taken together our results provide a comprehensive characterization of Ultivue panels and offer practical guidelines for analyzing multiplex images.