Assuring quality in assisted reproduction laboratories: assessing the performance of ART Compass - a digital art...

Staff management is the most cited ART/IVF laboratory inspection deficiency. Small ART/IVF clinics may be challenged to perform these activities by low staff volume; similarly, large ART/IVF networks may be challenged by high staff volume and large datasets. Here, we sought to investigate the performance of an automated, digital platform solution to manage this necessary task.

The ART Compass (ARTC) digital staff management platform was used to assess the clinical decision-making of ART laboratory staff. The survey modules presented standardized instructions to technologists and measured inter- and intra-technologist variability for subjective "clinical decision-making" type questions. Internal and external comparisons were achieved by providing technologists two answers: (1) a comparison to their own lab director and (2) to the most popular response collectively provided by all lab director level accounts. The platform is hosted on HIPAA compliant Amazon web servers, accessible via web browser and mobile applications for iOS (Apple) and Android mobile devices.

Here, we investigated the performance of a digital staff management platform for single embryologist IVF practices and for three IVF lab networks (sites A, B, C) from 2020 to 2022. Embryology dish preparation survey results show variance among respondents in the following: PPE use, media volume, timing of oil overlay, and timing of moving prepared dishes to incubators. Surveying the perceived Gardner score and terms in use for early blastocysts reveals a lack of standardization of terminology and fair to poor agreement. We observed moderate inter-technologist agreement for ICM and TE grade (0.47 and 0.52, respectively). Lastly, the clinical decision of choice to freeze or discard an embryo revealed that agreement to freeze was highest for the top-quality embryos, and that some embryos can be highly contested, evenly split between choice to freeze or discard.

We conclude that a digital platform is a novel and effective tool to automate, routinely monitor, and assure quality for staff-related parameters in ART and IVF laboratories. Use of a digital platform can increase regulatory compliance and provide actionable insight for quality assurance in both single embryologist practices and for large networks. Furthermore, clinical decision-making can be augmented with artificial intelligence integration.