Deep-Learning-Based Microfluidic Droplet Classification for Multijet Monitoring

Inkjet printing, the deposition of microfluidic droplets on a specified area, has gained increasing attention from both academia and industry for its versatility and scalability for mass production. Inkjet printing productivity depends on the number of nozzles used in a multijet process. However, droplet jetting conditions can vary for each nozzle due to multiple factors, such as the surface wetting condition of the nozzle, properties of the ink, and variances in the manufacturing of the nozzle head. For these reasons, droplet jetting conditions must be continuously monitored and evaluated by skillful engineers. The present study presents a deep-learning-based method to identify the droplet jetting status of a single-jet printing process. A convolutional neural network (CNN)-based on the MobileNetV2 model was employed with optimized hyperparameters to classify the inkjet frames containing images captured with a CCD camera. By accumulating the classified class data in order by frame time, the jetting conditions could be evaluated with high accuracy. The method was also successfully demonstrated with a multijet process, with a test time of less than a second per image.