Anomaly Detection in Fused Filament Fabrication Using Machine Learning

Fused filament fabrication (FFF) has been widely used in various industries, and the adoption of technology is growing significantly. However, the FFF process has several disadvantages like inconsistent part quality and print repeatability. The occurrence of manufacturing-induced defects often leads to these shortcomings. This study aims to develop and implement an on-site monitoring system, which consists of a camera attached to the print head and the laptop that processes the video feed, for the extrusion-based 3D printers incorporating computer vision and object detection models to detect defects and make corrections in real-time. Image data from two classes of defects were collected to train the model. Various YOLO architectures were evaluated to study the ability to detect and classify printing anomalies such as under-extrusion and over-extrusion. Four of the trained models, YOLOv3 and YOLOv4 with "Tiny" variation, achieved a mean average precision score of >80% using the AP50 metric. Subsequently, two of the models (YOLOv3-Tiny 100 and 300 epochs) were optimized using Open Neural Network Exchange (ONNX) model conversion and ONNX Runtime to improve the inference speed. A classification accuracy rate of 89.8% and an inference speed of 70 frames per second were obtained. Before implementing the on-site monitoring system, a correction algorithm was developed to perform simple corrective actions based on defect classification. The G-codes of the corrective actions were sent to the printers during the printing process. This implementation successfully demonstrated real-time monitoring and autonomous correction during the FFF 3D printing process. This implementation will pave the way for an on-site monitoring and correction system through closed-loop feedback from other additive manufacturing (AM) processes.