Related Experiment Video
Updated: Jul 7, 2025

04:17
DNA Virus Detection System Based on RPA-CRISPR/Cas12a-SPM and Deep Learning
Published on: May 10, 2024
775
Fault Diagnosis Method for Human Coexistence Robots Based on Convolutional Neural Networks Using Time-Series Data
Seung-Hwan Choi1, Jun-Kyu Park2, Dawn An1
1Advanced Mechatronics Research Group, Daegyeong Division, Korea Institute of Industrial Technology, Daegu 42994, Republic of Korea.
Sensors (Basel, Switzerland)
|December 23, 2023
Summary
This study introduces advanced fault diagnosis for industrial robots, enhancing safety. Utilizing Wasserstein generative adversarial networks (WGAN-GP) and spectrograms with DenseNet models significantly improved diagnostic accuracy for robot driving modules.
Area of Science:
- Robotics
- Artificial Intelligence
- Machine Learning
Background:
- Industrial environments increasingly utilize human coexistence robots (HCRs), necessitating robust safety measures.
- Proactive fault diagnosis is critical for preventing safety incidents in HCRs.
- Limited post-failure data poses a challenge for training diagnostic models.
Purpose of the Study:
- To develop and evaluate novel fault diagnosis methods for HCR driving modules.
- To address the challenge of limited fault data using generative models.
- To identify optimal image encoding and convolutional neural network (CNN) architectures for time-series vibration data.
Main Methods:
- Collected time-series vibration data from HCR driving module durability tests.
- Employed Wasserstein generative adversarial networks with gradient penalty (WGAN-GP) to augment limited fault data.
- Converted time-series data into images using recurrence plot, Gramian angular field, Markov transition field, spectrogram, and scalogram.
- Applied and compared four CNN models (VGGNet, GoogleNet, ResNet, DenseNet) for fault classification.
Main Results:
- WGAN-GP significantly improved diagnostic accuracy by generating synthetic fault data.
- Spectrogram image encoding and the DenseNet CNN model demonstrated superior performance.
- The proposed methods achieved high accuracy in diagnosing faults in HCR driving modules.
Conclusions:
- The integration of WGAN-GP for data augmentation and spectrograms with DenseNet offers a powerful approach for robot fault diagnosis.
- This methodology enhances the safety and reliability of industrial robots, particularly HCRs.
- The findings provide a framework for selecting effective image encoding and CNN models for time-series fault analysis.

