Towards Deep Transfer Learning in Industrial Internet of Things

Machine learning techniques have been widely adopted to assist in data analysis in a variety of Internet of Things (IoT) systems. To enable flexible use of trained learning models, one viable solution is to leverage all categories of data from different applications to train a general model, which can be further tuned for applications through tuning process. This process incurs additional overhead at the start, but makes later revision and iteration faster and more flexible. Nonetheless, due to limited computing capabilities, IoT devices cannot handle the training process of large datasets. To address this issue, in this paper, we propose a general framework to adopt transfer learning in industrial Internet of Things (IIoT) systems. In our study, we categorize the application space of applying transfer learning to IIoT systems into four generic scenarios: centralized transfer learning with large datasets, distributed transfer learning with large datasets, centralized transfer learning with small datasets, and distributed transfer learning with small datasets. According to the characteristics of each scenario, we design workflows to apply transfer learning technique. To demonstrate the efficacy of the approach, we apply our transfer learning technique to the task of IIoT component recognition. We use the known VGG-16 model and leverage T-Less industrial datasets to evaluate the performance of our approach in different scenarios. Via performance evaluation, our experimental results confirm the efficacy of our approach, which can not only reduce training time, but also achieve higher accuracy, compared with the classical convolutional neural network (CNN) approach.