Fault tolerance in distributed systems using deep learning approaches

Recently, distributed systems have become the backbone of technological development. It serves as the foundation for new trends technologies such as blockchain, the internet of things and others. A distributed system provides fault tolerance and decentralization, where a fault in any component does not result in a whole system failure. In addition, deep learning model enables processing data to find patterns, which helps in classification, regression, prediction, and clustering. This work employs deep learning to handle faults within distributed systems in three scenarios. Firstly, a faulty processor may not be able to produce the right output. Therefore, deep learning model uses the inputs and outputs of other processors to find patterns and produces the proper output of the faulty processor. Secondly, if a faulty possessor corrupts its inputs as well, then the deep learning model learns from the inputs and the outputs of successful processors and produces the proper output of the faulty processor, even with corrupted inputs. Thirdly, for unrelated data, in which the patterns of the input of the faulty processors differ from the patterns of the inputs of successful ones. In this case, the model is able to discover the new pattern and to be labeled as unknown. In the experiments, we use deep learning models like VGG16, VGG19, AlexNet LSTM and ResNet34, to investigate the performance of the deep learning in the three mentioned scenarios. For unstructured datasets, the accuracy of the models is affected by the size of the faulty data. The accuracy of all models lies between 60% when the size of the faulty data is 90%, and 96%, when the size of the faulty data is 90%. The structured datasets are not significantly affected by the portion of the faulty data and the accuracy reaches 99%.