Building Better Deep Learning Models Through Dataset Fusion: A Case Study in Skin Cancer Classification with...

Background/Objectives: This work brings to light the importance of forming large training datasets with diverse images generated and proposes an image dataset merging application, namely, the Data Merger App, to streamline the management and synthesis of large-scale datasets. The Data Merger can recognize common classes across various datasets and provides tools to combine and organize them in a well-structured and easily accessible way. Methods: A case study is then presented, leveraging four different Convolutional Neural Network (CNN) models, VGG16, ResNet50, MobileNetV3-small, and DenseNet-161, and a Visual Transformer (ViT), to benchmark their performance to classify skin cancer images, when trained on single datasets and on enhanced hyperdatasets generated by the Data Merger App. Results: Extended experimental results indicated that enhanced hyperdatasets are efficient and able to improve the accuracies of classification models, whether the models are trained from scratch or by using Transfer Learning. Moreover, the ViT model was reported for higher classification accuracies compared to CNNs on datasets with a limited number of classes, reporting 91.87% accuracy for 9 classes, as well as in the case of enhanced hyperdatasets with multiple numbers of classes, reporting accuracy of 58% for 32 classes. Conclusions: In essence, this work demonstrates the great significance of data combination, as well as the utility value of the developed prototype web application as a critical tool for researchers and data scientists, enabling them to easily handle complex datasets, combine datasets into larger diverse versions, to further enhance the generalization ability of models and improve the quality and impact of their work.