Related Experiment Video
Updated: May 27, 2025

Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
Enhancing food recognition accuracy using hybrid transformer models and image preprocessing techniques
B N Jagadesh1, Srihari Varma Mantena2, Asha P Sathe3
1School of Computer Science and Engineering, VIT-AP University, Vijayawada, India.
Abstract:
This study presents a robust approach for continuous food recognition essential for nutritional research, leveraging advanced computer vision techniques. The proposed method integrates Mutually Guided Image Filtering (MuGIF) to enhance dataset quality and minimize noise, followed by feature extraction using the Visual Geometry Group (VGG) architecture for intricate visual analysis. A hybrid transformer model, combining Vision Transformer and Swin Transformer variants, is introduced to capitalize on their complementary strengths. Hyperparameter optimization is performed using the Improved Discrete Bat Algorithm (IDBA), resulting in a highly accurate and efficient classification system. Experimental results highlight the superior performance of the proposed model, achieving a classification accuracy of 99.83%, significantly outperforming existing methods. This study underscores the potential of hybrid transformer architectures and advanced preprocessing techniques in advancing food recognition systems, offering enhanced accuracy and efficiency for practical applications in dietary monitoring and personalized nutrition recommendations.

