You might also read
Articles linked to this work by shared authors, journal, and citation graph.
Updated: Aug 29, 2025

Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
This study evaluates five advanced artificial intelligence models to identify eating and drinking behaviors using data from a wearable device. Researchers compared how accurately different neural networks detect food consumption from muscle movement signals collected in real-world settings. The findings show that a specific architecture called ResNet provides the highest detection performance among the tested methods.
Area of Science:
Background:
No prior work had resolved which specific neural network architecture provides the most reliable detection of human consumption behaviors using wearable sensor data. Researchers often struggle to select optimal computational models for classifying complex physiological signals. It was already known that various deep learning frameworks exist for time-series analysis. However, their relative effectiveness for identifying ingestion events remained unclear. This gap motivated a systematic comparison of multiple state-of-the-art algorithms. Previous investigations frequently relied on limited datasets or controlled laboratory environments. That uncertainty drove the need for testing these models under free-living conditions. The current study addresses this challenge by evaluating five distinct classifiers using real-world temporalis muscle activity.
Purpose Of The Study:
The aim of this research was to compare the performance of various deep learning algorithms for classifying food intake using wearable sensor data. Scientists sought to determine which computational framework most accurately identifies eating and drinking behaviors. This investigation addressed the challenge of selecting appropriate models for processing complex physiological signals. The researchers focused on distinguishing ingestion events from other common daily activities. By testing multiple architectures, the team intended to establish a performance baseline for automated monitoring systems. This work was motivated by the need for more reliable classification methods in free-living environments. The study specifically examined how different neural network designs handle raw inputs from temporalis muscle sensors. Ultimately, the authors aimed to identify the most effective algorithm for enhancing dietary tracking accuracy.
Main Methods:
The review approach involved testing five distinct neural network architectures to classify ingestion events from raw sensor inputs. Investigators utilized a wearable device equipped with optical and accelerometer components to monitor temporalis muscle movement. Data collection occurred over twenty-three days involving seventeen participants in naturalistic settings. The team implemented a leave-one-subject-out cross-validation strategy to ensure rigorous model evaluation. Each of the five classifiers underwent training using the same temporal datasets to maintain consistency. The researchers compared the multilayer perceptron against four advanced convolutional architectures. This methodology allowed for a direct assessment of how different model structures process physiological time-series information. The final analysis focused on identifying which framework maximized balanced accuracy for detecting eating and drinking.
Main Results:
The Residual Neural Network achieved the highest balanced classification accuracy at 93.47% among all tested models. The Inception network followed with an average accuracy of 92.15% for identifying ingestion events. The Fully Convolutional Neural Network reached 90.18% accuracy during the evaluation process. The time Convolutional Neural Network demonstrated an average balanced accuracy of 88.84% across the subjects. These findings indicate that the Residual Neural Network consistently outperforms the other state-of-the-art algorithms tested. The study confirms that deep learning models effectively differentiate food intake from other daily activities using muscle sensor data. The results highlight significant performance variations between the five architectures when applied to the same dataset. These metrics provide a clear hierarchy of model effectiveness for this specific classification task.
Conclusions:
The authors propose that the Residual Neural Network architecture offers superior performance for identifying ingestion events compared to other evaluated models. Their analysis suggests that selecting the right deep learning framework significantly impacts classification accuracy in wearable systems. This synthesis indicates that time-series data from temporalis muscle sensors can effectively distinguish eating from other daily activities. The researchers conclude that the Residual Neural Network achieved the highest balanced accuracy among all tested configurations. These implications highlight the potential for improved monitoring of dietary habits using advanced computational approaches. The study demonstrates that specific network designs are better suited for processing complex sensor inputs in real-world environments. Future applications could leverage these findings to enhance the reliability of automated ingestion tracking systems. The evidence supports prioritizing the Residual Neural Network when developing similar classification tools for physiological signal analysis.
The researchers propose that the Residual Neural Network (ResNet) provides the highest performance, achieving 93.47% balanced accuracy. This model outperformed the multilayer perceptron, time Convolutional Neural Network, Fully Convolutional Neural Network, and Inception network in distinguishing ingestion from other activities.
The Automatic Ingestion Monitor v2 (AIM-2) served as the primary tool. This wearable system utilizes an optical sensor alongside a 3-axis accelerometer to capture muscle activation patterns near the temporalis region during consumption.
A leave-one-subject-out cross-validation scheme was necessary to ensure the robustness of the models. This technique prevents overfitting by training on all participants except one, then testing the performance on the excluded individual, thereby validating generalization across different users.
The dataset consisted of raw sensor signals captured from 17 pilot subjects over 23 days. These data were recorded while participants engaged in their normal, free-living daily routines rather than in a restricted laboratory setting.
The study measured balanced classification accuracy to assess model performance. ResNet reached 93.47%, while the Inception network, Fully Convolutional Neural Network, and time Convolutional Neural Network achieved 92.15%, 90.18%, and 88.84%, respectively.
The authors suggest that their findings provide a benchmark for selecting appropriate algorithms in wearable monitoring. They propose that the superior accuracy of ResNet makes it a preferred choice for future automated systems designed to track dietary intake patterns.