Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Wearable Camera-Based Dietary Assessment of Mother-Father Dyads in Urban and Rural Households in Ghana.

Current developments in nutrition·2026
Same author

Eating architecture components and their associations with BMI in urban and rural Ghanaian mothers, fathers, children, and adolescents, assessed using a wearable camera: A cross-sectional study.

Chronobiology international·2026
Same author

FRIENDS GUI: A Graphical User Interface for Data Collection and Visualization of Vaping Behavior from a Passive Vaping Monitor.

Journal of open research software·2026
Same author

Screen Detection from Egocentric Image Streams Leveraging Multi-View Vision Language Model.

IEEE transactions on multimedia·2026
Same author

SmartStep: A Fully Integrated, Low-Power Insole Monitor.

Electronics·2026
Same author

Image-Based Volume Estimation for Food in a Bowl.

Journal of food engineering·2026

Related Experiment Video

Updated: Aug 29, 2025

Deep Neural Networks for Image-Based Dietary Assessment
13:19

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

9.3K

A Comparative Study of Deep Learning Algorithms for Detecting Food Intake.

Tonmoy Ghosh, Edward Sazonov

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
    |September 10, 2022
    PubMed
    Summary

    This study evaluates five advanced artificial intelligence models to identify eating and drinking behaviors using data from a wearable device. Researchers compared how accurately different neural networks detect food consumption from muscle movement signals collected in real-world settings. The findings show that a specific architecture called ResNet provides the highest detection performance among the tested methods.

    Keywords:
    wearable technologyneural networksingestion monitoringtime-series analysis

    Frequently Asked Questions

    More Related Videos

    Integration of Animal Behavioral Assessment and Convolutional Neural Network to Study Wasabi-Alcohol Taste-Smell Interaction
    06:19

    Integration of Animal Behavioral Assessment and Convolutional Neural Network to Study Wasabi-Alcohol Taste-Smell Interaction

    Published on: August 16, 2024

    494
    Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification
    07:47

    Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification

    Published on: February 14, 2018

    11.4K

    Related Experiment Videos

    Last Updated: Aug 29, 2025

    Deep Neural Networks for Image-Based Dietary Assessment
    13:19

    Deep Neural Networks for Image-Based Dietary Assessment

    Published on: March 13, 2021

    9.3K
    Integration of Animal Behavioral Assessment and Convolutional Neural Network to Study Wasabi-Alcohol Taste-Smell Interaction
    06:19

    Integration of Animal Behavioral Assessment and Convolutional Neural Network to Study Wasabi-Alcohol Taste-Smell Interaction

    Published on: August 16, 2024

    494
    Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification
    07:47

    Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification

    Published on: February 14, 2018

    11.4K

    Area of Science:

    • Wearable sensor technology within deep learning research
    • Biomedical signal processing and food intake monitoring

    Background:

    No prior work had resolved which specific neural network architecture provides the most reliable detection of human consumption behaviors using wearable sensor data. Researchers often struggle to select optimal computational models for classifying complex physiological signals. It was already known that various deep learning frameworks exist for time-series analysis. However, their relative effectiveness for identifying ingestion events remained unclear. This gap motivated a systematic comparison of multiple state-of-the-art algorithms. Previous investigations frequently relied on limited datasets or controlled laboratory environments. That uncertainty drove the need for testing these models under free-living conditions. The current study addresses this challenge by evaluating five distinct classifiers using real-world temporalis muscle activity.

    Purpose Of The Study:

    The aim of this research was to compare the performance of various deep learning algorithms for classifying food intake using wearable sensor data. Scientists sought to determine which computational framework most accurately identifies eating and drinking behaviors. This investigation addressed the challenge of selecting appropriate models for processing complex physiological signals. The researchers focused on distinguishing ingestion events from other common daily activities. By testing multiple architectures, the team intended to establish a performance baseline for automated monitoring systems. This work was motivated by the need for more reliable classification methods in free-living environments. The study specifically examined how different neural network designs handle raw inputs from temporalis muscle sensors. Ultimately, the authors aimed to identify the most effective algorithm for enhancing dietary tracking accuracy.

    Main Methods:

    The review approach involved testing five distinct neural network architectures to classify ingestion events from raw sensor inputs. Investigators utilized a wearable device equipped with optical and accelerometer components to monitor temporalis muscle movement. Data collection occurred over twenty-three days involving seventeen participants in naturalistic settings. The team implemented a leave-one-subject-out cross-validation strategy to ensure rigorous model evaluation. Each of the five classifiers underwent training using the same temporal datasets to maintain consistency. The researchers compared the multilayer perceptron against four advanced convolutional architectures. This methodology allowed for a direct assessment of how different model structures process physiological time-series information. The final analysis focused on identifying which framework maximized balanced accuracy for detecting eating and drinking.

    Main Results:

    The Residual Neural Network achieved the highest balanced classification accuracy at 93.47% among all tested models. The Inception network followed with an average accuracy of 92.15% for identifying ingestion events. The Fully Convolutional Neural Network reached 90.18% accuracy during the evaluation process. The time Convolutional Neural Network demonstrated an average balanced accuracy of 88.84% across the subjects. These findings indicate that the Residual Neural Network consistently outperforms the other state-of-the-art algorithms tested. The study confirms that deep learning models effectively differentiate food intake from other daily activities using muscle sensor data. The results highlight significant performance variations between the five architectures when applied to the same dataset. These metrics provide a clear hierarchy of model effectiveness for this specific classification task.

    Conclusions:

    The authors propose that the Residual Neural Network architecture offers superior performance for identifying ingestion events compared to other evaluated models. Their analysis suggests that selecting the right deep learning framework significantly impacts classification accuracy in wearable systems. This synthesis indicates that time-series data from temporalis muscle sensors can effectively distinguish eating from other daily activities. The researchers conclude that the Residual Neural Network achieved the highest balanced accuracy among all tested configurations. These implications highlight the potential for improved monitoring of dietary habits using advanced computational approaches. The study demonstrates that specific network designs are better suited for processing complex sensor inputs in real-world environments. Future applications could leverage these findings to enhance the reliability of automated ingestion tracking systems. The evidence supports prioritizing the Residual Neural Network when developing similar classification tools for physiological signal analysis.

    The researchers propose that the Residual Neural Network (ResNet) provides the highest performance, achieving 93.47% balanced accuracy. This model outperformed the multilayer perceptron, time Convolutional Neural Network, Fully Convolutional Neural Network, and Inception network in distinguishing ingestion from other activities.

    The Automatic Ingestion Monitor v2 (AIM-2) served as the primary tool. This wearable system utilizes an optical sensor alongside a 3-axis accelerometer to capture muscle activation patterns near the temporalis region during consumption.

    A leave-one-subject-out cross-validation scheme was necessary to ensure the robustness of the models. This technique prevents overfitting by training on all participants except one, then testing the performance on the excluded individual, thereby validating generalization across different users.

    The dataset consisted of raw sensor signals captured from 17 pilot subjects over 23 days. These data were recorded while participants engaged in their normal, free-living daily routines rather than in a restricted laboratory setting.

    The study measured balanced classification accuracy to assess model performance. ResNet reached 93.47%, while the Inception network, Fully Convolutional Neural Network, and time Convolutional Neural Network achieved 92.15%, 90.18%, and 88.84%, respectively.

    The authors suggest that their findings provide a benchmark for selecting appropriate algorithms in wearable monitoring. They propose that the superior accuracy of ResNet makes it a preferred choice for future automated systems designed to track dietary intake patterns.