Related Experiment Video
Updated: Feb 24, 2026

Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
Multimodal AI for Real-Time Food Safety and Quality: From Sensors to Foundation Models, Edge Deployment, and
Zhaojie Chen1, Guangyu Zhang2, Fan Zhang3
1Guangzhou College of Technology and Business Guangzhou People's Republic of China.
Abstract:
Real-time assurance of food safety and quality requires decisions at line speed, from farm to retail, using signals that span vision, spectroscopy, volatiles, biosensing, and process telemetry. This review investigates and summarizes evidence on multimodal artificial intelligence that fuses such heterogeneous data to detect hazards, verify authenticity, and predict freshness within seconds. We outline sensing coverage along the chain, typical response times, and reported limits of detection, then detail data engineering practices that make disparate streams analysis-ready, including time synchronization, co-registration to ground truth, and robust sampling for multisite and multiseason generalization. We appraise fusion strategies, from early and late schemes to attention-based hybrids that learn joint embeddings across images, spectra, and gas sensor time series, and we summarize head-to-head studies where multimodality improves accuracy or reduces error against unimodal baselines. We discuss the maturation of foundation scale encoders and vision language systems for food tasks, together with efficient adaptation, knowledge infusion from HACCP, and bias control. Finally, we examine edge deployment and validation in industrial settings, including hardware constraints, latency budgets, repeatability and reproducibility, documentation for audits, and perspectives on regulatory alignment in EU and US contexts, extended to China's standards-driven framework where the National Health Commission (NHC) and the State Administration for Market Regulation (SAMR) jointly issue and update National Food Safety Standards (GB) that govern key compliance requirements for labelling and contaminant limits. Evidence gaps persist, notably few multisite deployments over long durations, limited public benchmarks for hyperspectral and e-nose fusion, and sparse cost-benefit analyses in the scholarly record. Addressing these gaps will enable trustworthy, auditable multimodal AI that complements existing controls and reduces waste while protecting consumers.
Related Concept Videos
Multi-input and Multi-variable systems
In the absence of...
Neural Regulation
