A vision-based dietary survey and assessment system for college students in China

Understanding the current dietary habits of college students is essential due to the pressing issues of unbalanced diets and insufficient nutrition. However, traditional approaches frequently depend on recollection, which can introduce unconscious bias and make them difficult to implement. Herein, we introduce a new computer vision system to evaluate the dietary habits of college students in China. A specialized food dataset comprising RGB-D images, recipes with ingredient masses, and nutrient composition was created using data collected from college canteens. First, object detection models were utilized to identify food categories and locations. Subsequently, we introduced a method for automatically estimating the food volume of nonstandard portions using position and depth information. The final nutrients were derived directly or indirectly through the database. Experimental results demonstrate the applicability of the YOLOv8 object detection model and volume estimation method to our tasks. To support the development of devices for detecting food intake and diet management, we have made our dataset publicly available. The College Canteen Food-100 dataset is publicly available at https://github.com/zichengzichengzi/CC-FOOD-100.