Affiliation:
1. Department of Electrical and Electronic Engineering, Konkuk University, 1 Hwayang-dong, Gwangjin-gu, Seoul 05029, Republic of Korea
Abstract
Continuous monitoring and recording of the type and caloric content of ingested foods with a minimum of user intervention is very useful in preventing metabolic diseases and obesity. In this paper, automatic recognition of food type and caloric content was achieved via the use of multi-spectral images. A method of fusing the RGB image and the images captured at ultra violet, visible, and near-infrared regions at center wavelengths of 385, 405, 430, 470, 490, 510, 560, 590, 625, 645, 660, 810, 850, 870, 890, 910, 950, 970, and 1020 nm was adopted to improve the accuracy. A convolutional neural network (CNN) was adopted to classify food items and estimate the caloric amounts. The CNN was trained using 10,909 images acquired from 101 types. The objective functions including classification accuracy and mean absolute percentage error (MAPE) were investigated according to wavelength numbers. The optimal combinations of wavelengths (including/excluding the RGB image) were determined by using a piecewise selection method. Validation tests were carried out on 3636 images of the food types that were used in training the CNN. As a result of the experiments, the accuracy of food classification was increased from 88.9 to 97.1% and MAPEs were decreased from 41.97 to 18.97 even when one kind of NIR image was added to the RGB image. The highest accuracy for food type classification was 99.81% when using 19 images and the lowest MAPE for caloric content was 10.56 when using 14 images. These results demonstrated that the use of the images captured at various wavelengths in the UV and NIR bands was very helpful for improving the accuracy of food classification and caloric estimation.
Funder
Korean Evaluation Institute of Industrial Technology (KEIT) under Industrial Embedded System Technology Development (R&D) Program
Subject
Plant Science,Health Professions (miscellaneous),Health (social science),Microbiology,Food Science
Reference40 articles.
1. The epidemiology of obesity and gastrointestinal and other diseases: An overview;Moayyedi;Dig. Dis. Sci.,2008
2. Metabolism or appetite: Questions of energy balance with particular reference to obesity;Prentice;J. Hum. Nutr. Diet.,1989
3. Methodology, correlational analysis, and interpretation of diet diary records of the food and fluid intake of free-living humans;Appetite,1994
4. Four-day multimedia diet records underestimate energy needs in middle-aged and elderly women as determined by doubly-labeled water;Kaczkowski;J. Nutr.,2000
5. Nishimura, J., and Kuroda, T. (2008, January 7–9). Eating habits monitoring using wireless wearable in-ear microphone. Proceedings of the International Symposium on Wireless Pervasive Communication, Santorini, Greece.