Surveying Nutrient Assessment with Photographs of Meals (SNAPMe): A Benchmark Dataset of Food Photos for Dietary Assessment
-
Published:2023-11-30
Issue:23
Volume:15
Page:4972
-
ISSN:2072-6643
-
Container-title:Nutrients
-
language:en
-
Short-container-title:Nutrients
Author:
Larke Jules A.1, Chin Elizabeth L.1, Bouzid Yasmine Y.2ORCID, Nguyen Tu1, Vainberg Yael2, Lee Dong Hee3, Pirsiavash Hamed3, Smilowitz Jennifer T.2, Lemay Danielle G.12ORCID
Affiliation:
1. United States Department of Agriculture, Agricultural Research Service, Western Human Nutrition Research Center, Davis, CA 95616, USA 2. Department of Nutrition, University of California Davis, Davis, CA 95616, USA 3. Department of Computer Science, University of California Davis, Davis, CA 95616, USA
Abstract
Photo-based dietary assessment is becoming more feasible as artificial intelligence methods improve. However, advancement of these methods for dietary assessment in research settings has been hindered by the lack of an appropriate dataset against which to benchmark algorithm performance. We conducted the Surveying Nutrient Assessment with Photographs of Meals (SNAPMe) study (ClinicalTrials ID: NCT05008653) to pair meal photographs with traditional food records. Participants were recruited nationally, and 110 enrollment meetings were completed via web-based video conferencing. Participants uploaded and annotated their meal photos using a mobile phone app called Bitesnap and completed food records using the Automated Self-Administered 24-h Dietary Assessment Tool (ASA24®) version 2020. Participants included photos before and after eating non-packaged and multi-serving packaged meals, as well as photos of the front and ingredient labels for single-serving packaged foods. The SNAPMe Database (DB) contains 3311 unique food photos linked with 275 ASA24 food records from 95 participants who photographed all foods consumed and recorded food records in parallel for up to 3 study days each. The use of the SNAPMe DB to evaluate ingredient prediction demonstrated that the publicly available algorithms FB Inverse Cooking and Im2Recipe performed poorly, especially for single-ingredient foods and beverages. Correlations between nutrient estimates common to the Bitesnap and ASA24 dietary assessment tools indicated a range in predictive capacity across nutrients (cholesterol, adjusted R2 = 0.85, p < 0.0001; food folate, adjusted R2 = 0.21, p < 0.05). SNAPMe DB is a publicly available benchmark for photo-based dietary assessment in nutrition research. Its demonstrated utility suggested areas of needed improvement, especially the prediction of single-ingredient foods and beverages.
Funder
United States Department of Agriculture (USDA)/NSF AI Institute USDA ARS SCINet AI Center of Excellence of the USDA Agricultural Research Service
Subject
Food Science,Nutrition and Dietetics
Reference47 articles.
1. The National Cancer Institute’s Dietary Assessment Primer;Kirkpatrick;FASEB J.,2015 2. Dietary Assessment Methods in Epidemiological Research: Current State of the Art and Future Prospects;Naska;F1000Research,2017 3. Food and Agriculture Organization of the United Nations (2023, November 01). Dietary Assessment: A Resource Guide to Method Selection and Application in Low Resource Settings|Intake [Internet]. Available online: https://www.intake.org/resource/dietary-assessment-resource-guide-method-selection-and-application-low-resource-settings. 4. Christodoulidis, S., and Anthimopoulos, M. (2015). New Trends in Image Analysis and Processing—ICIAP 2015 Workshops: ICIAP 2015 International Workshops, BioFor, CTMR, RHEUMA, ISCA, MADiMa, SBMI, and QoEM, Genoa, Italy, 7–8 September 2015, Springer. 5. Hassannejad, H., Matrella, G., Ciampolini, P., De Munari, I., Mordonini, M., and Cagnoni, S. (2016, January 16). Food Image Recognition Using Very Deep Convolutional Networks. Proceedings of the MADiMa 2016—the 2nd International Workshop on Multimedia Assisted Dietary Management, Co-Located with ACM Multimedia 2016, Amsterdam, The Netherlands.
|
|