Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks
MetadataShow full item record
Due to the growing concern of chronic diseases and other health problems related to diet, there is a need to develop accurate methods to estimate an individual's food and energy intake. Measuring accurate dietary intake is an open research problem. In particular, accurate food portion estimation is challenging since the process of food preparation and consumption impose large variations on food shapes and appearances. In this paper, we present a food portion estimation method to estimate food energy (kilocalories) from food images using Generative Adversarial Networks (GAN). We introduce the concept of an "energy distribution" for each food image. To train the GAN, we design a food image dataset based on ground truth food labels and segmentation masks for each food image as well as energy information associated with the food image. Our goal is to learn the mapping of the food image to the food energy. We can then estimate food energy based on the energy distribution. We show that an average energy estimation error rate of 10.89% can be obtained by learning the image-to-energy mapping.
Showing items related by title, author, creator and subject.
Chae, J.; Woo, I.; Kim, S.; Maciejewski, R.; Zhu, F.; Delp, E.; Boushey, Carol; Ebert, D. (2011)As obesity concerns mount, dietary assessment methods for prevention and intervention are being developed. These methods include recording, cataloging and analyzing daily dietary records to monitor energy and nutrient ...
Fang, S.; Liu, C.; Zhu, F.; Delp, E.; Boushey, Carol (2016)In this paper we present a food portion estimation technique based on a single-view food image used for the estimation of the amount of energy (in kilocalories) consumed at a meal. Unlike previous methods we have developed, ...
Rahman, M.; Li, Q.; Pickering, M.; Frater, M.; Kerr, Deborah; Bouchey, C.; Delp, E. (2012)There is now convincing evidence that poor diet, in combination with physical inactivity are key determinants of an individual's risk of developing chronic diseases, such as obesity, cancer, cardiovascular disease or ...