Model-based food volume estimation using 3D pose
MetadataShow full item record
We are developing a dietary assessment system to automatically identify and quantify foods and beverages consumed by analyzing meal images captured with a mobile device. After food items are segmented and identified, accurately estimating the volume of the food in the image is important for determining the nutrient content of the food. In this paper, we proposed a novel food portion size estimation method for rigid food items using a single image. First, we create a 3D graphical model during the training step using 3D reconstruction from multiple views. Then, for each food image, we determine the translation and elevation parameters of each of the food items, which are relative to the camera coordinate through camera calibration. Using these geometric parameters we project the pre-built 3D model of each food item back to the image plane. Subsequently, the remaining degrees-of-freedom (DOF) for the final pose is estimated by image similarity measure. The experimental results of our volume estimation method for four food categories validate the accuracy and reliability of our model-based approach.
Showing items related by title, author, creator and subject.
Fang, S.; Liu, C.; Zhu, F.; Delp, E.; Boushey, Carol (2016)In this paper we present a food portion estimation technique based on a single-view food image used for the estimation of the amount of energy (in kilocalories) consumed at a meal. Unlike previous methods we have developed, ...
Rahman, M.; Li, Q.; Pickering, M.; Frater, M.; Kerr, Deborah; Bouchey, C.; Delp, E. (2012)There is now convincing evidence that poor diet, in combination with physical inactivity are key determinants of an individual's risk of developing chronic diseases, such as obesity, cancer, cardiovascular disease or ...
Adolescents in the United States can identify familiar foods at the time of consumption and when prompted with an image 14 h postprandial, but poorly estimate portionsSchap, T.; Six, B.; Delp, E.; Ebert, D.; Kerr, Deborah; Boushey, C. (2011)Objective To evaluate adolescents- abilities to identify foods and estimate the portion size of foods consumed in order to inform development of the mobile telephone food record (mpFR).Design Data were collected from two ...