IP Library Granted Patent US 9,165,398
Granted Patent B2
US 9,165,398 · App. 14/001,446 · Granted Oct 20, 2015

Analysis of food items captured in digital images

Inventors: Kyungjin Kim (Seoul, KR); Kiwon Lee (Seongnam, KR); Sungil Cho (Seoul, KR); Jiyoung Hong (Seoul, KR); Sungeun Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06T15/08G06F19/321G06F19/3475G06Q10/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,165,398
App. No.
14/001,446
Granted
Oct 20, 2015
Kind
B2
Abstract

Data analysis of a food item based on one or more digital images of the food item is disclosed. In one embodiment, the method comprises displaying, on a display unit of the smart device, first and second digital images of a meal, where the first digital image is captured before the second digital image. The method also comprises determining a volume of each food item in the first digital image and a volume of each food item in the second digital image by analyzing the first digital image and the second digital image using a digital image processing technique. The method further comprises generating, on the display unit, an amount of intake for the meal based on a difference between the volume of each food item in the first digital image and the volume of each food item in the second digital image.

Claims (33)

1. A smart device for analyzing food items captured in a digital image for diet watch, the smart device comprising: a display unit; a memory; and a processor coupled to the display unit and the memory and the processor configured to:

preset a calorie amount as a goal for the diet watch;

display, on the display unit, a first digital image of a meal and a second digital image of the meal, wherein the first digital image of the meal is captured before the second digital image of the meal;

determine a volume of each food item in the first digital image of the meal and a volume of the each food item in the second digital image of the meal by analyzing the first digital image and the second digital image using a digital image processing technique; and

generate for displaying on the display unit an amount of intake for the meal based on a difference between the volume of the each food item in the first digital image and the volume of the each food item in the second digital image,

wherein the processor is further configured to:

display, on the display unit, a third digital image of a specific food item, wherein the third digital image of the food item is captured after the second digital image of the meal;

calculate the remaining calorie amount which can be consumed by a user by subtracting the amount of intake for the meal from the preset calorie amount;

compare the calculated remaining calorie amount with the total calorie amount of the specific food item; and

display, on the third digital image, a marking identifying a recommended portion and a caption related to the recommended portion, and

wherein the recommended portion corresponds to or is less than the remaining calorie amount.

2. The smart device of claim 1 , further comprising a digital camera configured to capture the first digital image and the second digital image.

3. The smart device of claim 2 , wherein the digital camera is a two-dimensional digital camera or a three-dimensional digital camera.

4. The smart device of claim 1 , wherein the amount of intake is in calorie or nutrient weight.

5. The smart device of claim 1 , wherein the first digital image of the meal is captured before the meal is eaten and the second digital image of the meal is captured after the meal is eaten.

6. A method of a smart device for analyzing food items captured in a digital image for diet watch, the method comprising:

presetting a calorie amount as a goal for the diet watch;

displaying, on a display unit of the smart device, a first digital image of a meal and a second digital image of the meal, wherein the first digital image of the meal is captured before the second digital image of the meal;

determining a volume of each food item in the first digital image of the meal and a volume of the each food item in the second digital image of the meal by analyzing the first digital image and the second digital image using a digital image processing technique;

generating, on the display unit, an amount of intake for the meal based on a difference between the volume of the each food item in the first digital image and the volume of the each food item in the second digital image,

displaying, on the display unit of the smart device, a third digital image of a specific food item, wherein the third digital image of the food item is captured after the second digital image of the meal;

calculating the remaining calorie amount which can be consumed by a user by subtracting the amount of intake for the meal from the preset calorie amount;

comparing the calculated remaining calorie amount with the total calorie amount of the specific food item; and

displaying, on the third digital image, a marking identifying a recommended portion and a caption related to the recommended portion,

wherein the recommended portion corresponds to or is less than the remaining calorie amount.

7. The method of claim 6 , wherein the first digital image of the meal and the second digital image of the meal are received from an external device.

8. The method of claim 6 , wherein the first digital image of the meal and the second digital image of the meal are captured using a camera implemented on the smart device.

9. The method of claim 6 , wherein the displaying the first digital image further comprises displaying metadata of the each food item on the display unit.

10. The method of claim 9 , wherein the metadata comprises identification data of the each food item.

11. The method of claim 9 , wherein the metadata comprises an icon for the each food item.

12. The method of claim 9 , further comprising associating the each food item on the first digital image with a respective item of the metadata.

13. The method of claim 12 , wherein the associating the each food item with the respective item of the metadata is performed when the respective item of the metadata is dragged to a domain of the each food item displayed on the display unit.

14. The method of claim 6 , further comprising displaying an image of at least one food item recommended for next meal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2013
From: KIM, KYUNGJIN; LEE, KIWON; CHO, SUNGIL; HONG, JIYOUNG; KIM, SUNGEUN
To: LG ELECTRONICS INC.
Reel/Frame 031084/0246 →
Continuity (1)
Related Publication 20130335418A1 · Dec 19, 2013