IP Library Granted Patent US 10,580,533
Granted Patent B2
US 10,580,533 · App. 15/852,156 · Granted Mar 3, 2020

Image-based food analysis for medical condition warnings

Inventor: Marwan Sati (Mississauga, CA)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G16H50/30A61M5/1723G06K9/6256G06K9/78G06T7/0004G16H20/60A61M2205/3306A61M2205/3569A61M2205/50A61M2230/201A61M2230/63G06F16/5854G06T2207/30128G16H40/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,580,533
App. No.
15/852,156
Granted
Mar 3, 2020
Kind
B2
Abstract

A method of performing image based analysis of food. The method includes receiving, with an electronic processor, image data captured by an image capture device, analyzing the image data to identify a food represented in the image data, and determining a characteristic of the food identified in the image data. The method further includes accessing medical information of a user, determining a level of risk associated with the user ingesting the food identified in the image data based on the medical information of the user, and outputting a notification, where the notification providing information related to the level of risk associated with the user ingesting the food identified in the image data.

Claims (24)

1. A method of performing image based analysis of food, the method comprising:

receiving, with an electronic processor, image data captured by a first image capture device operated by a first user;

analyzing the image data, with the electronic processor, to identify a food represented in the image data;

determining, with the electronic processor, a characteristic of the food identified in the image data;

accessing, with the electronic processor, medical information of a second user;

determining, with the electronic processor, a level of risk associated with the second user ingesting the food identified in the image data based on the medical information of the second user, and

outputting, with the electronic processor, a notification, the notification providing information related to the level of risk associated with the second user ingesting the food identified in the image data.

2. The method of claim 1 , wherein determining the characteristic of the food identified in the image data includes identifying at least one of nutritional information of the food and an ingredient of the food.

3. The method of claim 1 , wherein outputting the notification includes transmitting the notification to a user device, wherein the notification includes at least one selected from a group consisting of visual message output via a display device of the user device, an audible message output via a speaker of the user device, and a tactile message generated via a vibration engine of the user device.

4. The method of claim 1 , wherein outputting the notification includes outputting the notification via a user device, wherein the electronic processor is included in the user device.

5. The method of claim 1 , wherein outputting the notification includes outputting a notification including a recommendation for mitigating the level of risk.

6. The method of claim 5 , wherein outputting the notification including the recommendation for mitigating the level of risk includes outputting a notification including at least one of a recommendation of a type of medication the second user should take and a dosage of the medication the second user should take.

7. The method of claim 1 , further comprising communicating with a medical device delivering medication to the second user, wherein communicating with the medical device includes communicating with the medical device through a user device.

8. The method of claim 7 , wherein communicating with the medical device includes receiving confirmation from the medical device that the second user ingested the food identified in the image data and transmitting instructions to the medical device to prepare a dose of the medication to the second user.

9. The method of claim 7 , wherein communicating with the medical device includes receiving confirmation from the medical device that the second user ingested the food identified in the image data and transmitting instructions to the medical device to prepare and automatically administer a dose of the medication to the second user.

10. The method of claim 1 , wherein accessing medical information of the second user includes accessing an electronic medical record of the second user.

11. Non-transitory computer readable medium storing instructions that, when executed by an electronic processor, perform a set of functions, the set of functions comprising:

receiving image data captured by a first image capture device;

analyzing the image data to identify a food represented in the image data;

determining a characteristic of the food identified in the image data by accessing a food database containing a library of foods and associated characteristics of the foods;

accessing medical information of a first user;

determining a level of risk associated with the first user ingesting the food identified in the image data based on the medical information of the first user;

communicating with a medical device to prepare a dosage of medicine based on the level of risk, and

outputting a notification to a second user device operated by the second user related to the level of risk associated with the first user ingesting the food.

Assignments (3)
SECURITY INTEREST Recorded Oct 1, 2025
From: MERATIVE US L.P.; MERGE HEALTHCARE INCORPORATED
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 072808/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: MERATIVE US L.P.
Reel/Frame 061496/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2018
From: SATI, MARWAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 044787/0198 →
Continuity (1)
Related Publication 20190198173A1 · Jun 27, 2019
Cited By (1)
US 12,704,938