Granted Patent B2

US 12,374,455 · App. 18/424,283 · Granted Jul 29, 2025

Inventors: Katelijn Vleugels (Austin, TX); Ronald Marianetti, II (Campbell, CA)

Assignee: MEDTRONIC MINIMED, INC.

G16H40/63A61B5/0022A61B5/1118A61B5/1121A61B5/1123A61B5/16A61B5/4866A61B5/4875A61B5/7282G16H20/60G16H40/67G16H50/70G16H70/60A61B2505/07A61B2560/0209A61B2562/0219

Abstract

Claims (46)

1. A method of sensing user activity, the method comprising:

obtaining sensor readings associated with movement of a body part of a user of an electronic device;

determining a gesture indicative of a start of a food intake event based on the sensor readings and on a confidence level associated with the gesture exceeding a threshold;

obtaining an image related to the food intake event, the image captured using an image capture capability that is activated responsive to determining the gesture indicative of the start of the food intake event;

determining a sequence of gestures related to the food intake event based on the sensor readings;

determining, from the sequence of gestures, one or more parameters for the food intake event; and

storing the one or more parameters in association with the image.

2. The method of claim 1 , wherein determining the gesture indicative of the start of the food intake event comprises determining the gesture indicative of the start of the food intake event using one or more machine learning models.

3. The method of claim 2 , wherein the one or more machine learning models include one or more classifiers.

4. The method of claim 2 , wherein the method further comprises:

determining the start of the food intake event responsive to the confidence level being higher than a predetermined threshold.

5. The method of claim 1 , wherein determining the gesture indicative of the start of the food intake event includes comparing the sensor readings with a plurality of gesture patterns stored in a database.

6. The method of claim 1 , further comprising providing feedback to the user, wherein the feedback comprises periodic haptic feedback signals, sound alarms, display messages, notifications, or any combination thereof.

7. The method of claim 6 , wherein the feedback comprises information related to eating patterns or habits, a food item taken during the food intake event, a trigger for the eating patterns or habits, an environment where the food intake event happens, biometrics of the user, recommended portion sizes and/or food content, historical data, one or more tracked parameters, personalized dietary, or a combination thereof.

8. The method of claim 1 , wherein the one or more parameters associated with the food intake event include a pace of eating or drinking related to the food intake event, an amount consumed during the food intake event, or a combination thereof.

9. The method of claim 1 , further comprising estimating a duration of the food intake event, a bite count, a sip count, an eating pace, a drinking pace, or a combination thereof.

10. The method of claim 1 , wherein:

the electronic device comprises a camera, the camera comprising the image capture capability; and

obtaining the image related to the food intake event further comprises activating the image capture capability of the camera.

11. The method of claim 10 , further comprising:

enabling a projecting light source of the electronic device, in response to determining the start of the food intake event; and

projecting visible light from the projecting light source to indicate an area within view of the camera.

12. The method of claim 11 , further comprising:

controlling operation of the projecting light source to communicate image capturing information to the user of the electronic device.

13. The method of claim 12 , wherein the projecting light source is controlled to communicate that: the camera is within a proper distance range from an object of interest, a distance between the camera and the object of interest needs to be increased, or a distance between the camera and the object of interest needs to be decreased.

14. The method of claim 12 , wherein the projecting light source is controlled to communicate that: ambient light is unsuitable for obtaining the image with predetermined quality.

15. The method of claim 11 , further comprising:

controlling operation of the projecting light source to communicate dietary coaching information to the user of the electronic device.

16. The method of claim 1 , wherein:

obtaining the image related to the food intake event further comprises activating an image capture capability of a camera of a mobile device associated with the user for obtaining the image related to the food intake event.

17. The method of claim 1 , further comprising:

determining, from the sensor readings, an end of the food intake event; and

disabling an image capture capability configured for obtaining the image related to the food intake event.

18. The method of claim 1 , further comprising:

analyzing the image to identify food items, identify food content, identify or retrieve nutritional information, estimate portion size, identify or infer eating behaviors, identify or infer eating patterns, identify food categories, identify or infer pace of eating, identify or infer a pace of drinking, identify meal type, or estimate an amount of food consumed.

19. A system for sensing user activity, the system comprising:

one or more transceivers;

one or more memories; and

one or more processors communicatively coupled with the one or more transceivers and the one or more memories, wherein the one or more processors are configured to:

obtain sensor readings associated with movement of a body part of a user of an electronic device;

determine a gesture indicative of a start of a food intake event based on the sensor readings and on a confidence level associated with the gesture exceeding a threshold;

obtain an image related to the food intake event, the image captured using an image capture capability that is activated responsive to determining the gesture indicative of the start of the food intake event;

determine a sequence of gestures related to the food intake event based on the sensor readings;

determine, from the sequence of gestures, one or more parameters for the food intake event; and

store the one or more parameters in association with the image in the one or more memories.

20. The system of claim 19 , wherein the one or more processors are configured to determine the gesture indicative of the start of the food intake event using one or more machine learning models.

Assignments (4)

Continuity (5)

References Cited (276)

Cited By (1)

US 12,562,249