IP Library Granted Patent US 11,367,526
Granted Patent B2
US 11,367,526 · App. 16/403,453 · Granted Jun 21, 2022

Proactive patient guidance using augmented reality

Inventors: Chia-Hung Chiu (Pasadena, CA); Rebecca K. Gottlieb (Culver City, CA); Carol A. Jerome (Mission Hills, CA); Kenny J. Long (Simi Valley, CA)
Assignee: MEDTRONIC MINIMED, INC.
G16H40/67A61B90/36A61M5/1723G06T19/006G06V20/20G16H20/17G16H20/30G16H20/60G16H40/63A61B2090/365A61M2005/14208A61M2205/3553
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,367,526
App. No.
16/403,453
Granted
Jun 21, 2022
Kind
B2
Abstract

Medical devices and related augmented reality systems and methods are provided. A method of providing guidance to a patient using an electronic device having an imaging device associated therewith involves analyzing one or more images captured by the imaging device to identify image content indicative of a potential activity for the patient, determining, by a control system associated with the electronic device, one or more attributes for the potential activity, determining, by the control system, a predicted physiological response by the patient to the potential activity based at least in part on the one or more attributes, and providing, on a display associated with the electronic device, an augmented reality graphical user interface including a graphical indication influenced by the predicted physiological response.

Claims (54)

1. A method of providing guidance to a patient using an electronic device having an imaging device associated therewith, the method comprising:

analyzing one or more images captured by the imaging device to identify image content indicative of a meal for the patient;

determining, by a control system associated with the electronic device, one or more attributes for the meal;

determining, by the control system, a forecasted glucose value in the future likely to result from the meal based at least in part on the one or more attributes and one or more recent glucose measurement values for the patient by inputting the one or more attributes and the one or more recent glucose measurement values to a glucose forecasting model associated with the patient;

determining, by the control system, a recommended attribute for the meal based at least in part on the forecasted glucose value in the future likely to result from the meal and the one or more recent glucose measurement values using the glucose forecasting model associated with the patient;

automatically adjusting, by the control system, one or more closed-loop control parameters of an infusion device based at least in part on the recommended attribute for the meal to proactively adjust responsiveness of fluid delivery by a closed-loop operating mode of the infusion device to account for the image content, resulting in one or more adjusted closed-loop control parameters, wherein the infusion device autonomously delivers fluid to the patient in accordance with the one or more adjusted closed-loop control parameters; and thereafter:

analyzing one or more subsequent images captured by the imaging device to identify an actual attribute associated with the meal consumed by the patient;

adjusting the one or more adjusted closed-loop control parameters to account for a difference between the actual attribute and the recommended attribute based on analysis of the one or more subsequent images, wherein:

determining the recommended attribute comprises determining an amount of food that increases a time in range for the forecasted glucose value in the future or reduces a difference between the forecasted glucose value in the future and a reference glucose value; and

the difference between the actual attribute and the recommended attribute comprises a difference between an actual amount of the food that the patient has consumed and the amount of the food that increases the time in range for the forecasted glucose value in the future or reduces the difference between the forecasted glucose value in the future and the reference glucose value.

2. The method of claim 1 , wherein determining the one or more attributes comprises determining an estimated carbohydrate amount for the meal based at least in part on the one or more images.

3. The method of claim 2 , wherein determining the estimated carbohydrate amount comprises determining an estimated portion size based on the image content.

4. The method of claim 3 , wherein the determining the estimated carbohydrate amount comprises:

identifying a meal type associated with the meal based on the image content;

obtaining reference data associated with the meal type; and

determining the estimated carbohydrate amount based at least in part on the reference data and the estimated portion size.

5. The method of claim 1 , wherein determining the one or more attributes comprises:

identifying a meal type associated with the meal based on the image content; and

determining the one or more attributes based on the meal type.

6. The method of claim 1 , the image content comprising a menu of meal options, wherein the graphical indication comprises an overlay indicating a recommended meal from the menu based on forecasted glucose values for the patient to the meal options.

7. The method of claim 1 , wherein the recommended attribute comprises an optimal portion size.

8. The method of claim 1 , further comprising providing, on a display associated with the electronic device, an augmented reality graphical user interface including a graphical indication of the recommended attribute in visual association with the image content, wherein:

the augmented reality graphical user interface includes a second graphical indication of a delivery adjustment for the infusion device to account for a predicted postprandial glycemic response.

9. The method of claim 1 , wherein:

automatically adjusting the one or more closed-loop control parameters comprises adjusting the one or more closed-loop control parameters to increase responsiveness of fluid delivery by the infusion device to deviations between a measured glucose value and a target glucose value; and

adjusting the one or more adjusted closed-loop control parameters to account for the difference between the actual attribute and the recommended attribute comprises dynamically adjusting the one or more adjusted closed-loop control parameters to decrease the responsiveness of the fluid delivery by the infusion device.

10. The method of claim 1 , wherein automatically adjusting the one or more closed-loop control parameters comprises proactively increasing responsiveness of fluid delivery by the closed-loop operating mode of the infusion device that autonomously regulates a glucose level of the patient to account for the image content.

11. The method of claim 1 , wherein automatically adjusting the one or more closed-loop control parameters comprises proactively decreasing responsiveness of fluid delivery by the closed-loop operating mode of the infusion device that autonomously regulates a glucose level of the patient to account for the image content.

12. The method of claim 1 , wherein the infusion device autonomously delivers the fluid to the patient in accordance with the one or more adjusted closed-loop control parameters by generating dosage commands to reduce the difference between a current glucose measurement value and a target glucose value using the one or more adjusted closed-loop control parameters.

13. The method of claim 1 , wherein the infusion device includes the control system.

14. The method of claim 1 , wherein:

automatically adjusting the one or more closed-loop control parameters comprises automatically adjusting a time constant of the closed-loop operating mode based at least in part on the recommended attribute for the meal to proactively adjust responsiveness of fluid delivery by the closed-loop operating mode of the infusion device to account for the image content; and

adjusting the one or more adjusted closed-loop control parameters to account for the difference between the actual attribute and the recommended attribute comprises adjusting the time constant of the closed-loop operating mode to account for the difference between the actual attribute and the recommended attribute to counteract the automatically adjusting the time constant based at least in part on the recommended attribute.

15. The method of claim 1 , wherein:

automatically adjusting the one or more closed-loop control parameters comprises automatically adjusting a gain coefficient of the closed-loop operating mode based at least in part on the recommended attribute for the meal to proactively adjust responsiveness of fluid delivery by the closed-loop operating mode of the infusion device to account for the image content; and

adjusting the one or more adjusted closed-loop control parameters to account for the difference between the actual attribute and the recommended attribute comprises adjusting the gain coefficient of the closed-loop operating mode to account for the difference between the actual attribute and the recommended attribute to counteract the automatically adjusting the gain coefficient based at least in part on the recommended attribute.

16. The method of claim 1 , wherein:

automatically adjusting the one or more closed-loop control parameters comprises automatically adjusting a target glucose value of the closed-loop operating mode based at least in part on the recommended attribute for the meal to proactively adjust responsiveness of fluid delivery by the closed-loop operating mode of the infusion device to account for the image content; and

adjusting the one or more adjusted closed-loop control parameters to account for the difference between the actual attribute and the recommended attribute comprises adjusting the target glucose value of the closed-loop operating mode to account for the difference between the actual attribute and the recommended attribute to counteract the automatically adjusting the target glucose value based at least in part on the recommended attribute.

17. The method of claim 1 , wherein:

automatically adjusting the one or more closed-loop control parameters comprises automatically adjusting a basal rate setting of the closed-loop operating mode based at least in part on the recommended attribute for the meal to proactively adjust responsiveness of fluid delivery by the closed-loop operating mode of the infusion device to account for the image content; and

adjusting the one or more adjusted closed-loop control parameters to account for the difference between the actual attribute and the recommended attribute comprises adjusting the basal rate setting of the closed-loop operating mode to account for the difference between the actual attribute and the recommended attribute to counteract the automatically adjusting the basal rate setting based at least in part on the recommended attribute.

18. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to:

analyze one or more images captured by an imaging device to identify image content indicative of a meal for a patient;

determine one or more attributes for the potential activity meal;

determine a forecasted glucose value in the future likely to result from the meal based at least in part on the one or more attributes and one or more recent glucose measurement values for the patient by inputting the one or more attributes and the one or more recent glucose measurement values to a glucose forecasting model associated with the patient;

determine a recommended attribute for the meal based at least in part on the forecasted glucose value in the future likely to result from the meal and the one or more recent glucose measurement values using the glucose forecasting model associated with the patient;

automatically adjust one or more closed-loop control parameters of an infusion device based at least in part on the recommended attribute to account for the image content, resulting in one or more adjusted closed-loop control parameters, wherein: the one or more closed-loop control parameters include at least one of a basal rate setting, a time constant, a gain coefficient value, an insulin sensitivity factor, a carbohydrate ratio and an insulin limit; and

the infusion device is configured to autonomously deliver a fluid capable of influencing a glucose level to the patient in accordance with the one or more adjusted closed-loop control parameters; and thereafter:

analyze one or more subsequent images captured by the imaging device to identify an actual attribute associated with the meal consumed by the patient;

adjust the one or more adjusted closed-loop control parameters to account for a difference between the actual attribute and the recommended attribute based on analysis of the one or more subsequent images, wherein:

determining the recommended attribute comprises determining an amount of food that increases a time in range for the forecasted glucose value in the future or reduces a difference between the forecasted glucose value in the future and a reference glucose value; and

the difference between the actual attribute and the recommended attribute comprises a difference between an actual amount of the food that the patient has consumed and the amount of the food that increases the time in range for the forecasted glucose value in the future or reduces the difference between the forecasted glucose value in the future and the reference glucose value.

19. The computer-readable medium of claim 18 , wherein the recommended attribute comprises an optimal portion size to increase a time in range for the forecasted glucose value in the future or reduce a difference between the forecasted glucose value in the future and a reference glucose value.

Assignments (2)
SECURITY INTEREST Recorded Jan 16, 2026
From: MEDTRONIC MINIMED, INC.; COMPANION MEDICAL, INC.
To: CITIBANK, N.A.
Reel/Frame 074394/0237 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2019
From: CHIU, CHIA-HUNG; GOTTLIEB, REBECCA K.; JEROME, CAROL A.; LONG, KENNY J.
To: MEDTRONIC MINIMED, INC.
Reel/Frame 051298/0772 →