IP Library Granted Patent US 11,071,515
Granted Patent B2
US 11,071,515 · App. 17/021,922 · Granted Jul 27, 2021

Augmented reality systems and methods for user health analysis

Inventors: Nicole Elizabeth Samec (Fort Lauderdale, FL); Mark Baerenrodt (Millbrae, CA); Nastasja U. Robaina (Coconut Grove, FL); Charlotte Dorothea Wilhelmina Vinkers (Fort Lauderdale, FL); Christopher M. Harrises (Nashua, NH); Nicholas Atkinson Kramer (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
A61B7/04A61B3/113A61B5/0077A61B5/01A61B5/021A61B5/024A61B5/14532A61B5/6898G02B27/017G02B27/0172G06F3/013A61B5/0066A61B5/0095A61B5/082A61B5/0816A61B5/1116A61B5/1123A61B5/1128A61B5/318A61B5/369A61B5/389A61B5/441A61B5/744A61B2562/0219G02B6/009G02B6/0076G02B2027/014G02B2027/0112G02B2027/0125G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,071,515
App. No.
17/021,922
Granted
Jul 27, 2021
Kind
B2
Abstract

Augmented reality systems and methods for user health analysis. Methods for user health analysis may include collecting data for an initial prediction model and continuing to collect additional data based on one or more data criteria. The methods may further include updating the initial prediction model based on the additional data to produce a revised prediction model or causing an intervention to occur based on the additional data. The data may be collected by a display system including one or more sensors configured to collect user-specific data and a display device configured to present virtual content to a user. The display device may be configured to output light with variable wavefront divergence.

Claims (63)

1. A display system comprising:

a display device configured to present virtual content to a user, wherein the display device is configured to output light with variable wavefront divergence;

one or more sensors attached to the display device, the one or more sensors comprising:

a user sensor configured to collect behavioral information characterizing behavior of the user; and

an environmental sensor configured to collect environmental data;

one or more processors; and

one or more computer storage media storing instructions that, when executed by the system, cause the system to perform operations comprising:

collecting the behavioral information and the environmental data from the one or more sensors;

correlating the environmental data with the behavioral information;

applying the behavioral information and the environmental data to an initial prediction model;

continuing to collect additional behavioral information and additional environmental data from the one or more sensors; and

updating the initial prediction model based at least in part on the additional behavioral information and the additional environmental data to produce a revised prediction model.

2. The display system of claim 1 , wherein the display device is configured to output images with an accommodation-vergence mismatch less than about 0.25 diopters.

3. The display system of claim 1 , wherein applying the behavioral information and the environmental data comprises determining an outcome of the prediction model.

4. The display system of claim 1 , wherein applying the behavioral information and the environmental data comprises determining that a criterion or set of criteria for the data are satisfied before determining an outcome of the prediction model.

5. The display system of claim 1 , wherein the display device is configured to continue to collect additional behavioral information from the user sensor over a period of at least one month.

6. The display system of claim 5 , wherein the display device is configured to continue to collect additional behavioral information from the user sensor for durations of about 3 hours or more a day over the period.

7. The display system of claim 1 , wherein an amount of the additional behavioral information to be collected is determined based on one or more statistical power analyses.

8. The display system of claim 1 , wherein updating the initial prediction model comprises modifying at least one of a measured variable within the behavioral information, a number of behavioral information points to be collected, a time period for collecting the additional behavioral information, or a weighting of one or more measured variables.

9. The display system of claim 1 , wherein updating the initial prediction model comprises changing a quantity of data to be collected, and wherein the instructions further cause the system to perform operations comprising continuing to collect additional behavioral information from the user sensor in accordance with the revised prediction model.

10. The display system of claim 1 , wherein the instructions further cause the system to perform operations comprising displaying virtual content to the user based at least in part on the revised prediction model or on the additional behavioral information.

11. A method of conducting a user health analysis, the method comprising:

collecting, from a user sensor of an augmented reality display device configured to output light with variable wavefront divergence, behavioral information characterizing behavior of a user;

collecting environmental data from an environmental sensor of the augmented reality display device;

correlating the environmental data with the behavioral information;

applying the behavioral information and the environmental data to an initial prediction model;

continuing to collect additional behavioral information and additional environmental data from the user sensor and the environmental sensor; and

updating the initial prediction model based at least in part on the additional behavioral information and the additional environmental data to produce a revised prediction model.

12. The method of claim 11 , further comprising displaying virtual content on the display device with an accommodation-vergence mismatch of less than about 0.25 diopters.

13. The method of claim 12 , wherein the accommodation-vergence mismatch is less than about 0.33 diopters.

14. The method of claim 11 , wherein continuing to collect additional behavioral information and additional environmental data comprises collecting additional behavioral information from the user sensor over a period of at least one month.

15. The method of claim 14 , wherein continuing to collect additional behavioral information and additional environmental data comprises collecting additional behavioral information from the user sensor for durations of about 3 hours or more a day over the period.

16. The method of claim 11 , wherein an amount of the additional behavioral information to be collected is determined based on one or more statistical power analyses.

17. The method of claim 11 , wherein updating the initial prediction model comprises modifying at least one of a measured variable within the behavioral information, a number of behavioral information points to be collected, a time period for collecting the additional behavioral information, or a weighting of one or more measured variables.

18. The method of claim 11 , wherein updating the initial prediction model comprises changing a quantity of data to be collected, the method further comprising continuing to collect additional behavioral information from the user sensor in accordance with the revised prediction model.

19. The method of claim 11 , further comprising displaying virtual content to the user based at least in part on the revised prediction model or on the additional behavioral information.

20. A display system comprising:

a display device configured to present virtual content to a user, wherein the display device is configured to output light with variable wavefront divergence;

one or more sensors attached to the display device, the one or more sensors comprising:

a user sensor configured to collect behavioral information characterizing behavior of the user; and

an environmental sensor configured to collect environmental data;

one or more processors; and

one or more computer storage media storing instructions that, when executed by the system, cause the system to perform operations comprising:

collecting the behavioral information and the environmental data from the one or more sensors from the one or more sensors;

correlating the environmental data with the behavioral information;

applying the behavioral information and the environmental data to an initial prediction model;

continuing to collect additional behavioral information and additional environmental data from the one or more sensors; and

causing an intervention to occur based at least in part on the additional behavioral information and the additional environmental data.

21. The display system of claim 20 , wherein the display device is configured to output images with an accommodation-vergence mismatch less than about 0.25 diopters.

22. The display system of claim 20 , wherein the display device is configured to continue to collect additional behavioral information from the user sensor over a period of at least one month.

23. The display system of claim 22 , wherein the display device is configured to continue to collect additional behavioral information from the user sensor for durations of about 3 hours or more a day over the period.

24. The display system of claim 20 , wherein the intervention is a treatment for a condition indicated by an outcome of the prediction model.

25. A method of conducting a user health analysis, the method comprising:

collecting, from a user sensor of an augmented reality display device configured to output light with variable wavefront divergence, behavioral information characterizing behavior of a user;

collecting environmental data from an environmental sensor of the augmented reality display device;

correlating the environmental data with the behavioral information;

applying the behavioral information and the environmental data to an initial prediction model;

continuing to collect additional behavioral information and additional environmental data from the user sensor and the environmental sensor; and

causing an intervention to occur based at least in part on the additional behavioral information and the additional environmental data.

26. The method of claim 25 , further comprising displaying virtual content on the display device with an accommodation-vergence mismatch of less than about 0.25 diopters.

27. The method of claim 25 , wherein continuing to collect additional behavioral information and additional environmental data comprises collecting additional behavioral information from the user sensor over a period of at least one month.

28. The method of claim 27 , wherein continuing to collect additional behavioral information and additional environmental data comprises collecting additional behavioral information from the user sensor for durations of about 3 hours or more a day over the period.

29. The method of claim 25 , wherein the intervention is a treatment for a condition indicated by an outcome of the prediction model.

Assignments (3)
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2020
From: HARRISES, CHRISTOPHER M.; TECHNICAL SOLUTIONS, INC.
To: MAGIC LEAP, INC.
Reel/Frame 053907/0627 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2020
From: SAMEC, NICOLE ELIZABETH; BAERENRODT, MARK; ROBAINA, NASTASJA U.; KRAMER, NICHOLAS ATKINSON; VINKERS, CHARLOTTE DOROTHEA WILHELMINA
To: MAGIC LEAP, INC.
Reel/Frame 053907/0679 →