IP Library Granted Patent US 10,614,630
Granted Patent B2
US 10,614,630 · App. 16/428,275 · Granted Apr 7, 2020

Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions

Inventors: Nicole Elizabeth Samec (Fort Lauderdale, FL); Christopher M. Harrises (Nashua, NH); Mark Baerenrodt (Fort Lauderdale, FL); Stephen Vincent Mangiat (San Francisco, CA); Nastasja U. Robaina (Coconut Grove, FL); Adam Carl Wright (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
G06T19/006G02B27/017G02B27/0172G02B2027/0105G02B2027/0138G02B2027/0174G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,614,630
App. No.
16/428,275
Granted
Apr 7, 2020
Kind
B2
Abstract

In some embodiments, a display system comprising a head-mountable, augmented reality display is configured to perform a neurological analysis and to provide a perception aid based on an environmental trigger associated with the neurological condition. Performing the neurological analysis may include determining a reaction to a stimulus by receiving data from the one or more inwardly-directed sensors; and identifying a neurological condition associated with the reaction. In some embodiments, the perception aid may include a reminder, an alert, or virtual content that changes a property, e.g. a color, of a real object. The augmented reality display may be configured to display virtual content by outputting light with variable wavefront divergence, and to provide an accommodation-vergence mismatch of less than 0.5 diopters, including less than 0.25 diopters.

Claims (38)

1. An augmented reality display system comprising:

a head-mountable display configured to:

transmit light from an ambient environment to allow a view of the ambient environment; and

output light with different amounts of wavefront divergence to display virtual content on a plurality of depth planes;

one or more outwardly-directed sensors;

one or more processors; and

one or more computer storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

performing a neurological analysis by:

determining a reaction to a stimulus by receiving data from the one or more outwardly-directed sensors; and

identifying a neurological condition associated with the reaction.

2. The augmented reality display system of claim 1 , wherein the operations further comprise:

determining a presence of an environmental trigger; and

causing the display system to display a perception aid in response to the presence of the environmental trigger.

3. The augmented reality display system of claim 2 , wherein the perception aid is selected based on the identified neurological condition.

4. The augmented reality display system of claim 2 , wherein the perception aid is selected based on a user profile.

5. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors are configured to detect one or more of objects, stimuli, people, animals, and locations.

6. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise a camera.

7. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of an altimeter, a barometer, a chemical sensor, a humidity sensor, a temperature sensor, an external microphone, and a thermal imaging sensor.

8. The augmented reality display system of claim 1 , wherein identifying the neurological condition comprises generating a list of potential neurological conditions.

9. The augmented reality display system of claim 1 , wherein the operations further comprise:

automatically repeating the neurological analysis a plurality of times over a plurality of months,

wherein repeating the neurological analysis comprises updating the identified neurological condition.

10. The augmented reality display system of claim 1 , wherein the operations further comprise transmitting the identified neurological condition to a plurality of other display systems.

11. The augmented reality display system of claim 10 , wherein the operations comprise identifying the neurological condition based upon a norm determined from a population of users of the other display systems.

12. The augmented reality display system of claim 1 , wherein the display is configured to output virtual content with an accommodation-vergence mismatch of less than 0.25 diopters for each of the depth planes.

13. A method performed by a display system comprising one or more processors, one or more outwardly-directed sensors, and a head-mounted display, the method comprising:

performing a neurological analysis by:

determining a user reaction to a stimulus by collecting data from the one or more outwardly-directed sensors; and

identifying a neurological condition associated with the reaction.

14. The method of claim 13 , further comprising:

determining a presence of an environmental trigger; and

displaying a perception aid in response to the presence of the environmental trigger.

15. The method of claim 14 , further comprising selecting the perception aid based on one or more of the identified neurological condition, the reaction, or a user profile.

16. The method of claim 13 , further comprising automatically repeating the neurological analysis a plurality of times over a plurality of months and updating the identified neurological condition.

17. The method of claim 13 , wherein the stimulus comprises visual content, further comprising providing the stimulus via the head-mounted display.

18. The method of claim 13 , further comprising detecting one or more of objects, stimuli, people, animals, and locations with the outwardly-directed sensors.

19. The method of claim 13 , wherein the outwardly-directed sensors comprise a camera.

20. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of an altimeter, a barometer, a chemical sensor, a humidity sensor, a temperature sensor, an external microphone, and a thermal imaging sensor.

Assignments (10)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: SAMEC, NICOLE ELIZABETH; BAERENRODT, MARK; MANGIAT, STEPHEN V.
To: MAGIC LEAP, INC.
Reel/Frame 051745/0865 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: HARRISES, CHRISTOPHER M.; TECHNICAL SOLUTIONS, INC.
To: MAGIC LEAP, INC.
Reel/Frame 051745/0872 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: SAMEC, NICOLE ELIZABETH; BAERENRODT, MARK; MANGIAT, STEPHEN V.
To: MAGIC LEAP, INC.
Reel/Frame 051745/0875 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: HARRISES, CHRISTOPHER M.; TECHNICAL SOLUTIONS, INC.
To: MAGIC LEAP, INC.
Reel/Frame 051745/0885 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: SAMEC, NICOLE ELIZABETH; BAERENRODT, MARK; ROBAINA, NASTASJA U.; MANGIAT, STEPHEN V.
To: MAGIC LEAP, INC.
Reel/Frame 051745/0888 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: WRIGHT, ADAM CARL
To: MAGIC LEAP, INC.
Reel/Frame 051745/0900 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: HARRISES, CHRISTOPHER M.; TECHNICAL SOLUTIONS, INC.
To: MAGIC LEAP, INC.
Reel/Frame 051745/0795 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
Continuity (5)
Continuation 15627208 · Jun 19, 2017
Provisional Application 62440291 · Dec 29, 2016
Provisional Application 62366555 · Jul 25, 2016
Provisional Application 62352539 · Jun 20, 2016
Related Publication 20190287309A1 · Sep 19, 2019