Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions
View Patent ↗In some embodiments, a display system comprising a head-mountable, augmented reality display is configured to perform a neurological analysis and to provide a perception aid based on an environmental trigger associated with the neurological condition. Performing the neurological analysis may include determining a reaction to a stimulus by receiving data from the one or more inwardly-directed sensors; and identifying a neurological condition associated with the reaction. In some embodiments, the perception aid may include a reminder, an alert, or virtual content that changes a property, e.g. a color, of a real object. The augmented reality display may be configured to display virtual content by outputting light with variable wavefront divergence, and to provide an accommodation-vergence mismatch of less than 0.5 diopters, including less than 0.25 diopters.
1. An augmented reality display system comprising:
a head-mountable display configured to:
transmit light from an ambient environment to allow a view of the ambient environment; and
output light with different amounts of wavefront divergence to display virtual content on a plurality of depth planes;
one or more outwardly-directed sensors;
one or more processors; and
one or more computer storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
providing a therapy to a wearer of the head-mountable display by:
monitoring an ambient environment by receiving data from the one or more outwardly-directed sensors;
detecting the presence of a stimulus associated with an identified neurological condition of the wearer based on the data received from the one or more outwardly-directed sensors; and
providing a perception aid associated with the identified neurological condition based on the detected presence of the stimulus.
2. The augmented reality display system of claim 1 , wherein the perception aid comprises virtual content displayed in response to the presence of the environmental trigger.
3. The augmented reality display system of claim 1 , wherein the neurological condition is part of a user profile corresponding to the wearer, wherein the perception aid is selected based at least in part on the user profile.
4. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors are configured to detect one or more of objects, stimuli, people, animals, and locations.
5. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise a camera.
6. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of an altimeter and a barometer.
7. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of a chemical sensor, a humidity sensor, and a temperature sensor.
8. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of an external microphone and a thermal imaging sensor.
9. The augmented reality display system of claim 1 , wherein the operations further comprise:
monitoring a status of the identified neurological condition on a daily basis; and
automatically repeating the therapy in response to detected stimuli a plurality of times,
wherein automatically repeating the therapy comprises updating the therapy based on the status of the identified neurological condition.
10. The augmented reality display system of claim 1 , wherein the operations further comprise transmitting an indication of the detection of the presence of the stimulus to a plurality of other display systems.
11. The augmented reality display system of claim 1 , wherein the operations further comprise providing an alert to the wearer that the perception aid is being provided.
12. The augmented reality display system of claim 1 , wherein the display is configured to output virtual content with an accommodation-vergence mismatch of less than 0.25 diopters for each of the depth planes.
13. A method performed by a display system comprising one or more processors, one or more outwardly-directed sensors, and a head-mounted display, the method comprising:
providing a therapy by:
monitoring an ambient environment around a user by collecting data from the one or more outwardly-directed sensors;
detecting the presence of a stimulus associated with an identified neurological condition of the user based on monitoring the data collected from the one or more outwardly-directed sensors; and
providing a perception aid associated with the identified neurological condition based on the detected presence of the stimulus.
14. The method of claim 13 , wherein the perception aid comprises virtual content displayed in response to the presence of the environmental trigger.
15. The method of claim 13 , further comprising automatically repeating the therapy a plurality of times on a daily basis and updating the therapy based on monitoring a status of the identified neurological condition.
16. The method of claim 13 , wherein providing the perception aid comprises displaying visual content to the user via the head-mounted display.
17. The method of claim 13 , wherein detecting the presence of the stimulus comprises detecting one or more of objects, people, and animals with the outwardly-directed sensors.
18. The method of claim 13 , wherein detecting the presence of the stimulus comprises detecting one or more environmental conditions with the outwardly-directed sensors.
19. The method of claim 13 , wherein detecting the presence of the stimulus comprises detecting a location with the outwardly-directed sensors.
20. The method of claim 13 , wherein the outwardly-directed sensors comprise a camera.
21. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of an altimeter and a barometer.
22. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of a chemical sensor, a humidity sensor, and a temperature sensor.
23. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of an external microphone and a thermal imaging sensor.