Directional augmented reality warning system
A head mounted device (HMD) has a transparent display. The HMD detects an event external to the HMD and determines a location of the event relative to the location of the HMD. The HMD generates augmented reality (AR) content identifying the event and a direction of the location of the event relative to the location of the HMD and displays the AR content in the transparent display.
1. A head mounted device (HMD) comprising:
a transparent display;
one or more hardware processors comprising an event detection application, the event detection application being configured to perform operations comprising:
detecting an event external to the HMD;
determining a location of the event relative to a location of the HMD;
generating augmented reality (AR) content identifying the event and a direction of the location of the event relative to the location of the HMD;
displaying the AR content in the transparent display;
determining a task-based context of the HMD based on a task being performed by a user of the HMD;
determining an ambient-based context of the HMD based on audio data produced by an array of microphones;
detecting a first notification configured to be displayed in the transparent display of the HMD;
intercepting the first notification in response to detecting the first notification;
generating a second notification based on a priority level of the first notification, the task-based context, and the ambient-based context, the second notification comprising a combination of an audio notification and a visual notification, the visual notification including an augmented reality (AR) content;
replacing the first notification with the second notification; and
providing the second notification at the HMD.
2. The HMD of claim 1 , further comprising:
an array of microphones; and
wherein the operations further comprise:
detecting the event using audio data from the array of microphones;
identifying the event based on the audio data; and
using adaptive beamforming on the audio data to determine the location of the event relative to the HMD.
3. The HMD of claim 1 , wherein the operations further comprise:
determining a distance between the location of the event and the location of the HMD; and
increasing a size of the AR content in response to determining that the distance between the location of the event and the location of the HMD has decreased.
4. The HMD of claim 3 , wherein the operations further comprise:
generating an audible notification at the HMD, the audible notification having a frequency based on the distance between the location of the event and the location of the HMD.
5. The HMD of claim 3 , wherein the operations further comprise:
receiving first location data from a first device, the first location data identifying the location of the event relative to the first device;
receiving second location data from a second device, the second location data identifying the location of the event relative to the second device;
determining a position of the event based on the first and second location data; and
adjusting a representation of the distance between the location of the event and the location of the HMD based on the position of the event.
6. The HMD of claim 1 , wherein the detecting of the event further comprises:
receiving a notification of the event from a server, the notification identifying a type of event and further AR content identifying the type of event and an escape route based on the type of event, the escape route illustrating a path away from the location of the event.
7. The HMD of claim 1 , wherein the detecting of the event further comprises:
receiving a notification of a first event from a first device, the notification identifying a first type of event;
receiving a notification of a second event from a second device, the notification identifying a second type of event;
determining that the first type of event and second type of event are the same as a type of event detected at the HMD;
generating AR content based on the detected type of event, the AR content identifying a route; and
providing the AR content to the first and second devices in response to determining that the first type of event and second type of event are the same as the type of event detected at the HMD.
8. The HMD of claim 1 , wherein the operations further comprise:
accessing a floorplan corresponding to a location of the HMD,
wherein the AR content further comprises an escape route based on the floorplan, the route corresponding to the event and the location of the event.
9. The HMD of claim 8 , wherein the operations further comprise:
increasing an audio level or a frequency of the audio notification based on a distance between the location of the HMD and the location of the event.
10. A method comprising:
detecting an event external to a head-mounted device (HMD);
determining a location of the event relative to a location of the HMD;
generating augmented reality (AR) content identifying the event and a direction of the location of the event relative to the location of the HMD;
displaying the AR content in a transparent display of the HMD;
determining a task-based context of the HMD based on a task being performed by a user of the HMD;
determining an ambient-based context of the HMD based on audio data produced by an array of microphones;
detecting a first notification configured to be displayed in the transparent display of the HMD;
intercepting the first notification in response to detecting the first notification;
generating a second notification based on a priority level of the first notification, the task-based context, and the ambient-based context, the second notification comprising a combination of an audio notification and a visual notification, the visual notification including an augmented reality (AR) content;
replacing the first notification with the second notification; and
providing the second notification at the HMD.
11. The method of claim 10 , further comprising:
detecting the event using audio data from an array of microphones at the HMD;
identifying the event based on the audio data; and
using adaptive beamforming on the audio data to determine the location of the event relative to the HMD.
12. The method of claim 10 , further comprising:
determining a distance between the location of the event and the location of the HMD; and
increasing a size of the AR content in response to determining that the distance between the location of the event and the location of the HMD has decreased.
13. The method of claim 12 , further comprising:
generating an audible notification at the HMD, the audible notification having a frequency based on the distance between the location of the event and the location of the HMD.
14. The method of claim 12 , further comprising:
receiving first location data from a first device, the location data identifying the location of the event relative to the first device;
receiving second location data from a second device, the location data identifying the location of the event relative to the second device;
determining a position of the event based on the first and second location data; and
adjusting a representation of the distance between the location of the event and the location of the HMD based on the position of the event.
15. The method of claim 10 , wherein detecting the event further comprises:
receiving a notification of the event from a server, the notification identifying a type of event and AR content identifying the type of event and an escape route based on the type of event, the escape route illustrating a path away from the location of the event.
16. The method of claim 10 , wherein detecting the event further comprises:
receiving a notification of a first event from a first device, the notification identifying a first type of event;
receiving a notification of a second event from a second device, the notification identifying a second type of event;
determining that the first type of event and second type of event are the same as a type of event detected at the HMD;
generating AR content based on the detected type of event, the AR content identifying a route; and
providing the AR content to the first and second devices in response to determining that the first type of event and second type of event are the same as the type of event detected at the HMD.
17. The method of claim 10 , further comprising:
accessing a floorplan corresponding to a location of the HMD,
wherein the AR content further comprises an escape route based on the floorplan, the route corresponding to the event and the location of the event.
18. The method of claim 17 , further comprising:
increasing an audio level or a frequency of the audio notification based on a distance between the location of the HMD and the location of the event.
19. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
detecting an event external to a head-mounted device (HMD);
determining a location of the event relative to a location of the HMD;
generating augmented reality (AR) content identifying the event and a direction of the location of the event relative to the location of the HMD;
displaying the AR content in a transparent display of the HMD;
determining a task-based context of the HMD based on a task being performed by a user of the HMD;
determining an ambient-based context of the HMD based on audio data produced by an array of microphones;
detecting a first notification configured to be displayed in the transparent display of the HMD;
intercepting the first notification in response to detecting the first notification;
generating a second notification based on a priority level of the first notification, the task-based context, and the ambient-based context, the second notification comprising a combination of an audio notification and a visual notification, the visual notification including an augmented reality (AR) content;
replacing the first notification with the second notification; and
providing the second notification at the HMD.