System for assisted operator safety using an HMD
A system and method for providing assisted safety to an operator of a vehicle using a head-mounted display that provides displayed content and a see-through view of a surrounding environment, includes determining whether the operator is looking through the windshield of the vehicle or is not looking through the windshield, if the user is looking through the windshield, preventing displayed content from being provided within a display field of view of the head-mounted display, thereby providing an unencumbered see-through view of the surrounding environment, if the user is not looking through the windshield, providing displayed content for viewing by the user within the display field of view, and if important information relating to the safety of the vehicle is detected by a system associated with the vehicle while the user is looking not looking through the windshield, interrupting the displayed content and providing an alert to the operator.
1. A method of selectively presenting information to a user of a wearable head device comprising a see-through display and one or more sensors, the user having a field of view comprising the see-through display, the method comprising:
determining whether the user is in a vehicle;
in accordance with a determination that the user is in the vehicle, determining whether a gaze direction of the user is away from a window of the vehicle, the window in front of the user with respect to a forward movement direction of the vehicle;
in accordance with one or more of a determination that the user is not in the vehicle and a determination that the user's gaze direction is away from the window:
determining, via the one or more sensors, a view target of the user;
selecting a first content associated with the view target; and
presenting the first content via the see-through display; and
in accordance with a determination that the user is in the vehicle and further in accordance with a determination that the user's gaze direction is not away from the window, forgoing presenting the first content via the see-through display.
2. The method of claim 1 , wherein whether the user's gaze direction is away from the window is determined based on a difference between an orientation of the wearable head device and the forward movement direction of the vehicle.
3. The method of claim 2 , wherein:
the one or more sensors comprises a camera,
the method further comprises determining an identity of a target of the camera, and
the orientation of the wearable head device is determined based on the identity.
4. The method of claim 3 , wherein the target comprises an object inside the vehicle.
5. The method of claim 4 , wherein the object comprises one or more of a windshield, a steering wheel, a rear view mirror, a door pillar, a side window, an audio system, and a side mirror.
6. The method of claim 3 , wherein the target comprises a target point.
7. The method of claim 1 , further comprising:
in accordance with a determination that the user is in the vehicle and further in accordance with a determination that the user's gaze direction is not away from the window, concurrently with forgoing presenting the first content via the see-through display, presenting second content via the see-through display, wherein the second content comprises safety information.
8. The method of claim 1 , wherein the window comprises a windshield.
9. The method of claim 1 , wherein determining whether the user's gaze direction is away from the window comprises determining whether the user's field of view comprises a view of the portion of the window reflected in a mirror of the vehicle.
10. The method of claim 1 , wherein the view target comprises a mirror and the first content comprises an output of a backup camera.
11. The method of claim 1 , wherein the view target comprises a dashboard and the first content comprises motion data.
12. The method of claim 1 , wherein the view target comprises a center console and the first content comprises navigational information.
13. The method of claim 1 , wherein the wearable head device is in communication with a monitoring system of the vehicle and the first content comprises vehicle maintenance information received at the wearable head device from the monitoring system.
14. A wearable head device comprising:
a see-through display;
one or more sensors; and
one or more processors configured to perform a method comprising:
determining whether a user of the wearable head device, the user having a field of view comprising the see-through display, is in a vehicle;
in accordance with a determination that the user is in the vehicle, determining whether a gaze direction of the user is away from a window of the vehicle, the window in front of the user with respect to a forward movement direction of the vehicle;
in accordance with one or more of a determination that the user is not in the vehicle and a determination that the user's gaze direction is away from the window:
determining, via the one or more sensors, a view target of the user;
selecting a first content associated with the view target; and
presenting the first content via the see-through display; and
in accordance with a determination that the user is in the vehicle and further in accordance with a determination that the user's gaze direction is not away from the window, forgoing presenting the first content via the see-through display.
15. The wearable head device of claim 14 , wherein whether the user's gaze direction is away from the window is determined based on a difference between an orientation of the wearable head device and the forward movement direction of the vehicle.
16. The wearable head device of claim 15 , wherein:
the one or more sensors comprises a camera,
the method further comprises determining an identity of a target of the camera, and the orientation of the wearable head device is determined based on the identity.
17. The wearable head device of claim 16 , wherein the target comprises an object inside the vehicle.
18. The wearable head device of claim 17 , wherein the object comprises one or more of a windshield, a steering wheel, a rear view mirror, a door pillar, a side window, an audio system, and a side mirror.
19. The wearable head device of claim 16 , wherein the target comprises a target point.
20. The wearable head device of claim 14 , wherein the method further comprises:
in accordance with a determination that the user is in the vehicle and further in accordance with a determination that the user's gaze direction is not away from the window, concurrently with forgoing presenting the first content via the see-through display, presenting second content via the see-through display, wherein the second content comprises safety information.
21. The wearable head device of claim 14 , wherein the window comprises a windshield.
22. The wearable head device of claim 14 , wherein determining whether the user's gaze direction is away from the window comprises determining whether the user's field of view comprises a view of the portion of the window reflected in a mirror of the vehicle.
23. The wearable head device of claim 14 , wherein the view target comprises a mirror and the first content comprises an output of a backup camera.
24. The wearable head device of claim 14 , wherein the view target comprises a dashboard and the first content comprises motion data.
25. The wearable head device of claim 14 , wherein the view target comprises a center console and the first content comprises navigational information.
26. The wearable head device of claim 14 , wherein the wearable head device is in communication with a monitoring system of the vehicle and the first content comprises vehicle maintenance information received at the wearable head device from the monitoring system.
27. A method of selectively presenting information to a user of a wearable head device comprising a see-through display and one or more sensors, the user having a field of view comprising the see-through display, the method comprising:
determining whether the user is in a vehicle;
in accordance with a determination that the user is in the vehicle, determining whether a gaze direction of the user is away from a window of the vehicle and through the see-through display, the window in front of the user with respect to a forward movement direction of the vehicle;
in accordance with one or more of a determination that the user is not in the vehicle and a determination that the user's gaze direction is away from the window and through the see-through display:
determining, via the one or more sensors, a view target of the user;
selecting a first content associated with the view target; and
presenting the first content via the see-through display; and
in accordance with a determination that the user is in the vehicle and further in accordance with a determination that the user's gaze direction is not away from the window and through the see-through display, forgoing presenting the first content via the see-through display.
28. A wearable head device comprising:
a see-through display;
one or more sensors; and
one or more processors configured to perform a method comprising:
determining whether a user of the wearable head device, the user having a field of view comprising the see-through display, is in a vehicle;
in accordance with a determination that the user is in the vehicle, determining whether a gaze direction of the user is away from a window of the vehicle and through the see-through display, the window in front of the user with respect to a forward movement direction of the vehicle;
in accordance with one or more of a determination that the user is not in the vehicle and a determination that the user's gaze direction is away from the window and through the see-through display:
determining, via the one or more sensors, a view target of the user;
selecting a first content associated with the view target; and
presenting the first content via the see-through display; and
in accordance with a determination that the user is in the vehicle and further in accordance with a determination that the user's gaze direction is not away from the window and through the see-through display, forgoing presenting the first content via the see-through display.