Automatic control of wearable display device based on external conditions
Embodiments of a wearable device can include a head-mounted display (HMD) which can be configured to display virtual content. While the user is interacting with visual or audible virtual content, the user of the wearable may encounter a triggering event such as, for example, an emergency condition or an unsafe condition, detecting one or more triggering objects in an environment, or determining characteristics of the user's environment (e.g., home or office). Embodiments of the wearable device can automatically detect the triggering event and automatically control the HMD to deemphasize, block, or stop displaying the virtual content. The HMD may include a button that can be actuated by the user to manually deemphasize, block, or stop displaying the virtual content.
1. A wearable system configured to display virtual content in a mixed reality, augmented reality, or virtual reality environment, the wearable system comprising:
a display configured to present virtual content in a mixed reality, augmented reality, or virtual reality environment; and
a hardware processor programmed to:
receive images of a first environment of a user;
cause to be rendered by the display a plurality of virtual content items in the first environment of the user;
analyze the images using one or more object recognizers configured to recognize objects with machine learning algorithms;
detect, based at least partly on objects recognized by the one or more object recognizers, movement of the user from the first environment to a second environment;
in response to detection of the movement of the user from the first environment to the second environment:
cause to be rendered by the display a visual indication of the detected movement from the first environment to the second environment;
access content blocking rules associated with the second environment, wherein the content blocking rules comprise a blacklist indicating virtual content items that are available for muting;
determine, based on the content blocking rules associated with the second environment, one or more of the plurality of virtual content items that are available for muting in the second environment; and
mute the determined one or more virtual content items.
2. The wearable system of claim 1 , wherein to mute the one or more virtual content items, the hardware processor is programmed to at least:
dim light output by the display;
turn off display of one or more of the virtual content items;
reduce a size of one or more of the virtual content items;
increase a transparency of one or more of the virtual content items; or
change a position of one or more of the virtual content items as rendered by the display.
3. The wearable system of claim 1 , wherein the hardware processor is further programmed to:
detect a termination condition of said muting the determined one or more virtual content items; and
discontinue muting the determined one or more virtual content items in response to detecting the termination condition.
4. The wearable system of claim 3 , wherein to detect the termination condition, the wearable system is programmed to
determine whether the user has left the second environment where said muting the determined one or more virtual content items occurs.
5. The wearable system of claim 1 , wherein the hardware processor is further programmed to mute a speaker of the wearable system in response to the detected movement from the first environment to the second environment.
6. The wearable system of claim 1 , wherein the hardware processor is further programmed to, in response to the detected movement from the first environment to the second environment, provide an alert message, wherein the alert message indicates to the user at least one of: (1) that the wearable system will be automatically muted in a time period unless the user performs a cancellation action or (2) that the wearable system will not be muted unless the user performs a confirmation action.
7. The wearable system of claim 6 , wherein the cancellation action or the confirmation action comprise at least one of: actuating a reality button, actuating a virtual user interface element rendered by the display, actuating a user input device, or detecting a cancellation or confirmation pose of the user.
8. The wearable system of claim 1 , wherein the machine learning algorithms comprise one or more of a deep neural network or a convolutional neural network.
9. The wearable system of claim 1 , wherein the determined one or more virtual content items include at least one virtual content item that is not associated with the object that is at least partly responsible for detecting the movement of the user from the first environment to the second environment.
10. The wearable system of claim 1 , wherein virtual content items that are available for muting are further determined based on potential perceptual confusion to the user associated with the respective virtual content items.
11. The wearable system of claim 1 , wherein the content blocking rules further comprise a whitelist indicating virtual content items that are not available for muting.
12. A method for displaying virtual content in a mixed reality or virtual reality environment, the method comprising:
under control of a hardware processor:
receiving images of a first environment of a user;
causing to be rendered by a display, a plurality of virtual content items in the first environment of the user;
analyzing the image using one or more object recognizers configured to recognize objects;
detecting, based at least partly on objects recognized by the one or more object recognizers, movement of the user from the first environment to a second environment;
in response to detection of the movement of the user from the first environment to the second environment:
causing to be rendered by the display of a head mounted display a visual indication of the detected movement from the first environment to the second environment;
accessing content blocking rules associated with the second environment, wherein the content blocking rules comprise a blacklist indicating virtual content items that are available for muting;
determining, based on the content blocking rules associated with the second environment, one or more of the plurality of virtual content items that are available for muting in the second environment; and
muting the determined one or more virtual content items.
13. The method of claim 12 , wherein muting the one or more virtual content items comprises at least one of:
blocking one or more of the virtual content items from being rendered;
disabling interactions with one or more of the virtual content items;
turning off display of one or more of the virtual content items;
reducing a size of one or more of the virtual content items;
increasing a transparency of one or more of the virtual content items; or
changing a position of one or more of the virtual content items as rendered by the display.
14. The method of claim 12 , further comprising:
detecting a termination condition of said muting the determined one or more virtual content items; and
discontinuing muting of the determined one or more virtual content items in response to detection of the termination condition.
15. The method of claim 14 , wherein to detect the termination condition, the wearable system is programmed to
determine whether the user has left the second environment where said muting the determined one or more virtual content items occurs.
16. The method of claim 12 , wherein recognizing the objects is performed by a neural network.
17. The method of claim 12 , wherein the determined one or more virtual content items include at least one virtual content item that is not associated with the object that is at least partly responsible for detecting the movement of the user from the first environment to the second environment.