Systems and methods for modifying a user interface based on eye focus
Disclosed is a computing system and associated methods that use changes in eye focus or the depth at which a user is looking to modify a user interface. The computing system presents a three-dimensional (“3D”) environment with different user interface (“UI”) elements that are positioned in a foreground or near plane of the 3D environment and that partially or wholly obscure a background or far plane of the 3D environment. The computing system detects a change in user eye focus from the foreground to the background by using a sensor to track changes to the pupil or the amount of light reflecting off the user's eye. The computing system produces an unobstructed view to all or part of the background by adjusting positioning, opacity, or other properties of the UI elements in the foreground in response to detecting the change in the user eye focus.
1. A method comprising:
presenting a three-dimensional (“3D”) environment comprising one or more user interface (“UP”) elements that are positioned in a foreground of the 3D environment and that partially or wholly obscure a background of the 3D environment;
determining that a user eye focus is focused at a first depth corresponding to the foreground of the 3D environment;
retaining positions of the one or more UI elements in the foreground that partially or wholly obscure the background in response to determining that the user eye focus is focused at the first depth;
detecting a change in the user eye focus from the foreground to the background; and
producing an unobstructed view to all or part of the background by adjusting the one or more UI elements in the foreground in response to detecting the change in the user eye focus.
2. The method of claim 1 , wherein detecting the change in the user eye focus comprises:
determining that the user eye focus has shifted from the first depth to a second depth corresponding to the background of the 3D environment.
3. The method of claim 1 , wherein detecting the change comprises:
measuring a change to a pupil with a sensor.
4. The method of claim 1 , wherein detecting the change comprises:
measuring a change in an amount of light being reflected off a user's eye with a sensor.
5. The method of claim 1 , wherein producing the unobstructed view comprises:
increasing a transparency of the one or more UI elements.
6. The method of claim 1 , wherein producing the unobstructed view comprises:
moving the one or more UI elements to a display periphery.
7. The method of claim 1 , wherein producing the unobstructed view comprises:
minimizing the one or more UI elements.
8. The method of claim 1 further comprising:
detecting a second change in the user eye focus from the background to the foreground; and
removing said adjusting of the one or more UI elements, wherein said removing comprises returning the one or more UI elements to positions in the foreground prior to said adjusting and to visible properties specified for the one or more UI elements prior to said adjusting.
9. The method of claim 1 further comprising:
tracking a depth at which the one or more UI elements are positioned in the 3D environment;
determining that the one or more UI elements are positioned in the foreground of the 3D environment based on said tracking of the depth; and
issuing a command that adjusts a positioning or opacity of the one or more UI elements in response to determining that the one or more UI elements are positioned in the foreground and the change in the user eye focus from the foreground to the background.
10. A computing system comprising:
one or more hardware processors configured to:
present a three-dimensional (“3D”) environment comprising one or more user interface (“UP”) elements that are positioned in a foreground of the 3D environment and that partially or wholly obscure a background of the 3D environment;
determine that a user eye focus is focused at a first depth corresponding to the foreground of the 3D environment;
retain positions of the one or more UI elements in the foreground that partially or wholly obscure the background in response to determining that the user eye focus is focused at the first depth;
detect a change in the user eye focus from the foreground to the background; and
produce an unobstructed view to all or part of the background by adjusting the one or more UI elements in the foreground in response to detecting the change in the user eye focus.
11. The computing system of claim 10 further comprising:
an eye focus tracking sensor that is directed in a direction of a user's eye, wherein the eye focus tracking sensor determines the user eye focus based on one or more of a change to a pupil of the user's eye or a change in an amount of light being reflected off the user's eye.
12. The computing system of claim 11 , wherein the computing system is one of a virtual reality, mixed reality, or augmented reality headset.
13. The computing system of claim 10 , wherein detecting the change in the user eye focus comprises:
determining that the user eye focus has shifted from the first depth to a second depth corresponding to the background of the 3D environment.
14. The computing system of claim 10 , wherein producing the unobstructed view comprises:
increasing a transparency of the one or more UI elements.
15. The computing system of claim 10 , wherein producing the unobstructed view comprises:
moving the one or more UI elements to a display periphery.
16. The computing system of claim 10 , wherein producing the unobstructed view comprises:
minimizing the one or more UI elements.
17. The computing system of claim 10 , wherein the one or more hardware processors are further configured to:
detect a second change in the user eye focus from the background to the foreground; and
remove said adjusting of the one or more UI elements, wherein said removing comprises returning the one or more UI elements to positions in the foreground prior to said adjusting and to visible properties specified for the one or more UI elements prior to said adjusting.
18. A method comprising:
presenting a three-dimensional (“3D”) environment comprising one or more user interface (“UP”) elements that are positioned in a foreground of the 3D environment and that partially or wholly obscure a background of the 3D environment;
detecting a first change in a user eye focus from the foreground to the background;
producing an unobstructed view to all or part of the background by adjusting the one or more UI elements in the foreground in response to detecting the change in the user eye focus;
detecting a second change in the user eye focus from the background to the foreground; and
removing said adjusting of the one or more UI elements, wherein said removing comprises returning the one or more UI elements to positions in the foreground prior to said adjusting and to visible properties specified for the one or more UI elements prior to said adjusting.
19. A computing system comprising:
one or more hardware processors configured to:
present a three-dimensional (“3D”) environment comprising one or more user interface (“UP”) elements that are positioned in a foreground of the 3D environment and that partially or wholly obscure a background of the 3D environment;
detect a change in a user eye focus from the foreground to the background;
produce an unobstructed view to all or part of the background by adjusting the one or more UI elements in the foreground in response to detecting the change in the user eye focus;
detect a second change in the user eye focus from the background to the foreground; and
remove said adjusting of the one or more UI elements, wherein said removing comprises returning the one or more UI elements to positions in the foreground prior to said adjusting and to visible properties specified for the one or more UI elements prior to said adjusting.
20. A method comprising:
presenting a three-dimensional (“3D”) environment comprising one or more user interface (“UP”) elements that are positioned in a foreground of the 3D environment and that partially or wholly obscure a background of the 3D environment;
tracking a depth at which the one or more UI elements are positioned in the 3D environment;
determining that the one or more UI elements are positioned in the foreground of the 3D environment based on said tracking of the depth;
detecting a first change in a user eye focus from the foreground to the background;
issuing a command that adjusts a positioning or opacity of the one or more UI elements in response to determining that the one or more UI elements are positioned in the foreground and further in response to the change in the user eye focus from the foreground to the background; and
producing an unobstructed view to all or part of the background by adjusting the one or more UI elements in the foreground in response to executing the command.
21. A computing system comprising:
one or more hardware processors configured to:
present a three-dimensional (“3D”) environment comprising one or more user interface (“UP”) elements that are positioned in a foreground of the 3D environment and that partially or wholly obscure a background of the 3D environment;
track a depth at which the one or more UI elements are positioned in the 3D environment;
determine that the one or more UI elements are positioned in the foreground of the 3D environment based on said tracking of the depth;
detect a first change in a user eye focus from the foreground to the background;
issue a command that adjusts a positioning or opacity of the one or more UI elements in response to determining that the one or more UI elements are positioned in the foreground and further in response to the change in the user eye focus from the foreground to the background; and
produce an unobstructed view to all or part of the background by adjusting the one or more UI elements in the foreground in response to executing the command.