Metering for display modes in artificial reality
View Patent ↗Aspects of the present disclosure are directed to setting a display mode for a virtual object based on a display mode timer that is controlled by context factors. An artificial reality system can associate one or more virtual objects with a corresponding display mode timer. Various ranges on the display mode timer can be mapped to different display modes that the virtual object can assume. The display mode timer can be adjusted to add time based on a determination of a user focusing on the virtual object or other context factors. Display mode timers can also have rules for setting other display mode timer properties, such as how quickly the display mode timer runs down, that are evaluated based on context factors.
1. A method for displaying a virtual object in an artificial reality environment, the method comprising:
causing a display mode timer to be associated with the virtual object, wherein multiple ranges of the display mode timer are each mapped to one of multiple display modes and the display mode timer elapses at a specified rate;
identifying one or more context factors specifying conditions related to the artificial reality environment, wherein at least one of the one or more context factors indicates a user focus in the artificial reality environment;
evaluating, based on the one or more context factors, one or more rules for the virtual object;
in response to the evaluating, including determining that the user focus is on the virtual object, adding time to the display mode timer;
determining that the time added to the display mode timer caused the display mode timer to have an amount of time in one of the multiple ranges mapped to a new display mode other than a current display mode of the virtual object; and
causing the virtual object to change to the new display mode.
2. The method of claim 1 ,
wherein the specified rate for the display mode timer is variable depending on at least one of the one or more context factors; and
wherein the method further comprises increasing the specified rate in response to a determination, based on the one or more context factors, including one or more of:
that an amount of space the virtual object takes on a display is above a threshold space;
that a power saving mode has been enabled;
that the virtual object is above a threshold distance, in the artificial reality environment, from a user; or
any combination thereof.
3. The method of claim 1 , wherein the specified rate for the display mode timer is variable depending on at least one of the one or more context factors.
4. The method of claim 1 , wherein the new display mode is a maximized display mode in which the virtual object can use a full amount of a volume allocated for that virtual object.
5. The method of claim 1 , wherein the new display mode is a minimized display mode in which a constraint is set such that the virtual object can use less than a full amount of a volume allocated for that virtual object.
6. The method of claim 1 ,
wherein the new display mode is a glint display mode in which a constraint is set such that the virtual object is displayed in a shape specified for all virtual objects that are in the glint display mode; and
wherein, when the virtual object is in the glint display mode, causing the virtual object to enable a display mode other than the glint display mode requires a user interaction specified for exiting glint mode.
7. The method of claim 1 , wherein the new display mode is a glint display mode in which a constraint is set such that the virtual object is displayed in a shape specified for all virtual objects that are in the glint display mode.
8. The method of claim 1 ,
wherein one of the multiple display modes includes a key-actions configuration in which certain controls are displayed in relation to the virtual object; and
wherein the certain controls are controls identified as most often used in relation to the virtual object.
9. The method of claim 1 ,
wherein the new display mode is associated with one or more constraints including:
how much of a display the virtual object can use, or
where in the artificial reality environment the virtual object can be placed; and
wherein, when the virtual object changes to the new display mode, the one or more constraints associated with the new display mode are enforced.
10. The method of claim 1 ,
wherein the virtual object is part of a cluster of multiple virtual objects;
wherein the cluster of multiple virtual objects was defined based on one or more of:
having been created by the same entity,
having a common specified type,
having been grouped by a user, or
any combination thereof; and
wherein the display mode timer associated with the virtual object is:
assigned to the cluster of multiple virtual objects; or
is synchronized with one or more other display mode timers associated with one or more of the multiple virtual objects.
11. The method of claim 1 ,
wherein the virtual object is part of a cluster of multiple virtual objects; and
wherein the display mode timer associated with the virtual object is:
assigned to the cluster of multiple virtual objects; or
is synchronized with one or more other display mode timers associated with one or more of the multiple virtual objects.
12. The method of claim 1 , wherein the evaluating the one or more rules for the virtual object includes determining that the user focus is directed at the virtual object.
13. A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for displaying a virtual object in an artificial reality environment, the process comprising:
receiving one or more context factors specifying conditions related to the artificial reality environment;
evaluating, based on the one or more context factors, one or more rules for the virtual object;
in response to the evaluating, adding time to a display mode timer associated with the virtual object, wherein multiple ranges of the display mode timer are each mapped to one of multiple display modes;
determining that the time added to the display mode timer caused the display mode timer to have an amount of time in one of the multiple ranges mapped to a new display mode other than a current display mode of the virtual object; and
causing the virtual object to change to the new display mode.
14. The computer-readable storage medium of claim 13 , wherein the one or more context factors include:
user proximity, in the artificial reality environment, to the virtual object;
that a user input has been provided in relation to the virtual object;
a current mode of an artificial reality system in control of the artificial reality environment;
an amount of power used to display the virtual object; or
any combination thereof.
15. The computer-readable storage medium of claim 13 , wherein the process further comprises determining that the virtual object is providing active output and, in response, preventing a further change in display mode while the virtual object is providing the active output.
16. The computer-readable storage medium of claim 13 ,
wherein the display mode timer elapses at a specified rate; and
wherein the process further comprises increasing the specified rate in response to a determination, based on the one or more context factors, including one or more of:
that a power saving mode has been enabled;
that the virtual object is above a threshold distance, in the artificial reality environment, from the user; or
any combination thereof.
17. The computer-readable storage medium of claim 13 ,
wherein the one or more context factors specify at least a user gaze direction; and
wherein the evaluating the one or more rules for the virtual object includes determining that the user gaze direction is directed at the virtual object.
18. A computing system for displaying a virtual object in an artificial reality environment, the computing system comprising:
one or more processors; and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:
causing a display mode timer to be associated with the virtual object, wherein multiple ranges of the display mode timer are each mapped to one of multiple display modes and the display mode timer elapses at a specified rate, and wherein the multiple ranges of the display mode timer include at least three ranges;
in response to the display mode timer elapsing, determining that the display mode timer has an amount of time in one of the multiple ranges that is mapped to a new display mode other than a current display mode of the virtual object; and
causing the virtual object to change to the new display mode.
19. The computing system of claim 18 ,
wherein the process further comprises:
receiving one or more context factors specifying conditions related to the artificial reality environment; and
based on the one or more context factors, adding time to the display mode timer associated with the virtual object; and
wherein the one or more context factors include:
that a user input has been provided in relation to the virtual object;
a current mode of an artificial reality system in control of the artificial reality environment;
that the virtual object is providing active output; or
any combination thereof.
20. The computing system of claim 18 ,
wherein one of the multiple display modes includes a key-actions configuration in which certain controls are displayed in relation to the virtual object; and
wherein the certain controls are controls identified as most often used in relation to the type of virtual object corresponding to the virtual object.