IP Library Granted Patent US 11,637,999
Granted Patent B1
US 11,637,999 · App. 17/501,484 · Granted Apr 25, 2023

Metering for display modes in artificial reality

Inventors: James Tichenor (Seattle, WA); Hayden Schoen (Tacoma, WA); Yeliz Karadayi (Seattle, WA)
Assignee: Meta Platforms Technologies, LLC
H04N13/122G02B27/0172H04N13/332G02B2027/014H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,637,999
App. No.
17/501,484
Granted
Apr 25, 2023
Kind
B1
Abstract

Aspects of the present disclosure are directed to setting a display mode for a virtual object based on a display mode timer that is controlled by context factors. An artificial reality system can associate one or more virtual objects with a corresponding display mode timer. Various ranges on the display mode timer can be mapped to different display modes that the virtual object can assume. The display mode timer can be adjusted to add time based on a determination of a user focusing on the virtual object or other context factors. Display mode timers can also have rules for setting other display mode timer properties, such as how quickly the display mode timer runs down, that are evaluated based on context factors.

Claims (84)

1. A computing system for displaying a virtual object in an artificial reality environment, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

causing a display mode timer to be associated with the virtual object, wherein multiple ranges of the display mode timer are each mapped to one of multiple display modes;

identifying a user focus in the artificial reality environment;

determining that the user focus is on the virtual object and, in response, adding time to the display mode timer;

determining that the time added to the display mode timer caused the display mode timer to have an amount of time in one of the multiple ranges mapped to a new display mode other than a current display mode of the virtual object; and

causing the virtual object to change to the new display mode.

2. The computing system of claim 1 ,

wherein a rate at which the display mode timer elapses is variable depending on a determination of at least one of:

that an amount of space the virtual object takes on a display is above a threshold space;

that a power saving mode has been enabled;

that the virtual object is above a threshold distance, in the artificial reality environment, from a user; or

any combination thereof.

3. The computing system of claim 1 , wherein a rate at which the display mode timer elapses is variable depending on one or more context factors.

4. The computing system of claim 1 , wherein the new display mode is a maximized display mode in which the virtual object can use a full amount of a spatial volume allocated for that virtual object.

5. The computing system of claim 1 , wherein the new display mode is a minimized display mode in which a constraint is set such that the virtual object can use less than a full amount of a spatial volume allocated for that virtual object.

6. The computing system of claim 1 ,

wherein the new display mode is a glint display mode in which a constraint is set such that the virtual object is displayed in a shape specified for all virtual objects that are in the glint display mode; and

wherein, when the virtual object is in the glint display mode, causing the virtual object to enable a display mode other than the glint display mode requires a user interaction specified for exiting glint mode.

7. The computing system of claim 1 , wherein the new display mode is a glint display mode in which a constraint is set such that the virtual object is displayed in a shape specified for all virtual objects that are in the glint display mode.

8. The computing system of claim 1 ,

wherein one of the multiple display modes includes a key-actions configuration in which certain controls are displayed in relation to the virtual object; and

wherein the certain controls are controls identified as most often used in relation to the virtual object.

9. The computing system of claim 1 ,

wherein the new display mode is associated with one or more constraints including:

how much of a display the virtual object can use, or

where in the artificial reality environment the virtual object can be placed; and

wherein, when the virtual object changes to the new display mode, the one or more constraints associated with the new display mode are enforced.

10. The computing system of claim 1 ,

wherein the virtual object is part of a cluster of multiple virtual objects;

wherein the cluster of multiple virtual objects was defined based on one or more of:

having been created by the same entity,

having a common specified type,

having been grouped by a user, or

any combination thereof; and

wherein the display mode timer associated with the virtual object is:

assigned to the cluster of multiple virtual objects; or

is synchronized with one or more other display mode timers associated with one or more of the multiple virtual objects.

11. The computing system of claim 1 ,

wherein the virtual object is part of a cluster of multiple virtual objects; and

wherein the display mode timer associated with the virtual object is:

assigned to the cluster of multiple virtual objects; or

is synchronized with one or more other display mode timers associated with one or more of the multiple virtual objects.

12. The computing system of claim 1 , wherein the adding time to the display mode timer is in response to the determining that the user focus is on the virtual object through evaluation of logic, included in the virtual object, that takes contextual factors as parameters and determines corresponding additions or removals of time from the display mode timer.

13. A method for displaying a virtual object in an artificial reality environment, the method comprising:

receiving one or more context factors;

evaluating, based on the one or more context factors, one or more rules for the virtual object;

in response to the evaluating, changing an amount of time allocated to a display mode timer associated with the virtual object, wherein multiple ranges of the display mode timer are each mapped to one of multiple display modes;

determining that the time allocated to the display mode timer caused the display mode timer to have an amount of time in one of the multiple ranges mapped to a new display mode other than a current display mode of the virtual object; and

causing the virtual object to change to the new display mode.

14. The method of claim 13 , wherein the one or more context factors include:

user proximity, in the artificial reality environment, to the virtual object;

that a user input has been provided in relation to the virtual object;

a current mode of an artificial reality system in control of the artificial reality environment;

an amount of power used to display the virtual object; or

any combination thereof.

15. The method of claim 13 further comprising determining that the virtual object is providing active output and, in response, preventing a further change in display mode while the virtual object is providing the active output.

16. The method of claim 13 ,

wherein the display mode timer elapses at a specified rate; and

wherein the method further comprises increasing the specified rate in response

to a determination, based on the one or more context factors, including one or more of:

that a power saving mode has been enabled;

that the virtual object is above a threshold distance, in the artificial reality environment, from the user; or

any combination thereof.

17. The method of claim 13 ,

wherein the one or more context factors specify at least a user gaze direction; and

wherein the evaluating the one or more rules for the virtual object includes determining that the user gaze direction is directed at the virtual object.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for displaying a virtual object in an artificial reality environment, the process comprising:

causing a display mode timer to be associated with the virtual object, wherein multiple ranges of the display mode timer are each mapped to one of multiple display modes, and wherein the multiple ranges of the display mode timer include at least three ranges;

in response to the display mode timer elapsing, determining that the display mode timer has an amount of time in one of the multiple ranges that is mapped to a new display mode other than a current display mode of the virtual object; and

causing the virtual object to change to the new display mode.

19. The non-transitory computer-readable storage medium of claim 18 ,

wherein the process further comprises:

receiving one or more context factors specifying conditions related to the artificial reality environment; and

based on the one or more context factors, adding time to the display mode timer associated with the virtual object; and

wherein the one or more context factors include:

that a user input has been provided in relation to the virtual object;

a current mode of an artificial reality system in control of the artificial reality environment;

that the virtual object is providing active output; or

any combination thereof.

20. The non-transitory computer-readable storage medium of claim 18 ,

wherein one of the multiple display modes includes a key-actions configuration in which certain controls are displayed in relation to the virtual object; and

wherein the certain controls are controls identified as most often used in relation to the type of virtual object corresponding to the virtual object.

Assignments (1)
CHANGE OF NAME Recorded Jun 15, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060386/0364 →
Continuity (1)
Continuation 17013416 · Sep 4, 2020
Cited By (6)
US 12,353,680 US 12,461,592 US 12,468,379 US 12,492,913 US 12,501,150 US 12,663,874