Granted Patent B2

US 12,548,245 · App. 18/194,207 · Granted Feb 10, 2026

Inventors: Tushar Arora (Seattle, WA); Johnathon Simmons (Seattle, WA); Zachary Gil Freeman (Seattle, WA); William Joseph Siegfried (San Francisco, CA)

Assignee: Meta Platforms Technologies, LLC

G06T17/00G06F3/012G06T2219/2004H04N7/157

Abstract

Claims (54)

1 . A method for providing an augmented world environment model for an artificial reality environment, the method comprising:

managing the artificial reality environment on an artificial reality device, the artificial reality environment including multiple artificial reality experiences, each artificial reality experience providing one or more corresponding augments, the augments defining bounding layouts for one or more content items; and

rendering the artificial reality environment based on a defined hierarchy of multiple states,

wherein the defined hierarchy is based on a set of rules that control rendering of the multiple artificial reality experiences and the corresponding augments,

wherein each artificial reality experience, of the multiple artificial reality experiences, has an experience state, of the multiple states, the experience states comprising an active state, a foregrounded state, a backgrounded state, a not running state, and a closed experience state,

wherein each augment of the one or more corresponding augments has an augment state of the multiple states, the augment states comprising a focused state, a displayed state, a minimized state, an unloaded state, and a closed augment state, and

wherein an augment of the one or more augments, corresponding to a particular artificial reality experience of the multiple artificial reality experiences, having the focused state as the augment state, causes the experience state for the particular artificial reality experience to transition to the active state, based on a rule of the set of rules.

2 . The method of claim 1 , wherein interaction, by a user of the artificial reality device, with the augment of the one or more augments corresponding to the particular artificial reality experience, causes the augment to transition to the focused state as the augment state.

3 . The method of claim 1 ,

wherein the particular artificial reality experience, of the multiple artificial reality experiences, is a first artificial reality experience, and the rule is a first rule of the set of rules, and

wherein a second artificial reality experience, of the multiple artificial reality experiences, not being in the active state, and having at least one of the one or more augments, corresponding to the second artificial reality experience, in the displayed state, causes a corresponding transition to the foregrounded state for the second artificial reality experience.

4 . The method of claim 1 , wherein the particular artificial reality experience, of the multiple artificial reality experiences, is exclusively in the active state.

5 . The method of claim 1 ,

wherein the particular artificial reality experience, of the multiple artificial reality experiences, is a first artificial reality experience, and the rule is a first rule of the set of rules, and

wherein a second artificial reality experience creating a new augment in the artificial reality environment causes an augment, of the one or more augments corresponding to the second artificial reality experience, to transition to the minimized state.

6 . The method of claim 1 , wherein the artificial reality device renders an augment, of the one or more corresponding augments, in the displayed state with degradation relative to the augment having the focused state.

7 . The method of claim 1 , wherein a virtual representation of the artificial reality device being a threshold distance away from an augment of the one or more corresponding augments causes the augment to transition to the unloaded state.

8 . The method of claim 1 ,

wherein the particular artificial reality experience, of the multiple artificial reality experiences, is a first artificial reality experience, and the rule is a first rule of the set of rules, and

wherein each of the one or more augments, corresponding to a second artificial reality experience of the multiple artificial reality experiences, having at least one of A) the minimized state, B) the unloaded state, C) the closed augment state, or D) any combination thereof, causes the second artificial reality experience to transition to the backgrounded state, based on a second rule of the set of rules.

9 . The method of claim 1 ,

wherein the particular artificial reality experience, of the multiple artificial reality experiences, is a first artificial reality experience, and the rule is a first rule of the set of rules, and

wherein the artificial reality device terminating a second artificial reality experience of the multiple artificial reality experiences causes the second artificial reality experience to transition to the not running state, based on a second rule of the set of rules.

10 . The method of claim 1 ,

wherein the particular artificial reality experience, of the multiple artificial reality experiences, is a first artificial reality experience, and the rule is a first rule of the set of rules, and

wherein either A) a second artificial reality experience, of the multiple artificial reality experiences, being closed by a user of the artificial reality device, or B) each of the one or more augments, corresponding to the second artificial reality experience, being closed by a user of the artificial reality device, causes the second artificial reality experience to transition to the closed experience state, based on a second rule of the set of rules.

11 . The method of claim 1 , further comprising:

receiving input relative to the augment corresponding to the particular artificial reality experience to enter an exclusive mode for the particular artificial reality experience; and

exclusively rendering the particular artificial reality experience in the artificial reality environment.

12 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for providing an augmented world environment model for an artificial reality environment, the process comprising:

managing multiple artificial reality experiences in the artificial reality environment on an artificial reality device, each artificial reality experience providing one or more corresponding augments defining bounding layouts for one or more content items; and

rendering the artificial reality environment based on a hierarchy of multiple states,

wherein each artificial reality experience has an experience state, of the multiple states, the experience states defining capabilities of respective artificial reality experiences within the artificial reality environment;

wherein each augment of the one or more corresponding augments has an augment state, of the multiple states, the augment states defining how respective augments are or are not displayed in the artificial reality environment,

wherein at least one of the multiple states is selected based on a mapping between at least one of the experience states and at least one of the augment states defined by the hierarchy; and

wherein each of the one or more augments, corresponding to a particular artificial reality experience of the multiple artificial reality experiences, having a not displayed state, causes the particular artificial reality experience to transition to a backgrounded state, based on a set of rules.

13 . The non-transitory computer-readable storage medium of claim 12 ,

wherein the experience states comprise an active state, a foregrounded state, the backgrounded state, a not running state, and a closed experience state, and

wherein the augment states comprise a focused state, a displayed state, and the not displayed state.

14 . The non-transitory computer-readable storage medium of claim 13 , wherein the not displayed state is a minimized state, an unloaded state, or a closed augment state.

15 . A computing system for providing an augmented world environment model for an artificial reality environment, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

managing multiple artificial reality experiences in the artificial reality environment on an artificial reality device, each artificial reality experience providing one or more corresponding augments defining bounding layouts for one or more content items; and

rendering the artificial reality environment based on a hierarchy of multiple states,

wherein each artificial reality experience has an experience state, of the multiple states, the experience states defining capabilities of respective artificial reality experience in the artificial reality environment,

wherein each augment of the one or more corresponding augments has an augment state, of the multiple states, the augment states defining how respective augments are or are not displayed in the artificial reality environment,

wherein at least one of the multiple states is selected based on a mapping between at least one of the experience states and at least one of the augment states defined by the hierarchy, and

wherein an augment of the one or more augments, corresponding to a particular artificial reality experience of the multiple artificial reality experiences, having a focused state as the augment state, causes an active state as the experience state for the particular artificial reality experience, based on the hierarchy.

16 . The computing system of claim 15 ,

wherein the experience states comprise the active state, a foregrounded state, a backgrounded state, a not running state, and a closed experience state, and

wherein the augment states comprise the focused state, a displayed state, and a not displayed state.

17 . The computing system of claim 16 , wherein interaction, by a user of the artificial reality device, with an augment of the one or more augments corresponding to a particular artificial reality experience of the multiple artificial reality experiences, causes the augment to transition to the focused state as the augment state.

18 . The computing system of claim 17 , wherein the artificial reality device renders an augment, of the one or more corresponding augments, in the displayed state with degradation relative to the augment having the focused state.

Assignments (1)

Continuity (1)

References Cited (400)