IP Library Granted Patent US 11,119,568
Granted Patent B2
US 11,119,568 · App. 16/734,093 · Granted Sep 14, 2021

Suspend mode feature for artificial reality systems

Inventors: Arthur Bodolec (New York City, NY); Jing Shu (Sunnyvale, CA); Lindsay Young (San Francisco, CA); Melissa Erin Summers (Charlotte, NC); Andrea Zeller (Bothell, WA); Seohyun Lee (Mountain View, CA); Ayfer Gokalp (Kirkland, WA)
Assignee: Facebook Technologies, LLC
G06F3/011G06F3/017G06F3/04842G09G5/026G09G5/37G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,119,568
App. No.
16/734,093
Granted
Sep 14, 2021
Kind
B2
Abstract

In general, this disclosure describes a suspend mode feature for artificial reality systems and, more specifically, system configurations and techniques for generating a suspend mode environment during execution of an artificial reality application, and presenting and controlling user interface (UI) elements within the suspend mode environment. The suspend mode feature enables a user interacting with one or more other users (or one or more avatars corresponding to the one or more other users) within an artificial reality (AR) environment to suspend the AR environment from the user's perspective. While in the suspend mode environment, the user is able to view and select the other users from the AR environment. For example, the user may select another user to friend, message, mute, block, or report that user from the suspend mode environment.

Claims (52)

1. An artificial reality system comprising:

a head-mounted display (HMD) configured to output artificial reality content to a user of the HMD, wherein the artificial reality content includes one or more avatars corresponding to one or more other users participating in an artificial reality environment; and

a suspend mode engine configured to, in response to user input, enable a suspend mode environment for the user of the HMD in which an avatar corresponding to the user stops participating in the artificial reality environment and the one or more avatars corresponding to the one or more other users continue participating in the artificial reality environment at respective HMDs of the one or more other users, wherein the suspend mode engine at least:

renders the one or more avatars in static positions within the suspend mode environment at the HMD of the user while the one or more avatars corresponding to the one or more other users continue participating in the artificial reality environment at the respective HMDs of the one or more other users.

2. The artificial reality system of claim 1 , further comprising:

an image capture device configured to capture image data representative of a physical environment;

a gesture detector configured to identify, from the image data, a user interface (UI) activation gesture comprising moving an inside wrist area of a hand of the user of the HMD in a field of view of the image capture device;

a UI engine configured to, in response to the UI activation gesture, generate a suspend mode UI element; and

a rendering engine configured to render the suspend mode UI element near or at least partially over the hand of the user.

3. The artificial reality system of claim 2 , wherein the user input corresponds to a suspend mode selection gesture comprising placement of one or more fingers of a virtual hand of an avatar of the user on the suspend mode UI element, and the gesture detector is further configured to identify, from the image data, the suspend mode selection gesture.

4. The artificial reality system of claim 1 , wherein the suspend mode engine is further configured to move the one or more avatars away from the avatar corresponding to the user when the one or more avatars are within a personal space threshold from the avatar corresponding to the user in response to the suspend mode environment being enabled.

5. The artificial reality system of claim 1 , wherein the suspend mode engine is further configured to replace a virtual background and virtual objects within the artificial reality environment with a solid-color background in the suspend mode environment.

6. The artificial reality system of claim 1 , wherein the suspend mode engine is further configured to play background music in the suspend mode environment.

7. The artificial reality system of claim 1 , wherein at least one of the respective HMDs renders a virtual graphic corresponding to the user of the HMD after the suspend mode environment is enabled for the user at the HMD.

8. The artificial reality system of claim 1 , wherein at least one user of the other users of the respective HMDs is unable to interact with the avatar corresponding to the user of the HMD within the artificial reality environment after the suspend mode environment is enabled for the user at the HMD.

9. The artificial reality system of claim 1 ,

wherein the HMD comprises a first HMD and the user of the first HMD comprises a first user;

wherein the user input comprises a first user input and the suspend mode environment comprises a first suspend mode environment;

wherein the suspend mode engine is further configured to, in response to a second user input from a second user of the other users participating in the artificial reality environment, enable a second suspend mode environment for the second user of a second HMD of the respective HMDs that is different from the first suspend mode environment; and

wherein the second user of the second HMD is unable to interact with the avatar of the first user within the first suspend mode environment or the second suspend mode environment.

10. The artificial reality system of claim 1 , wherein the suspend mode engine is further configured to:

render a user interface (UI) element for each of the one or more avatars within the suspend mode environment, wherein each UI element is selectable via a selection gesture performed by the user; and

in response to detecting the selection gesture of a first UI element corresponding to a first avatar of the one or more avatars, at least one of:

render a first selectable virtual element configured to, when selected, mute the first avatar at the HMD when the user returns to the artificial reality environment,

render a second selectable virtual element configured to, when selected, block the first avatar and an avatar of the user from interacting when the user returns to the artificial reality environment, or

render a third selectable virtual element configured to, when selected, report the first avatar to a review entity associated with the AR experience.

11. The artificial reality system of claim 10 , wherein the first avatar is highlighted when the first UI element corresponding to the first avatar is selected.

12. The artificial reality system of claim 10 , wherein the first avatar will be unable to interact with the avatar of the user in the artificial reality environment or any other artificial reality environment if blocked by the user, whether or not the suspend mode environment is enabled for the user.

13. A method comprising:

outputting, at a head mounted display (HMD) of an artificial reality system, artificial reality content to a user of the HMD, wherein the artificial reality content includes one or more avatars corresponding to one or more other users participating an artificial reality environment; and

in response to user input, enabling a suspend mode environment for the user of the HMD in which an avatar corresponding to the user stops participating in the artificial reality environment and the one or more avatars corresponding to the one or more other users continue participating in the artificial reality environment at respective HMDs of the one or more other users, and wherein enabling the suspend mode environment for the user of the HMD comprises at least:

rendering the one or more avatars in static positions within the suspend mode environment at the HMD of the user while the one or more avatars corresponding to the one or more other users continue participating in the artificial reality environment at the respective HMDs of the one or more other users.

14. The method of claim 13 , further comprising:

obtaining, by the artificial reality system, image data via an image capture device;

identifying, from the image data, a user interface (UI) activation gesture comprising moving an inside wrist area of a hand of the user of the HMD in a field of view of the image capture device;

in response to the UI activation gesture, generating a suspend mode UI element; and

rendering the suspend mode UI element near or at least partially over the hand of the user.

15. The method of claim 14 ,

wherein the user input corresponds to a suspend mode selection gesture comprising placement of one or more fingers of a virtual hand of an avatar of the user on the suspend mode UI element, and

the method further comprises identifying, from the image data, the suspend mode selection gesture.

16. The method of claim 13 , wherein the suspend mode engine is further configured to replace a virtual background and virtual objects within the artificial reality environment with a solid-color background in the suspend mode environment.

17. The method of claim 13 wherein enabling the suspend mode environment further includes moving the one or more avatars away from the avatar corresponding to the user when the one or more avatars are within a personal space threshold from the avatar corresponding to the user in response to the suspend mode environment being enabled.

18. A non-transitory computer-readable storage medium comprising instructions that configure one or more programmable processors to:

output, at head mounted display (HMD) of an artificial reality system, artificial reality content to a user of the HMD, wherein the artificial reality content includes one or more avatars corresponding to one or more other users participating an artificial reality environment; and

in response to user input, enable a suspend mode environment for the user of the HMD in which an avatar corresponding to the user stops participating in the artificial reality environment and the one or more avatars corresponding to the one or more other users continue participating in the artificial reality environment at respective HMDs of the one or more other users, and wherein the instructions that configure the one or more programmable processors to enable the suspend mode environment for the user of the HMD further configure the one or more programmable processors to at least:

render the one or more avatars in static positions within the suspend mode environment at the HMD of the user while the one or more avatars corresponding to the one or more other users continue participating in the artificial reality environment at the respective HMDs of the one or more other users.

19. The artificial reality system of claim 1 , wherein, in addition to rendering the one or more avatars in static positions within the suspend mode environment at the HMD of the user, the suspend mode engine at least one of:

replaces the artificial reality environment with the suspend mode environment at the HMD of the user, or

mutes the one or more avatars and the artificial reality environment at the HMD of the user.

20. The method of claim 13 , wherein, in addition to rendering the one or more avatars in static positions within the suspend mode environment at the HMD of the user, enabling the suspend mode environment for the user of the HMD comprises at least one of:

replacing the artificial reality environment with the suspend mode environment at the HMD of the user, or

muting the one or more avatars and the artificial reality environment at the HMD of the user.

Assignments (2)
CHANGE OF NAME Recorded Jul 21, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060802/0799 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2020
From: BODOLEC, ARTHUR; SHU, JING; YOUNG, LINDSAY; SUMMERS, MELISSA ERIN; ZELLER, ANDREA; LEE, SEOHYUN; GOKALP, AYFER
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 051676/0699 →
Continuity (2)
Provisional Application 62905098 · Sep 24, 2019
Related Publication 20210089117A1 · Mar 25, 2021
Cited By (3)
US 12,266,056 US 12,682,417 US 12,718,490