IP Library Granted Patent US 10,536,691
Granted Patent B2
US 10,536,691 · App. 15/722,906 · Granted Jan 14, 2020

Controls and interfaces for user interactions in virtual spaces

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,536,691
App. No.
15/722,906
Granted
Jan 14, 2020
Kind
B2
Abstract

In one embodiment, a method includes sending information configured to render a virtual space on a display device; receiving a first input from a first controller device, wherein the first controller device is associated with a first location on a body of a user; sending information configured to render a user interface comprising a menu of items, the menu of items comprising one or more interactive elements; receiving a second input from a second controller device, wherein the second controller device is associated with a second location on the body of the user, and wherein the second input indicates a selection of a particular interactive element; and sending information configured to render a response to the selection of the particular interactive element on a display device associated with the user.

Claims (37)

1. A method comprising, by a computing system:

sending information configured to render a virtual space on a display device;

receiving a first input from a first controller device, wherein the first controller device is associated with a first location on a body of a user, and wherein the first input indicates a selection of a virtual tool;

determining, based on a property of the virtual tool, a user interface to be rendered in association with a representation of the first controller device, wherein the user interface comprises a menu of items comprising one or more virtual interactive elements for the representation of the first controller device;

sending information configured to render the user interface and the representation of the first controller device, wherein the user interface is rendered in a region of the virtual space in association with the representation of the first controller device;

receiving a second input from a second controller device, wherein the second controller device is associated with a second location on the body of the user, and wherein the second input indicates a selection of a particular virtual interactive element; and

sending information configured to render a response to the selection of the particular virtual interactive element on a display device associated with the user.

2. The method of claim 1 , wherein the first controller device is associated with a first hand of the user and the second location is associated with a second hand of the user.

3. The method of claim 2 , wherein one or more of the virtual interactive elements are rendered in the virtual space in association with a region of a virtual representation of the user that is associated with the first hand of the user.

4. The method of claim 2 , wherein the menu of items is rendered such that it follows motions of the first hand of the user.

5. The method of claim 2 , wherein the second input comprises:

a first gesture to cause a finger of a rendering of the second hand to point outward; and

a second gesture to cause the finger to move toward the particular virtual interactive element.

6. The method of claim 1 , wherein the first input comprises a trigger gesture, wherein the trigger gesture comprises a rotation of the first controller device.

7. The method of claim 1 , wherein the first input comprises a selection of a trigger element.

8. The method of claim 7 , wherein the trigger element is a virtual interactive element that is associated with a region of a virtual representation of the user.

9. The method of claim 1 , wherein the virtual tool is a paintbrush, pen, or marker tool and the menu of elements comprises a virtual palette comprising one or more colors.

10. The method of claim 1 , further comprising determining the virtual interactive elements that are comprised in the menu of items, the virtual interactive elements being determined based on a property of a content item that is selected.

11. The method of claim 1 , further comprising determining the virtual interactive elements that are comprised in the menu of items, the virtual interactive elements being determined based on information associated with the user.

12. The method of claim 1 , further comprising determining the virtual interactive elements that are comprised in the menu of items, the virtual interactive elements being determined based on a property associated with the virtual space.

13. The method of claim 1 , wherein the computing system comprises a remote server.

14. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

send information configured to render a virtual space on a display device;

receive a first input from a first controller device, wherein the first controller device is associated with a first location on a body of a user, and wherein the first input indicates a selection of a virtual tool;

determine, based on a property of the virtual tool, a user interface to be rendered in association with a representation of the first controller device, wherein the user interface comprises a menu of items comprising one or more virtual interactive elements for the representation of the first controller device

send information configured to render the user interface and the representation of the first controller device, wherein the user interface is rendered in a region of the virtual space in association with the representation of the first controller device;

receive a second input from a second controller device, wherein the second controller device is associated with a second location on the body of the user, and wherein the second input indicates a selection of a particular virtual interactive element; and

send information configured to render a response to the selection of the particular virtual interactive element on a display device associated with the user.

15. The media of claim 14 , wherein the first controller device is associated with a first hand of the user and the second location is associated with a second hand of the user.

16. The media of claim 15 , wherein one or more of the virtual interactive elements are rendered in the virtual space in association with a region of a virtual representation of the user that is associated with the first hand of the user.

17. A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:

send information configured to render a virtual space on a display device;

receive a first input from a first controller device, wherein the first controller device is associated with a first location on a body of a user, and wherein the first input indicates a selection of a virtual tool;

determine, based on a property of the virtual tool, a user interface to be rendered in association with a representation of the first controller device, wherein the user interface comprises a menu of items comprising one or more virtual interactive elements for the representation of the first controller device

send information configured to render the user interface and the representation of the first controller device, wherein the user interface is rendered in a region of the virtual space in association with the representation of the first controller device;

receive a second input from a second controller device, wherein the second controller device is associated with a second location on the body of the user, and wherein the second input indicates a selection of a particular virtual interactive element; and

send information configured to render a response to the selection of the particular virtual interactive element on a display device associated with the user.

Assignments (5)
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2018
From: WARREN, CLIFF; ALEXANDER, ALEXANDROS; BOOTH, MICHAEL STEPHEN; SUTTON, CHARLES MATTHEW
To: FACEBOOK, INC.
Reel/Frame 045498/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2018
From: TAUZIET, CHRISTOPHE MARCEL RENE
To: FACEBOOK, INC.
Reel/Frame 045194/0250 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2018
From: SOHAIL, MAHEEN
To: FACEBOOK, INC.
Reel/Frame 044706/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2018
From: VALDIVIA, GABRIEL
To: FACEBOOK, INC.
Reel/Frame 044692/0721 →