IP Library Granted Patent US 10,719,989
Granted Patent B2
US 10,719,989 · App. 16/112,407 · Granted Jul 21, 2020

Suggestion of content within augmented-reality environments

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,719,989
App. No.
16/112,407
Granted
Jul 21, 2020
Kind
B2
Abstract

In one embodiment, a method includes rendering an augmented-reality environment on a display associated with a first computing device associated with a first user; identifying one or more objects within the augmented-reality environment; determining a suggested augmented-reality content item based on social-networking information associated with the first user, and further based on characteristics associated with the identified objects; and presenting the suggested augmented-reality content item on a display associated with the first computing device.

Claims (70)

1. A method comprising:

rendering an augmented-reality environment on a display associated with a first computing device associated with a first user;

identifying one or more objects within the augmented-reality environment;

accessing a data store that comprises one or more augmented-reality content items;

calculating, for each of the augmented-reality content items, a relevance score based on:

one or more characteristics of one of more of the objects identified within the augmented-reality environment; and

social-networking information associated with the first user;

determining, based on their relevance scores, one or more augmented-reality content items to suggest to the first user for one or more of the objects identified within the augmented-reality environment; and

suggesting the one or more determined augmented-reality content items to the first user by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

2. The method of claim 1 , wherein presenting the one or more determined augmented-reality content items to the first user comprises presenting the one or more determined augmented-reality content items within a suggestions interface rendered within a sub-region of the display.

3. The method of claim 1 , wherein

one or more of the augmented-reality content items are associated with a second user;

the social-networking information associated with the first user comprises information about a degree of separation between the first user and the second user; and

determining one or more augmented-reality content items to suggest to the first user is further based on information associated with the second user.

4. The method of claim 1 , wherein determining one or more augmented-reality content items based on their relevance scores comprises identifying one or more augmented-reality content items with scores greater than a pre-determined threshold.

5. The method of claim 1 , wherein determining one or more augmented-reality content items to suggest to the first user is further based on one or more of:

a current location of the first user;

an event that is determined to be occurring currently; or

a current date or time.

6. The method of claim 1 , wherein determining one or more augmented-reality content items based on their relevance scores comprises ranking the augmented-reality content items based on their relevance scores.

7. The method of claim 1 , wherein the social-networking information associated with the first user comprises one or more of:

an affinity coefficient between the first user and the augmented-reality content item; or

demographic information associated with the first user.

8. The method of claim 1 , wherein the identified objects are objects within the augmented-reality environment that are within a focal region of the display associated with the first computing device.

9. The method of claim 1 , further comprising:

receiving an input at the first computing device selecting one of the suggested augmented-reality content items; and

modifying a particular identified object, wherein the modifying comprises altering the particular identified object based on the selected suggested augmented-reality content item.

10. The method of claim 9 , wherein the selected suggested augmented-reality content item comprises a mask and the particular identified object comprises a face.

11. The method of claim 9 , wherein the selected suggested augmented-reality content item comprises a filter.

12. The method of claim 9 , wherein the selected suggested augmented-reality content item comprises a drawing.

13. The method of claim 1 , further comprising:

receiving a content-selection input at the first computing device that selects one of the suggested augmented-reality content items;

receiving a content-placement input at the first computing device that specifies a location within the augmented-reality environment; and

placing the suggested augmented-reality content item selected by the content-selection input at the location specified by the content-placement input.

14. The method of claim 1 , further comprising:

receiving a content-modification input at the first computing device that specifies a modification to one of the suggested augmented-reality content items;

causing an instance of the suggested augmented-reality content item to be modified.

15. The method of claim 14 , further comprising:

uploading the modified instance of the suggested augmented-reality content item to a server; and

receiving a privacy-settings input from the first user, wherein the privacy-settings input specifies criteria that authorizes one or more fourth users to access the modified instance of the suggested augmented-reality content item.

16. The method of claim 1 , wherein:

the augmented-reality environment is rendered on the display by the first computing device;

identifying one or more objects within the augmented-reality environment, accessing the data store that comprises the augmented-reality content items, calculating the relevance scores of the augmented-reality content items, and determining the augmented-reality content items to suggest to the first user comprises, by the first computing device, communicating one or more requests to one or more servers and receiving one or more responses from one or more of the servers; and

the determined augmented-reality content items are suggested to the first user by the first computing device by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

17. The method of claim 1 , wherein:

the augmented-reality environment is rendered on the display by the first computing device;

the one or more objects within the augmented-reality environment are identified locally by the first computing device;

the data store that comprises one or more augmented-reality content items is accessed by the first computing device;

the relevance scores for the augmented-reality content items are calculated by the first computing device;

the augmented-reality content items to suggest to the first user are determined by the first computing device; and

the determined augmented-reality content items are suggested to the first user by the first computing device by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

18. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

render an augmented-reality environment on a display associated with a first computing device associated with a first user;

identify one or more objects within the augmented-reality environment;

access a data store that comprises one or more augmented-reality content items;

calculate, for each of the augmented-reality content items, a relevance score based on:

one or more characteristics of one of more of the objects identified within the augmented-reality environment; and

social-networking information associated with the first user;

determine, based on their relevance scores, one or more augmented-reality content items to suggest to the first user for one or more of the objects identified within the augmented-reality environment; and

suggest the one or more determined augmented-reality content items to the first user by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

19. The media of claim 18 , wherein one or more of the augmented-reality content items are associated with a second user, wherein the social-networking information associated with the first user comprises information about a degree of separation between the first user and the second user, and wherein determining one or more augmented-reality content items to suggest to the first user is further based on information associated with the second user.

20. A system comprising: one or more processors; and one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:

render an augmented-reality environment on a display associated with a first computing device associated with a first user;

identify one or more objects within the augmented-reality environment;

access a data store that comprises one or more augmented-reality content items;

calculate, for each of the augmented-reality content items, a relevance score based on:

one or more characteristics of one of more of the objects identified within the augmented-reality environment; and

social-networking information associated with the first user;

determine, based on their relevance scores, one or more augmented-reality content items to suggest to the first user for one or more of the objects identified within the augmented-reality environment; and

suggest the one or more determined augmented-reality content items to the first user by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

Assignments (2)
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2019
From: STAHL, JUSTIN DAVID; SEAD, NARIN; MURRELL, TULLIE; GERME, GREGORY DANIEL LOUIS; KISH, STEVEN
To: FACEBOOK, INC.
Reel/Frame 050487/0674 →