IP Library Granted Patent US 10,423,656
Granted Patent B2
US 10,423,656 · App. 15/491,778 · Granted Sep 24, 2019

Tag suggestions for images on online social networks

Inventors: Dan Barak (Redwood City, CA); Yaniv N. Taigman (Los Altos, CA); Gil Hirsch (Palo Alto, CA); Jorn Martinus Johannes van Dijk (Amsterdam, NL); Dirk John Stoop (Menlo Park, CA)
Assignee: Facebook, Inc.
G06F16/583G06F3/04842G06F16/3322G06F16/51G06F16/5866G06K9/00221G06K9/00228G06K9/00268G06K9/00295G06K9/00302G06K9/00677G06Q50/01H04L51/32H04L67/10H04L67/22H04L67/306G06F3/0482G06K2009/00328G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,423,656
App. No.
15/491,778
Granted
Sep 24, 2019
Kind
B2
Abstract

In one embodiment, a method includes sending, from a client system of a first user to a server of an online social network, an image portraying at least a first person and determining, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image. The facial-recognition score is based at least in part on a facial-representation associated with the user being compared with the image. The method further includes presenting, at the client system, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users and receiving a selection of a particular tag suggestion by the first user. Each tag suggestion corresponds to a particular user of the first set of users.

Claims (37)

1. A method comprising, by a client computing device of a first user:

sending, from the client computing device of the first user to a server of an online social network, an image portraying at least a first person;

determining, at the client computing device, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image, wherein the facial-recognition score is based at least in part on a facial-representation associated with the user, the facial-representation associated with the user being compared with the image;

presenting, at the client computing device, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users, wherein each tag suggestion corresponds to a particular user of the first set of users; and

receiving, at the client computing device, a selection of a particular tag suggestion by the first user.

2. The method of claim 1 , further comprising sending the selection of the particular tag suggestion to the server of the online social network.

3. The method of claim 1 , wherein the social graph affinity is accessed from the server of the online social network.

4. The method of claim 1 , wherein the facial-recognition score is accessed from the server of the online social network.

5. The method of claim 1 , further comprising determining a social-graph affinity for each user in the first set of users.

6. The method of claim 1 , further comprising:

accessing a social graph comprising a plurality of nodes and a plurality of edges connecting the nodes, each of the edges between two of the nodes representing a single degree of separation between them, the nodes comprising:

a first node corresponding to the image; and

a plurality of second nodes corresponding to a plurality of users associated with the online social network, respectively.

7. The method of claim 6 , wherein the social-graph affinity for each user in the first set of users is based at least in part on a degree of separation between the second node corresponding to the user and the first node corresponding to the image.

8. The method of claim 6 , wherein the image comprises one or more tags corresponding to one or more second users of the plurality of users, respectively, and wherein the social-graph affinity for each user of the first set of users is based at least in part on a degree of separation between the second node corresponding to the user and the one or more second nodes corresponding to the one or more second users, respectively.

9. The method of claim 1 , further comprising receiving one or more characters of a character string at the client computing device as the first user enters the character string into a user interface associated with the image.

10. The method of claim 9 , further comprising determining one or more users of the online social network that substantially match the character string.

11. The method of claim 9 , further comprising:

sending, from the client computing device to the server, the character string entered by the first user; and

receiving, at the client computing device from the server of the online social network, information associated with one or more users of the online social network that substantially match the character string.

12. The method of claim 9 , wherein determining the facial-recognition score is further based at least in part on the character string.

13. The method of claim 1 , further comprising generating the one or more tag suggestions by identifying each user of the first set of users having a facial-recognition score greater than a threshold facial-recognition score, wherein each identified user is generated as one of the tag suggestions.

14. The method of claim 1 , further comprising rendering the image with a tag-label for the particular tag suggestion, wherein the tag-label comprises a description of the particular user corresponding to the particular tag suggestion.

15. The method of claim 1 , wherein the facial-recognition score for each user measures a probability that the user matches the first person portrayed in the image.

16. The method of claim 1 , wherein the social-graph affinity for each user is based at least in part on a tag-history information of the image.

17. The method of claim 1 , wherein the image is associated with a first set of images, and wherein the social-graph affinity for each user is based at least in part on a tag-history information of the other images in the first set of images.

18. The method of claim 1 , wherein the social-graph affinity for each user is based at least in part on a time-decay information associated with the image.

19. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

send, from a client computing device of a first user to a server of an online social network, an image portraying at least a first person;

determine, at the client computing device, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image, wherein the facial-recognition score is based at least in part on a facial-representation associated with the user, the facial-representation associated with the user being compared with the image;

present, at the client computing device, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users, wherein each tag suggestion corresponds to a particular user of the first set of users; and

receive, at the client computing device, a selection of a particular tag suggestion by the first user.

20. A system comprising: one or more processors; and a memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:

send, from a client computing device of a first user to a server of an online social network, an image portraying at least a first person;

determine, at the client computing device, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image, wherein the facial-recognition score is based at least in part on a facial-representation associated with the user, the facial-representation associated with the user being compared with the image;

present, at the client computing device, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users, wherein each tag suggestion corresponds to a particular user of the first set of users; and

receive, at the client computing device, a selection of a particular tag suggestion by the first user.

Assignments (1)
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
Continuity (6)
Continuation 14942659 · Nov 16, 2015
Continuation 14748111 · Jun 23, 2015
Continuation 13906148 · May 30, 2013
Continuation In Part 12922984
Provisional Application 61070377 · Mar 20, 2008
Related Publication 20170220601A1 · Aug 3, 2017