IP Library Granted Patent US 10,528,591
Granted Patent B2
US 10,528,591 · App. 15/835,068 · Granted Jan 7, 2020

Methods and systems for using hints in media content tagging

Inventors: Dan Barak (Redwood City, CA); Gil Hirsch (Palo Alto, CA); Yaniv Taigman (Los Altos, CA); Cory West (San Francisco, CA)
Assignee: Facebook, Inc.
G06F16/27G06F16/5866
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,528,591
App. No.
15/835,068
Granted
Jan 7, 2020
Kind
B2
Abstract

Techniques to allow a social networking system to provide hints when a user tags an image. In one embodiment, a comment associated with an image to be tagged by a user of a social networking system is received. A hint based on the comment that is suggestive of at least one aspect relating to the image is identified. A set of candidate tags associated with the user is determined. At least one suggested tag from the set of candidate tags is selected based on the hint. The at least one suggested tag is provided for the user to potentially tag the image.

Claims (41)

1. A computer implemented method comprising:

receiving, by a computing system, information associated with a content item comprising an image to be tagged by a user of a social networking system;

detecting, by the computing system, a hint suggestive of at least one aspect relating to the content item, based on the information;

performing, by a computing system, image recognition on at least one object depicted in the image to obtain identified objects, wherein the image recognition comprises facial recognition;

selecting, by the computing system, at least one suggested tag based on the hint and the identified objects; and

providing, by the computing system, the at least one suggested tag for the user to potentially tag the content item.

2. The method of claim 1 , wherein the at least one aspect includes at least one of identity of an individual associated with the content item, identity of an object associated with the content item, location associated with the content item, identity of a person who created the content item, classification of the content item, or contextual information about the content item.

3. The method of claim 1 , further comprising:

determining a set of candidate tags associated with a set of objects in a social network of the user, wherein the at least one suggested tag is from the set of candidate tags.

4. The method of claim 1 , wherein the hint is based on a reference embedded in the information as the information is created.

5. The method of claim 4 , wherein the reference is a link to a profile page of an object in a social network of the user.

6. The method of claim 1 , wherein the hint comprises a name identified based at least in part on natural language processing.

7. The method of claim 1 , wherein the at least one suggested tag is provided for the user in a list of tags sorted according to relevancy.

8. The method of claim 1 , wherein the information is created by at least one of the user or an object in a social network of the user.

9. The method of claim 1 , further comprising:

detecting an action by the user to tag the content item, wherein the action comprises selection by the user of at least one of a position or a region in the content item.

10. The method of claim 1 , wherein the facial recognition uses facial signatures and characteristics associated with one or more social network members to identify a given face as a specific member of the social network.

11. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

receiving information associated with a content item comprising an image to be tagged by a user of a social networking system;

detecting a hint suggestive of at least one aspect relating to the content item, based on the information;

performing image recognition on at least one object depicted in the image to obtain identified objects, wherein the image recognition comprises facial recognition;

selecting at least one suggested tag based on the hint and the identified objects; and

providing the at least one suggested tag for the user to potentially tag the content item.

12. The system of claim 11 , wherein the at least one aspect includes at least one of identity of an individual associated with the content item, identity of an object associated with the content item, location associated with the content item, identity of a person who created the content item, classification of the content item, or contextual information about the content item.

13. The system of claim 11 , further comprising:

determining a set of candidate tags associated with a set of objects in a social network of the user, wherein the at least one suggested tag is from the set of candidate tags.

14. The system of claim 11 , wherein the hint is based on a reference embedded in the information as the information is created.

15. The system of claim 14 , wherein the reference is a link to a profile page of an object in a social network of the user.

16. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

receiving information associated with a content item comprising an image to be tagged by a user of a social networking system;

detecting a hint suggestive of at least one aspect relating to the content item, based on the information;

performing image recognition on at least one object depicted in the image to obtain identified objects, wherein the image recognition comprises facial recognition;

selecting at least one suggested tag based on the hint and the identified objects; and

providing the at least one suggested tag for the user to potentially tag the content item.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the at least one aspect includes at least one of identity of an individual associated with the content item, identity of an object associated with the content item, location associated with the content item, identity of a person who created the content item, classification of the content item, or contextual information about the content item.

18. The non-transitory computer-readable storage medium of claim 16 , further comprising:

determining a set of candidate tags associated with a set of objects in a social network of the user, wherein the at least one suggested tag is from the set of candidate tags.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the hint is based on a reference embedded in the information as the information is created.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the reference is a link to a profile page of an object in a social network of the user.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058301/0690 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2018
From: BARAK, DAN; HIRSCH, GIL; TAIGMAN, YANIV; WEST, CORY
To: FACEBOOK, INC.
Reel/Frame 047531/0988 →
Continuity (2)
Continuation 13940146 · Jul 11, 2013
Related Publication 20180095998A1 · Apr 5, 2018