IP Library Granted Patent US 11,023,519
Granted Patent B1
US 11,023,519 · App. 16/162,263 · Granted Jun 1, 2021

Image keywords

Inventors: Albert Koy (San Francisco, CA); Xiaodong Wang (Belmont, CA)
Assignee: Pinterest, Inc.
G06F16/5866G06F16/248G06F16/5846
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,023,519
App. No.
16/162,263
Granted
Jun 1, 2021
Kind
B1
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing content. One of the methods includes receiving a target image at an image platform; determining one or more images related to the target image; determining queries associated with the related images; deriving candidate keywords from the determined queries; filtering the candidate keywords to select one or more keywords; and providing the image to one or more users in response to respective incoming queries based on the one or more keywords.

Claims (46)

1. A method comprising:

receiving a target image at an image platform;

determining one or more related images comprising images that are related to the target image;

determining queries associated with the related images from historical information, wherein the determined queries returned the related images as search results of the image platform;

for each determined query of the determined queries, determining a level of engagement by users of the image platform with corresponding images of the related images, wherein the corresponding images are provided by the image platform as a search result responsive to the determined query;

deriving a set of candidate keywords from one or more determined queries of the determined queries, wherein the set of candidate keywords are derived based on content of the one or more determined queries, and wherein corresponding levels of engagements of the one or more determined queries satisfy a threshold;

filtering the set of candidate keywords to select one or more keywords; and

providing the target image to one or more users in response to respective incoming queries based on the one or more keywords.

2. The method of claim 1 , comprising:

determining one or more additional queries, the one or more additional queries associated with the target image; and

adding keywords extracted from the one or more additional queries to the set of candidate keywords.

3. The method of claim 1 , wherein determining one or more related images that are related to the target image includes determining images having a specified degree of visual similarity with the target image.

4. The method of claim 1 , wherein determining one or more related images that are related to the target image includes determining images that co-occur with the target image in user-defined collections of images.

5. The method of claim 1 , wherein filtering the set of candidate keywords includes comparing the candidate keywords to text annotations associated for the target image.

6. The method of claim 1 , wherein providing the target image to one or more users based on the one or more keywords includes using the one or more keywords to present the target image to one or more users of the image platform as sponsored image content.

7. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

receiving a target image at an image platform;

determining one or more related images comprising images that are related to the target image;

determining queries associated with the related images from historical information, wherein the determined queries returned the related images as search results of the image platform;

for each determined query of the determined queries, determining a level of engagement by users of the image platform with corresponding images of the related images, wherein the corresponding images are provided by the image platform as a search result responsive to the determined query;

deriving a set of candidate keywords from one or more determined queries of the determined queries, wherein the set of candidate keywords are derived based on content of the one or more determined queries, and wherein corresponding levels of engagements of the one or more determined queries satisfy a threshold;

filtering the set of candidate keywords to select one or more keywords; and

providing the target image to one or more users in response to respective incoming queries based on the one or more keywords.

8. The system of claim 7 , wherein the one or more computers are further operable to perform operations comprising:

determining one or more additional queries, the one or more additional queries associated with the target image; and

adding keywords extracted from the one or more additional queries to the set of candidate keywords.

9. The system of claim 7 , wherein determining one or more related images that are related to the target image includes determining images having a specified degree of visual similarity with the target image.

10. The system of claim 7 , wherein determining one or more related images that are related to the target image includes determining images that co-occur with the target image in user-defined collections of images.

11. The system of claim 7 , wherein filtering the set of candidate keywords includes comparing the candidate keywords to text annotations associated for the target image.

12. The system of claim 7 , wherein providing the target image to one or more users based on the one or more keywords includes using the one or more keywords to present the target image to one or more users of the image platform as sponsored image content.

13. One or more computer-readable storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

receiving a target image at an image platform;

determining one or more related images comprising images that are related to the target image;

determining queries associated with the related images from historical information, wherein the determined queries returned the related images as search results of the image platform;

for each determined query of the determined queries, determining a level of engagement by users of the image platform with corresponding images of the related images, wherein the corresponding images are provided by the image platform as a search result responsive to the determined query;

deriving a set of candidate keywords from one or more determined queries of the determined queries, wherein the set of candidate keywords are derived based on content of the one or more determined queries, and wherein corresponding levels of engagements of the one or more determined queries satisfy a threshold;

filtering the candidate keywords to select one or more keywords; and

providing the image to one or more users in response to respective incoming queries based on the one or more keywords.

14. The one or more computer-readable storage media of claim 13 , further comprising instructions that cause the one or more computers to perform operations comprising:

determining one or more additional queries, the one or more additional queries associated with the target image; and

adding keywords extracted from the one or more additional queries to the set of candidate keywords.

15. The one or more computer-readable storage media of claim 13 , wherein determining one or more related images that are related to the target image includes determining images having a specified degree of visual similarity with the target image.

16. The one or more computer-readable storage media of claim 13 , wherein determining one or more related images that are related to the target image includes determining images that co-occur with the target image in user-defined collections of images.

17. The one or more computer-readable storage media of claim 13 , wherein filtering the candidate keywords includes comparing the candidate keywords to text annotations associated for the target image.

18. The one or more computer-readable storage media of claim 13 , wherein providing the target image to one or more users based on the one or more keywords includes using the one or more keywords to present the target image to one or more users of the image platform as sponsored image content.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2021
From: KOY, ALBERT; WANG, XIAODONG
To: PINTEREST, INC.
Reel/Frame 056075/0491 →
SECURITY INTEREST Recorded Nov 19, 2018
From: PINTEREST, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 047598/0289 →