IP Library Granted Patent US 11,681,761
Granted Patent B1
US 11,681,761 · App. 17/699,686 · Granted Jun 20, 2023

Method and system for mining image searches to associate images with concepts

Inventors: Wesley T. Chan (Seattle, WA); Sumit Agarwal (Washington, DC); Rama Ranganath (San Francisco, CA); Leora Ruth Wiseman (Zichron Yaakov, IL); Deepak Jindal (Los Altos, CA)
Assignee: Google LLC
G06F16/93G06F16/51G06F16/90335G06Q30/0224G06Q30/0251G06Q30/0271G06V30/418G06F16/58G06F16/5846G06F16/951G06Q30/0242G06Q30/0256G06Q30/0277
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,681,761
App. No.
17/699,686
Granted
Jun 20, 2023
Kind
B1
Abstract

A system and method for associating a document with a concept are provided. One or more idea-electronic document associations is identified, wherein each idea-electronic document association is based on a user performance criteria relative to the electronic document and the idea. At least one of the one or more electronic documents is identified with a concept based on the one or more idea-electronic document associations, wherein the concept is related to the one or more ideas.

Claims (61)

1. A method, comprising:

identifying, by one or more processors, a first document containing an image;

processing, by the one or more processors, the image to determine one or more concepts of the image;

determining, by the one or more processors, a set of similar documents based on a comparison of the one or more concepts of the image to stored concepts for a plurality of other documents;

suggesting, by the one or more processors and in a user interface presented at a client device, one or more suggested documents from the set of similar documents;

detecting, by the one or more processors, interaction with a reference to a given document from the one or more suggested documents; and

distributing, by the one or more processors, the first document to a client device that subsequently presents the given document based on the interaction with the given document.

2. The method of claim 1 , wherein identifying the first document comprises receiving, through a graphical user interface, user input specifying the first document.

3. The method of claim 2 , further comprising:

receiving a user-specified criterion, wherein determining the set of similar documents comprises determining the set of similar documents based at least in part on the user-specified criterion.

4. The method of claim 3 , further comprising:

accepting search queries from users; and

determining, based on user interactions with documents presented responsive to the search queries, a set of concepts relevant to the documents, wherein:

determining a set of similar documents comprises determining the set of similar documents based on a match between the set of concepts and the one or more concepts of the image.

5. The method of claim 4 , further comprising:

storing interaction data based on a number of user interactions with the image;

modifying criteria used to distribute the image; and

updating the interaction data based on a number of user interaction with the image following the modification of the interaction data.

6. The method of claim 5 , wherein distributing the first document comprises distributing the first document to the client device that subsequently presents a web page having a specified concept that matches the one or more concepts of the image.

7. The method of claim 6 , wherein distributing the first document to the client device that subsequently presents the web page having a specified concept that matches the one or more concepts of the image comprises distributing the first document with a search results page presented responsive to a search query that matches the one or more concepts of the image.

8. A non-transitory computer-readable medium encoded with instructions that, when executed by a processor, cause the processor to perform operations comprising:

identifying a first document containing an image;

processing the image to determine one or more concepts of the image;

determining a set of similar documents based on a comparison of the one or more concepts of the image to stored concepts for a plurality of other documents;

suggesting, in a user interface presented at a client device, one or more suggested documents from the set of similar documents;

detecting interaction with a reference to a given document from the one or more suggested documents; and

distributing the first document to a client device that subsequently presents the given document based on the interaction with the given document.

9. The non-transitory computer-readable medium of claim 8 , wherein identifying the first document comprises receiving, through a graphical user interface, user input specifying the first document.

10. The non-transitory computer-readable medium of claim 9 , wherein the instructions cause the processor to perform operations further comprising:

receiving a user-specified criterion, wherein determining the set of similar documents comprises determining the set of similar documents based at least in part on the user-specified criterion.

11. The non-transitory computer-readable medium of claim 10 , wherein the instructions cause the processor to perform operations further comprising:

accepting search queries from users; and

determining, based on user interactions with documents presented responsive to the search queries, a set of concepts relevant to the documents, wherein:

determining a set of similar documents comprises determining the set of similar documents based on a match between the set of concepts and the one or more concepts of the image.

12. The non-transitory computer-readable medium of claim 11 , wherein the instructions cause the processor to perform operations further comprising:

storing interaction data based on a number of user interactions with the image;

modifying criteria used to distribute the image; and

updating the interaction data based on a number of user interaction with the image following the modification of the interaction data.

13. The non-transitory computer-readable medium of claim 12 , wherein distributing the first document comprises distributing the first document to the client device that subsequently presents a web page having a specified concept that matches the one or more concepts of the image.

14. The non-transitory computer-readable medium of claim 13 , wherein distributing the first document to the client device that subsequently presents the web page having a specified concept that matches the one or more concepts of the image comprises distributing the first document with a search results page presented responsive to a search query that matches the one or more concepts of the image.

15. A system, comprising:

a processor; and

a non-transitory computer-readable medium encoded with instructions that, when executed by the processor, cause the processor to perform operations comprising:

identifying a first document containing an image;

processing the image to determine one or more concepts of the image;

determining a set of similar documents based on a comparison of the one or more concepts of the image to stored concepts for a plurality of other documents;

suggesting, in a user interface presented at a client device, one or more suggested documents from the set of similar documents;

detecting interaction with a reference to a given document from the one or more suggested documents; and

distributing the first document to a client device that subsequently presents the given document based on the interaction with the given document.

16. The system of claim 15 , wherein identifying the first document comprises receiving, through a graphical user interface, user input specifying the first document.

17. The system of claim 16 , wherein the instructions cause the processor to perform operations further comprising:

receiving a user-specified criterion, wherein determining the set of similar documents comprises determining the set of similar documents based at least in part on the user-specified criterion.

18. The system of claim 17 , wherein the instructions cause the processor to perform operations further comprising:

accepting search queries from users; and

determining, based on user interactions with documents presented responsive to the search queries, a set of concepts relevant to the documents, wherein:

determining a set of similar documents comprises determining the set of similar documents based on a match between the set of concepts and the one or more concepts of the image.

19. The system of claim 18 , wherein the instructions cause the processor to perform operations further comprising:

storing interaction data based on a number of user interactions with the image;

modifying criteria used to distribute the image; and

updating the interaction data based on a number of user interaction with the image following the modification of the interaction data.

20. The system of claim 19 , wherein distributing the first document comprises distributing the first document to the client device that subsequently presents a web page having a specified concept that matches the one or more concepts of the image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2022
From: CHAN, WESLEY T.; AGARWAL, SUMIT; RANGANATH, RAMA; WISEMAN, LEORA RUTH; JINDAL, DEEPAK
To: GOOGLE INC.
Reel/Frame 060594/0617 →
CHANGE OF NAME Recorded Mar 26, 2022
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 060182/0528 →
Continuity (5)
Continuation 16205003 · Nov 29, 2018
Continuation 15399576 · Jan 5, 2017
Continuation 13301532 · Nov 21, 2011
Continuation 10880375 · Jun 30, 2004
Continuation In Part 10841835 · May 10, 2004