IP Library Granted Patent US 9,934,316
Granted Patent B2
US 9,934,316 · App. 13/281,440 · Granted Apr 3, 2018

Contextual search on digital images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,934,316
App. No.
13/281,440
Granted
Apr 3, 2018
Kind
B2
Abstract

A computer-implemented method of providing contextual search on digital images includes tracking a plurality of movements of a user over one or more hot-spots on a digital image in response to the user viewing a web page. The computer-implemented method also includes receiving a selected hot-spot from the user. Further, the computer-implemented method includes displaying a pop-up on the selected hot-spot. The pop-up includes a search query and search results on the hot-spot. Moreover, the computer-implemented method includes providing relevant context to the user corresponding to the search query.

Claims (58)

1. A computer-implemented method comprising:

providing, using at least one processor, a digital image in a web page for display to a user at the user's computing device, the digital image annotated with metadata comprising one or more search terms and having one or more portions of the digital image designated as user-selectable hot-spots of the digital image, each of the digital image's one or more user-selectable hot-spots being associated with a respective region of the digital image and at least one associated search term from the digital image's metadata to be used as a search query to retrieve and display initial search results comprising additional information about the digital image's content in response to user selection of one of the digital image's user-selectable hot-spots;

tracking, using the at least one processor, one or more movements of a user input device in connection with the digital image's one or more user-selectable hot-spots;

receiving, using the at least one processor, selection input indicating a user-selected hot-spot of the digital image's one or more user-selectable hot-spots;

performing, using the at least one processor and in response to receiving the selection input indicating a user-selected hot-spot, a search using the metadata associated with the user-selected hot-spot to retrieve the initial search results comprising the additional information about the digital image's content;

in response to selection, by the user, of the user-selected hot-spot, providing, using the at least one processor, a pop-up comprising a graphical user interface that displays, after receiving the selection input and performing the search, the at least one search term that is associated with the user-selected hot-spot associated with the respective region of the digital image-and that is used as a search query to retrieve the initial search results displayed by the pop-up about the digital image's content in response to the user-selected hot-spot associated with the respective region of the digital image, in further response to the selection, by the user, of the user-selected hot-spot, the pop-up further comprising one or more suggested search terms associated with the user-selected hot-spot associated with the respective region of the digital image, the one or more suggested search terms being selectable by the user to change the search query and the search results that are displayed in response to the selection input indicating the user-selected hot-spot associated with the respective region of the digital image, the pop-up further comprising recommendations derived from a number of social networks of the user.

2. The computer-implemented method of claim 1 further comprising:

providing one or more relevant advertisements corresponding to the user-selected hot-spot of the digital image's one or more user-selectable hot-spots in response to receiving the selection input indicating the user-selected hot-spot, the providing further comprising retrieving a number of links, to a number of advertisements, from the metadata annotating the digital image and corresponding to the user-selected hot-spot, each retrieved link corresponding to an advertisement associated with the user-selected hot-spot, and selecting the one or more relevant advertisements corresponding to the user-selected hot-spot and targeted to the user from the number of advertisements.

3. The computer-implemented method of claim 1 further comprising:

retrieving, by the at least one processor and in response to receiving the selection input indicating the user-selected hot-spot of the digital image's one or more user-selectable hot-spots, the at least one associated search term for the search query from the associated metadata for the user-selected hot-spot of the digital image's one or more user-selectable hot-spots; and

retrieving, by the at least one processor and in response to receiving the selection input indicating the user-selected hot-spot of the digital image's one or more user-selectable hot-spots, one or more universal resource locators (URLs) from the associated metadata for the user-selected hot-spot of the digital image's one or more user-selectable hot-spots, the one or more URLs retrieved from the metadata corresponding to the user-selected hot-spot being associated with one or more advertisements displayed in the pop-up in response to receiving the selection input indicating a user-selected hot-spot.

4. The computer-implemented method of claim 1 further comprising:

storing the metadata annotating the digital image, the stored metadata annotating the digital image comprising the one or more search terms and a link to a contextual advertisement corresponding to the search query used to retrieve the initial search results.

5. The computer-implemented method of claim 1 , further comprising:

linking each of the digital image's one or more user-selectable hot-spots with the at least one associated search term to be used as the search query to retrieve the initial search results and one or more relevant contextual advertisements corresponding to the search query.

6. The computer-implemented method of claim 1 further comprising:

analyzing, using the at least one computing device, the digital image prior to providing the digital image for display, the analyzing comprising:

scanning the digital image to identify the one or more portions of the digital image;

identifying each of the identified one or more portions of the scanned digital image as a hot-spot; and

associating metadata with each of the digital image's one or more user-selectable hot-spots, the metadata comprising the at least one associated search term and information identifying one or more advertisements.

7. The computer-implemented method of claim 6 , wherein the one or more portions comprises at least one of facial features, cloths, devices, and ornaments.

8. A non-transitory computer-readable storage medium storing thereon computer-readable instructions that when executed by a processor, cause the processor to:

provide a digital image in a web page for display to a user at the user's computing device, the digital image annotated with metadata comprising one or more search terms and having one or more portions of the digital image designated as user-selectable hot-spots of the digital image, each of the digital image's one or more user-selectable hot-spots being associated with a respective region of the digital image and at least one associated search term from the digital image's metadata to be used as a search query to retrieve and display initial search results comprising additional information about the digital image's content in response to user selection of the digital image's user-selectable hot-spots;

track one or more movements of a user input device in connection with the digital image's one or more user-selectable hot-spots;

receive selection input indicating a user-selected hot-spot of the digital image's one or more user-selectable hot-spots;

perform, in response to receiving the selection input indicating a user-selected hot-spot, a search using the metadata associated with the user-selected hot-spot to retrieve the initial search results comprising the additional information about the digital image's content;

in response to selection, by the user, of the user-selected hot-spot, provide a pop-up comprising a graphical user interface that displays, after receiving the selection input and performing the search, the at least one search term that is associated with the user-selected hot-spot associated with the respective region of the digital image and that is used as a search query to retrieve the initial search results displayed by the pop-up about the digital image's content in response to the user-selected hot-spot associated with the respective region of the digital image, in further response to selection, by the user, of the user-selected hot-spot, the pop-up further comprising one or more suggested search terms associated with the user-selected hot-spot associated with the respective region of the digital image, the one or more suggested search terms being selectable by the user to change the search query and search results that are displayed in response to the selection input indicating the user-selected hot-spot associated with the respective region of the digital image, the pop-up further comprising recommendations derived from a number of social networks of the user.

9. The medium of claim 8 , the instructions further comprising instructions to:

provide one or more advertisements relevant to the user-selected hot-spot of the digital image's one or more user-selectable hot-spots in response to receiving the selection input indicating the user-selected hot-spot, the providing further comprising retrieving a number of links, to a number of advertisements, from the metadata annotating the digital image and corresponding to the user-selected hot-spot, each retrieved link corresponding to an advertisement associated with the user-selected hot-spot, and selecting the one or more relevant advertisements corresponding to the user-selected hot-spot and targeted to the user from the number of advertisements.

10. The medium of claim 8 , the instructions further comprising instructions to:

retrieve, in response to receiving the selection input indicating the user-selected hot-spot of the digital image's one or more user-selectable hot-spots, the at least one associated search term for the search query from the associated metadata for the user-selected hot-spot of the digital image's one or more user-selectable hot-spots; and

retrieve, in response to receiving the selection input indicating the user-selected hot-spot of the digital image's one or more user-selectable hot-spots, one or more universal resource locators (URLs) from the associated metadata for the user-selected hot-spot of the digital image's one or more user-selectable hot-spots, the one or more URLs retrieved from the metadata corresponding to the user-selected hot-spot being associated with the one or more advertisements displayed in the pop-up in response to receiving the selection input indicating a user-selected hot-spot.

11. The medium of claim 8 , the instructions further comprising instructions to:

store the metadata annotating the digital image, the stored metadata annotating the digital image comprising the one or more search terms and a link to a contextual advertisement corresponding to the search query used to retrieve the initial search results.

12. The medium of claim 8 , the instructions further comprising instructions to:

link each of the digital image's one or more user-selectable hot-spots with the at least one associated search term to be used as the search query to retrieve the initial search results and the one or more relevant contextual advertisements corresponding to the search query.

13. The medium of claim 8 further comprising:

analyze the digital image prior to providing the digital image for display, the analyzing comprising:

the digital image to identify the one or more portions of the digital images;

identify each of the identified one or more portions of the scanned digital image as a hot-spot; and

associate metadata with each of the digital image's one or more user-selectable hot-spots, the metadata comprising the at least one associated search term and information identifying one or more advertisements.

14. The medium of claim 13 , wherein the one or more portions comprises at least one of facial features, cloths, devices, and ornaments.

15. A system comprising:

at least one computing device, each computing device comprising one or more processors and a storage medium for tangibly storing thereon program logic for execution by the one or more processors, the stored program logic comprising:

providing logic executed by the one or more processors for providing a digital image in a web page for display to a user at the user's computing device, the digital image annotated with metadata comprising one or more search terms and having one or more portions of the digital image designated as user-selectable hot-spots of the digital image, each of the digital image's one or more user-selectable hot-spots being associated with a respective region of the digital image and at least one associated search term from the digital image's metadata to be used as a search query to retrieve and display initial search results comprising additional information about the digital image's content in response to user selection of the digital image's user-selectable hot-spots;

tracking logic executed by the one or more processors for tracking one or more movements of a user input device in connection with the digital image's one or more user-selectable hot-spots;

receiving logic executed by the one or more processors for receiving selection input indicating a user-selected hot-spot of the digital image's one or more user-selectable hot-spots;

performing logic executed by the one or more processors for performing, in response to receiving the selection input indicating a user-selected hot-spot, a search using the metadata associated with the user-selected hot-spot to retrieve the initial search results comprising the additional information about the digital image's content;

providing logic executed by the one or more processors for providing, in response to selection, by the user, of the user-selected hot-spot, a pop-up comprising a graphical user interface that displays, after receiving the selection input and performing the search, the at least one search term that is associated with the user-selected hot-spot associated with the respective region of the digital image and that is used as a search query to retrieve the initial search results displayed by the pop-up about the digital image's content in response to the user-selected hot-spot associated with the respective region of the digital image, in further response to the selection, by the user, of the user-selected hot-spot, the pop-up further comprising one or more suggested search terms associated with the user-selected hot-spot associated with the respective region of the digital image, the one or more suggested search terms being selectable by the user to change the search query and the search results that are displayed in response to the selection input indicating the user-selected hot-spot associated with the respective region of the digital image, the pop-up further comprising recommendations derived from a number of social networks of the user.

16. The system of claim 15 , the program logic for execution by the one or more processors further comprising:

providing logic executed by the one or more processors for providing one or more advertisements relevant to the user-selected hot-spot of the digital image's one or more user-selectable hot-spots in response to receiving the selection input indicating the user-selected hot-spot, the providing logic further comprising retrieving a number of links, to a number of advertisements, from the metadata annotating the digital image and corresponding to the user-selected hot-spot, each retrieved link corresponding to an advertisement associated with the user-selected hot-spot, and selecting the one or more relevant advertisements corresponding to the user-selected hot-spot and targeted to the user from the number of advertisements.

17. The system of claim 15 , the program logic for execution by the one or more processors further comprising:

storing logic executed by the one or more processors for storing the metadata annotating the digital image, the stored metadata annotating the digital image comprising the one or more search terms and a link to a contextual advertisement corresponding to the search query used to retrieve the initial search results.

18. The system of claim 17 , the program logic for execution by the one or more processors further comprising:

analyzing logic executed by the one or more processors for analyzing the digital image prior to providing the digital image for display, the analyzing logic comprising:

scanning logic executed by the one or more processors for scanning the digital image to identify the one or more portions of the digital image;

identifying logic executed by the one or more processors for identifying each of the identified one or more portions of the scanned digital image as a hot-spot; and

associating logic executed by the one or more processors for associating metadata with each of the digital image's one or more user-selectable hot-spots, the associated metadata comprising the at least one associated search term and information identifying one or more advertisements.

Assignments (6)
PATENT SECURITY AGREEMENT (FIRST LIEN) Recorded Sep 29, 2022
From: YAHOO ASSETS LLC
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 061571/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: YAHOO AD TECH LLC (FORMERLY VERIZON MEDIA INC.)
To: YAHOO ASSETS LLC
Reel/Frame 058982/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2018
From: YAHOO HOLDINGS, INC.
To: OATH INC.
Reel/Frame 045240/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2017
From: YAHOO! INC.
To: YAHOO HOLDINGS, INC.
Reel/Frame 042963/0211 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2011
From: MOHAPATRA, SIDDHARTHA
To: YAHOO! INC.
Reel/Frame 027119/0484 →