Systems and methods for performing a search based on a media content snapshot image
View Patent ↗Systems and methods are provided for performing a search based on a snapshot image captured from media content presented to a user. The snapshot image contains features of the media content that the user wishes to target for the search. A search system recognizes features of the snapshot image and creates a search query based on the snapshot image. The search query is used to identify features of the snapshot image, and search results related to the identified features are presented to the user. Supplemental data or user input received with the snapshot image may be used in analyzing and identifying features of the snapshot image.
1. A method for performing an image-based search, the method comprising:
receiving a snapshot image captured from video of media content being displayed by user equipment;
receiving supplemental data associated with the media content;
retrieving a plurality of images from a collection of searchable data by comparing the supplemental data to data associated with each image of the plurality of images;
processing visual attributes of each image of the plurality of retrieved images to determine whether at least one image of the plurality of retrieved images includes at least one recognizable feature of the snapshot image;
providing at least one first search result based on determining at least one image of the plurality of retrieved images has the at least one recognizable feature;
receiving a user request to refine the image-based search;
processing at least one new image based at least in part on the user request; and
providing at least one second search result based on the at least one new image.
2. The method of claim 1 , wherein the snapshot image contains more than one recognizable feature, and further comprising targeting at least one recognizable feature of the snapshot image based on user input.
3. The method of claim 2 , wherein the user input is received in response to a prompt presented to the user to select the recognizable features to be targeted.
4. The method of claim 1 , wherein:
the snapshot image contains more than one recognizable feature; and
the providing comprises providing a profile of information for each image of the plurality of retrieved images having the at least one recognizable feature.
5. The method of claim 4 , further comprising:
receiving a user selection of an image of the plurality of retrieved images having the at least one recognizable feature; and
providing search results related to the selected image.
6. The method of claim 1 , wherein the processing comprises comparing visual patterns of the snapshot image to visual patterns of each image of the plurality of images.
7. The method of claim 1 , wherein:
the media content is a broadcast television program; and
the supplemental data is guidance data used in an electronic program guide.
8. The method of claim 1 , further comprising:
determining a user's location; and
providing search results related to the user's location.
9. A search system for performing an image-based search, the system comprising:
processing circuitry configured to:
receive a snapshot image captured from video of media content being displayed by user equipment; and
receive supplemental data associated with the media content; and
searching circuitry responsive to the processing circuitry and configured to:
retrieve a plurality of images from a collection of searchable data by comparing the supplemental data to data associated with each image of the plurality of images;
process visual attributes of each image of the plurality of retrieved images to determine whether at least one image of the plurality of images includes at least one recognizable feature of the snapshot image;
provide at least one first search result based on determining at least one image of the plurality of retrieved images has the at least one recognizable feature;
receive a user request to refine the image-based search;
process at least one new image based at least in part on the user request; and
provide at least one second search result based on the at least one new image.
10. The system of claim 9 , wherein the snapshot image contains more than one recognizable feature, and the processing circuitry is further configured to target at least one recognizable feature of the snapshot image based on user input.
11. The system of claim 10 , wherein the user input is received by the processing circuitry in response to a prompt presented to the user to select the recognizable features to be targeted.
12. The system of claim 9 , wherein:
the snapshot image contains more than one recognizable feature; and
the searching circuitry is configured to provide a profile of information for each image of the plurality of retrieved images having the at least one recognizable feature.
13. The system of claim 12 , wherein:
the processing circuitry is further configured to receive a user selection of an image of the plurality of retrieved images having the at least one recognizable feature; and
the searching circuitry is further configured to provide search results related to the selected image.
14. The system of claim 9 , wherein the searching circuitry is configured to compare visual patterns of the snapshot image to visual patterns of each image of the plurality of images.
15. The system of claim 9 , wherein:
the media content is a broadcast television program; and
the supplemental data is guidance data used in an electronic program guide.
16. The system of claim 9 wherein:
the processing circuitry is further configured to determine a user's location; and
the searching circuitry is further configured to provide search results related to the user's location.