Image search results by seasonal time period
View Patent ↗Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for retrieving images based on a seasonal time period. In one aspect, a method includes receiving a query including image data defining an image depicting a subject. A location at which the image was captured by an image capturing device is determined. One or more additional images of the subject that were captured by an image capturing device at the identified location are identified. At least a portion of the additional images are provided in response to receiving the query.
1. A method performed by data processing apparatus, the method comprising:
receiving a query comprising image data defining an image depicting a subject;
determining a location at which the image was captured by an image capturing device;
identifying, based on the query and the location, one or more additional images of the subject that were captured by an image capturing device at the determined location, the identifying comprising:
identifying a direction in which the image capturing device that captured the image was facing at a time at which the image was captured; and
identifying, as the one or more additional images, one or more images that were captured by an image capturing device located within a threshold distance of the determined location and that was facing in a direction that is within a threshold directional tolerance of the identified direction; and
providing at least a portion of the one or more additional images in response to receiving the query.
2. The method of claim 1 , wherein determining the location at which the image was captured comprises receiving, with the query, location information specifying the location.
3. The method of claim 1 , further comprising identifying the subject of the image by:
creating a feature vector for the image, the feature vector for the image comprising content feature values, each content feature value indicating a visual characteristic of the image; and
comparing the feature vector for the image to feature vectors for a plurality of images to identify images having a feature vector similar to the feature vector of the image.
4. The method of claim 1 , further comprising:
providing a user interface object that enables a user to select a seasonal time period for image search results;
receiving a selection of a seasonal time period via the user interface object; and
identifying, as the portion of the one or more additional images, one or more images that were captured by an image capturing device during the selected seasonal time period.
5. The method of claim 4 , wherein identifying the portion of the one or more additional images comprises:
identifying, for each particular image of the one or more additional images, a seasonal time period during which the particular image was captured by an image capturing device using one or more image classification models; and
identifying, as the portion, each additional image identified as being captured during the selected seasonal time period.
6. The method of claim 5 , wherein the user interface object comprises a timeline and a slider, the slider being moveable along the timeline to select the desired seasonal time period.
7. The method of claim 6 , further comprising selecting, as the portion of the one or more additional images, images captured during a plurality of seasonal time periods.
8. A system, comprising:
a data processing apparatus;
a memory storage apparatus in data communication with the data processing apparatus, the memory storage apparatus storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:
receiving a query comprising image data defining an image depicting a subject;
determining a location at which the image was captured by an image capturing device;
identifying, based on the query and the location, one or more additional images of the subject that were captured by an image capturing device at the determined location, the identifying comprising:
identifying a direction in which the image capturing device that captured the image was facing at a time at which the image was captured; and
identifying, as the additional images, images that were captured by an image capturing device located within a threshold distance of the determined location and that was facing in a direction that is within a threshold directional tolerance of the identified direction; and
providing at least a portion of the one or more additional images in response to receiving the query.
9. The system of claim 8 , wherein determining the location at which the image was captured comprises receiving, with the query, location information specifying the location.
10. The system of claim 8 , wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising identifying the subject of the image by:
creating a feature vector for the image, the feature vector for the image comprising content feature values, each content feature value indicating a visual characteristic of the image; and
comparing the feature vector for the image to feature vectors for a plurality of images to identify images having a feature vector similar to the feature vector of the image.
11. The system of claim 8 , wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising:
providing a user interface object that enables a user to select a seasonal time period for image search results;
receiving a selection of a seasonal time period via the user interface object; and
identifying, as the portion of the one or more additional images, one or more images that were captured by an image capturing device during the selected seasonal time period.
12. The system of claim 11 , wherein identifying the portion of the one or more additional images comprises:
identifying, for each particular image of the one or more additional images, a seasonal time period during which the particular image was captured by an image capturing device using one or more image classification models; and
identifying, as the portion, each additional image identified as being captured during the selected seasonal time period.
13. The system of claim 12 , wherein the user interface object comprises a timeline and a slider, the slider being moveable along the timeline to select the desired seasonal time period.
14. The system of claim 13 , wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising selecting, as the portion of the one or more additional images, images captured during a plurality of seasonal time periods.
15. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising:
receiving a query comprising image data defining an image depicting a subject;
determining a location at which the image was captured by an image capturing device;
identifying, based on the query and the location, one or more additional images of the subject that were captured by an image capturing device at the determined location, the identifying comprising:
identifying a direction in which the image capturing device that captured the image was facing at a time at which the image was captured; and
identifying, as the additional images, images that were captured by an image capturing device located within a threshold distance of the determined location and that was facing in a direction that is within a threshold directional tolerance of the identified direction; and
providing at least a portion of the one or more additional images in response to receiving the query.
16. The non-transitory computer storage medium of claim 15 , wherein determining the location at which the image was captured comprises receiving, with the query, location information specifying the location.
17. The non-transitory computer storage medium of claim 15 , wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising identifying the subject of the image by:
creating a feature vector for the image, the feature vector for the image comprising content feature values, each content feature value indicating a visual characteristic of the image; and
comparing the feature vector for the image to feature vectors for a plurality of images to identify images having a feature vector similar to the feature vector of the image.
18. The non-transitory computer storage medium of claim 15 , wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising:
providing a user interface object that enables a user to select a seasonal time period for image search results;
receiving a selection of a seasonal time period via the user interface object; and
identifying the portion of the one or more additional images, one or more images that were captured by an image capturing device during the selected seasonal time period.
19. The non-transitory computer storage medium of claim 18 , wherein identifying the portion of the one or more additional images comprises:
identifying, for each particular image of the one or more additional images, a seasonal time period during which the particular image was captured by an image capturing device using one or more image classification models; and
identifying, as the portion, each additional image identified as being captured during the selected seasonal time period.
20. The non-transitory computer storage medium of claim 19 , wherein the user interface object comprises a timeline and a slider, the slider being moveable along the timeline to select the desired seasonal time period.