System and method of identifying visual objects
A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.
1. A computer-implemented method comprising:
obtaining an image;
identifying a sequence of alphanumeric characters in the image;
generating a first search query that includes the sequence of alphanumeric characters as a search term;
receiving one or more results of the first search query;
automatically generating, without receiving further user input, a second search query that includes at least a term from one or more results of the first search query as a search term;
receiving one or more results of the second search query; and
providing an output based on at least one or more results of the second search query.
2. The method of claim 1 , wherein identifying a sequence of alphanumeric characters in the image comprises:
receiving, as an output of an optical character recognition process, the alphanumeric characters.
3. The method of claim 1 , wherein generating a first search query that includes the sequence of alphanumeric characters as a search term comprises:
generating a search query that includes multiple sequences of alphanumeric characters identified from the image as search terms.
4. The method of claim 1 , wherein receiving one or more results of the first search query comprises:
receiving sequences of alphanumeric characters describing an object in the image or an entity associated with the object.
5. The method of claim 1 , wherein automatically generating, without receiving further user input, a second search query that includes at least a term from one or more results of the first search query as a search term, comprises:
identifying the term from a result of the one or more results of the first search query; and
in response to identifying the term from the result of the one or more results of the first search query, including the term in the second search query.
6. The method of claim 1 , wherein the sequence of alphanumeric characters comprise a name of an entity associated with an object in the image.
7. The method of claim 1 , wherein providing an output based on at least one or more results of the second search query comprises:
providing a search results page that includes one of more of the results of the search query.
8. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
obtaining an image;
identifying a sequence of alphanumeric characters in the image;
generating a first search query that includes the sequence of alphanumeric characters as a search term;
receiving one or more results of the first search query;
automatically generating, without receiving further user input, a second search query that includes at least a term from one or more results of the first search query as a search term;
receiving one or more results of the second search query; and
providing an output based on at least one or more results of the second search query.
9. The system of claim 8 , wherein identifying a sequence of alphanumeric characters in the image comprises:
receiving, as an output of an optical character recognition process, the alphanumeric characters.
10. The system of claim 8 , wherein generating a first search query that includes the sequence of alphanumeric characters as a search term comprises:
generating a search query that includes multiple sequences of alphanumeric characters identified from the image as search terms.
11. The system of claim 8 , wherein receiving one or more results of the first search query comprises:
receiving sequences of alphanumeric characters describing an object in the image or an entity associated with the object.
12. The system of claim 8 , wherein automatically generating, without receiving further user input, a second search query that includes at least a term from one or more results of the first search query as a search term, comprises:
identifying the term from a result of the one or more results of the first search query; and
in response to identifying the term from the result of the one or more results of the first search query, including the term in the second search query.
13. The system of claim 8 , wherein the sequence of alphanumeric characters comprise a name of an entity associated with an object in the image.
14. The system of claim 8 , wherein providing an output based on at least one or more results of the second search query comprises:
providing a search results page that includes one of more of the results of the search query.
15. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
obtaining an image;
identifying a sequence of alphanumeric characters in the image;
generating a first search query that includes the sequence of alphanumeric characters as a search term;
receiving one or more results of the first search query;
automatically generating, without receiving further user input, a second search query that includes at least a term from one or more results of the first search query as a search term;
receiving one or more results of the second search query; and
providing an output based on at least one or more results of the second search query.
16. The medium of claim 15 , wherein identifying a sequence of alphanumeric characters in the image comprises:
receiving, as an output of an optical character recognition process, the alphanumeric characters.
17. The medium of claim 15 , wherein generating a first search query that includes the sequence of alphanumeric characters as a search term comprises:
generating a search query that includes multiple sequences of alphanumeric characters identified from the image as search terms.
18. The medium of claim 15 , wherein receiving one or more results of the first search query comprises:
receiving sequences of alphanumeric characters describing an object in the image or an entity associated with the object.
19. The medium of claim 15 , wherein automatically generating, without receiving further user input, a second search query that includes at least a term from one or more results of the first search query as a search term, comprises:
identifying the term from a result of the one or more results of the first search query; and
in response to identifying the term from the result of the one or more results of the first search query, including the term in the second search query.
20. The medium of claim 15 , wherein the sequence of alphanumeric characters comprise a name of an entity associated with an object in the image.