System and method for feature recognition and document searching based on feature recognition
A system for document searching can include a camera. The system may further include an image capturing module configured to capture a first image of a first portion of a document, a feature recognition module in communication with the image capturing module, the feature recognition module configured to determine a first feature associated with the first image, a search module configured to send search information to a server and receive a first result from a first search of a set of documents that was performed based on one or more search criteria determined based on the first feature associated with the first image, and a search interface configured to present the first result on the device.
1. A document searching system for searching documents in a mobile environment, comprising:
a server, including:
a processor;
a data store storing a set of documents; and
a non-transitory computer readable medium storing a set of computer instructions executable by the processor to:
receive first search information from a device, the first search information associated with a first image, the first image captured with a camera of the device, the first image comprising a first portion of a document;
perform a first search on the set of documents based on the first search information;
send a first result from the first search to the device, wherein the first result is presented on the device;
perform a second search of the set of documents based on second search information, the second search information derived from both the first image and a second image, the second image different than the first image and captured with the camera of the device and the second image comprising a second portion of the document;
update the first result using the second search information to form a second result; and
send the second result to the device, wherein the first result on the device is replaced with the second result.
2. The system of claim 1 , wherein the second search information was determined based on an overall feature formed by joining a first feature from the first image with a second feature from the second image.
3. The system of claim 2 , wherein the overall feature is identified using natural language processing on the first feature or second feature.
4. The system of claim 1 , wherein the first search information is based on a text feature of the first portion of the document.
5. The system of claim 1 , wherein the first search information or the second search information is based on formatting, logos, graphics, or a fingerprint associated with the first portion of the document.
6. The system of claim 1 , wherein the first result or the second result include a set of links, each link corresponding to a location in the data store for an associated document of the set of the set of documents.
7. The system of claim 1 , wherein the first image and the second image are joined to determine the second search information.
8. A method for document searching, comprising:
receiving, by a server storing a set of documents, first search information from a device, the first search information associated with a first image, the first image captured with a camera of the device, the first image comprising a first portion of a document;
performing, by the server, a first search on the set of documents based on the first search information;
the server sending a first result from the first search to the device, wherein the first result is presented on the device;
performing, by the server, a second search of the set of documents based on second search information, the second search information derived from both the first image and a second image, the second image different than the first image and captured with the camera of the device and the second image comprising a second portion of the document;
the server updating the first result using the second search information to form a second result; and
the server sending the second result to the device, wherein the first result on the device is replaced with the second result.
9. The method of claim 8 , wherein the second search information was determined based on an overall feature formed by joining a first feature from the first image with a second feature from the second image.
10. The method of claim 9 , wherein the overall feature is identified using natural language processing on the first feature or second feature.
11. The method of claim 8 , wherein the first search information is based on a text feature of the first portion of the document.
12. The method of claim 8 , wherein the first search information or the second search information is based on formatting, logos, graphics, or a fingerprint associated with the first portion of the document.
13. The method of claim 8 , wherein the first result or the second result include a set of links, each link corresponding to a location in the data store for an associated document of the set of the set of documents.
14. The method of claim 8 , wherein the first image and the second image are joined to determine the second search information.
15. A non-transitory computer readable medium, comprising instructions for:
receiving, by a server storing a set of documents, first search information from a device, the first search information associated with a first image, the first image captured with a camera of the device, the first image comprising a first portion of a document;
performing, by the server, a first search on the set of documents based on the first search information;
the server sending a first result from the first search to the device, wherein the first result is presented on the device;
performing, by the server, a second search of the set of documents based on second search information, the second search information derived from both the first image and a second image, the second image different than the first image and captured with the camera of the device and the second image comprising a second portion of the document;
the server updating the first result using the second search information to form a second result; and
the server sending the second result to the device, wherein the first result on the device is replaced with the second result.
16. The non-transitory computer readable medium of claim 15 , wherein the second search information was determined based on an overall feature formed by joining a first feature from the first image with a second feature from the second image.
17. The non-transitory computer readable medium of claim 16 , wherein the overall feature is identified using natural language processing on the first feature or second feature.
18. The non-transitory computer readable medium of claim 15 , wherein the first search information is based on a text feature of the first portion of the document.
19. The non-transitory computer readable medium of claim 15 , wherein the first search information or the second search information is based on formatting, logos, graphics, or a fingerprint associated with the first portion of the document.
20. The non-transitory computer readable medium of claim 15 , wherein the first result or the second result include a set of links, each link corresponding to a location in the data store for an associated document of the set of the set of documents.
21. The non-transitory computer readable medium of claim 15 , wherein the first image and the second image are joined to determine the second search information.