System and method for feature recognition and document searching based on feature recognition
View Patent ↗A system for document searching can include a camera. The system may further include an image capturing module configured to capture a first image of a first portion of a document, a feature recognition module in communication with the image capturing module, the feature recognition module configured to determine a first feature associated with the first image, a search module configured to send search information to a server and receive a first result from a first search of a set of documents that was performed based on one or more search criteria determined based on the first feature associated with the first image, and a search interface configured to present the first result on the device.
1. A method for document searching, comprising:
receiving, by a server, first search information from a device, the first search information derived from a first image, the first image captured with a camera of the device, the first image comprising a first portion of a document;
performing, by the server, a first search on a set of documents based on the first search information;
the server sending a first result from the first search to the device, wherein the first result is presented on the device;
receiving, by the server, second search information from the device, the second search information derived from joining the first image and a second image, the second image captured with the camera of the device after a movement of the device, the second image comprising a second portion of the document;
performing, by the server, a second search of the set of documents based on the second search information;
the server updating the first result using the second search information to form a second result; and
the server sending the second result to the device, wherein the first result on the device is replaced with the second result.
2. The method of claim 1 , wherein the first image and the second image are joined by searching for commonly found words in different portions of the first and second search information.
3. The method of claim 1 , wherein the first image and the second image are joined by evaluating probability of text from the first image and the second image matching.
4. The method of claim 1 , wherein motion data associated with the first image and the second image is used in joining the first image with the second image.
5. The method of claim 4 , wherein at least some of the motion data is determined by an accelerometer of the device.
6. The method of claim 4 , wherein the motion data is determined algorithmically from data from the first image and the second image.
7. The method of claim 4 , wherein the motion data includes speed data or direction data.
8. The method of claim 4 , wherein the motion data includes orientation data.
9. The method of claim 1 , wherein the first search information or the second search information includes: formatting, logos, graphics, or a whitespace fingerprint.
10. The method of claim 1 , wherein the first search information or the second search information includes search terms.
11. A system for document searching, comprising:
a server having a processor and a non-transitory computer readable medium storing a set of computer instructions executable by the processor to:
receive first search information from a device, the first search information derived from a first image, the first image captured with a camera of the device, the first image comprising a first portion of a document;
perform a first search on a set of documents based on the first search information;
send a first result from the first search to the device, wherein the first result is presented on the device;
receive second search information from the device, the second search information derived from joining the first image and a second image, the second image captured with the camera of the device after a movement of the device, the second image comprising a second portion of the document;
perform a second search of the set of documents based on the second search information;
update the first result using the second search information to form a second result; and
send the second result to the device, wherein the first result on the device is replaced with the second result.
12. The system of claim 11 , wherein the first image and the second image are joined by searching for commonly found words in different portions of the first and second search information.
13. The system of claim 11 , wherein the first image and the second image are joined by evaluating probability of text from the first image and the second image matching.
14. The system of claim 11 , wherein motion data associated with the first image and the second image is used in joining the first image with the second image.
15. The system of claim 14 , wherein at least some of the motion data is determined by an accelerometer of the device.
16. The system of claim 14 , wherein the motion data is determined algorithmically from data from the first image and the second image.
17. The system of claim 14 , wherein the motion data includes speed data or direction data.
18. The system of claim 14 , wherein the motion data includes orientation data.
19. The system of claim 11 , wherein the first search information or the second search information includes: formatting, logos, graphics, or a whitespace fingerprint.
20. The system of claim 11 , wherein the first search information or the second search information includes search terms.