Image capture and identification system and process
An image-based transaction system includes a mobile device with an image sensor that is programmed to capture, via the image sensor, a video stream of a scene. The mobile device identifies a document using image characteristics from the video stream and acquires an image of at least a part of the document, and then identifies symbols in the image based on locations within the image of the document. The symbols can include alphanumeric symbols. The mobile device processes the symbols according to their type to obtain an address related to the document and the symbols and initiates a transaction associated with the identified document.
1. An image-based transaction system:
a mobile device having an image sensor, wherein the mobile device, when software in the mobile device is executed, is caused to execute operations comprising:
digitally capturing a video stream of a scene via the image sensor;
identifying a document using image characteristics from the digitally captured video stream;
automatically acquiring an image of at least part of the document in the scene;
identifying symbols, including alphanumeric symbols, in the image based on locations within the image of the document;
processing the symbols according to their symbol type;
obtaining an address related to the identified document and the processed symbols; and
initiating a transaction associated with the identified document and with the address via a server.
2. The system of claim 1 , further comprising the server.
3. The system of claim 1 , wherein the transaction comprises an on-line transaction.
4. The system of claim 1 , wherein the transaction is with an account.
5. The system of claim 4 , wherein the transaction is with a bank account.
6. The system of claim 4 , wherein the transaction is with at least one of the following types of accounts: an account liked to a user, an account linked to the mobile device, or a credit card account.
7. The system of claim 1 , wherein the document identifies an individual.
8. The system of claim 7 , wherein the mobile device further executes operations including determining identification information pertinent to the individual.
9. The system of claim 1 , wherein the document comprises a paper object or a printed media object.
10. The system of claim 1 , wherein the mobile device is further caused to execute operations comprising determining at least one of a position or an orientation of the document in the video stream.
11. The system of claim 1 , wherein the mobile device is further caused to execute operations comprising performing ongoing interactions related to the transaction.
12. The system of claim 1 , wherein the symbols include at least one of the following symbol types: text, numeric characters, a barcode, or a matrix code.
13. The system of claim 1 , wherein the mobile device comprises a portable telephone.
14. The system of claim 1 , wherein the address comprises an information address.
15. The system of claim 1 , wherein the address comprises a network address.
16. The system of claim 1 , wherein the address references pertinent information related to the document.
17. The system of claim 1 , wherein the symbols are processed based on at least one of size and nature of the symbols.
18. The system of claim 1 , wherein the mobile device is further caused to execute operations comprising decomposing the image using at least one image processing algorithm to identify the symbols.
19. The system of claim 1 , wherein the mobile device is further caused to execute operations comprising automatically acquiring the image upon identification of the document.
20. The system of claim 1 , wherein the mobile device is further caused to execute operations comprising automatically recognizing that the image is to be acquired.
21. An image-based transaction system:
a mobile device having an image sensor, wherein the mobile device, when software in the mobile device is executed, is caused to execute operations comprising:
digitally capturing a video stream of a scene via the image sensor;
identifying a document using image characteristics from the digitally captured video stream;
acquiring an image of at least part of the document in the scene;
identifying symbols, including alphanumeric symbols, in the image based on locations within the image of the document;
processing the symbols according to their symbol type;
obtaining an address related to the identified document and the processed symbols; and
initiating a transaction associated with the identified document and the address a via a server.
22. The system of claim 21 , further comprising the server.
23. The system of claim 21 , wherein the transaction comprises an on-line transaction.
24. The system of claim 21 , wherein the transaction is with an account.
25. The system of claim 24 , wherein the transaction is with a bank account.
26. The system of claim 24 , wherein the transaction is with at least one of the following types of accounts: an account liked to a user, an account linked to the mobile device, or a credit card account.
27. The system of claim 21 , wherein the document that identifies an individual.
28. The system of claim 27 , wherein the mobile device is further caused to execute operations comprising determining identification information pertinent to the individual.
29. The system of claim 21 , wherein the document comprises a paper object or a printed media object.
30. The system of claim 21 , wherein the mobile device is further caused to execute operations comprising determining at least one of a position or an orientation of the document in the video stream.
31. The system of claim 21 , wherein the mobile device is further caused to execute operations comprising performing ongoing interactions related to the transaction.
32. The system of claim 21 , wherein the symbols include at least one of the following symbol types: text, numeric characters, a barcode, or a matrix code.
33. The system of claim 21 , wherein the mobile device comprises a portable telephone.
34. The system of claim 21 , wherein the address comprises an information address.
35. The system of claim 21 , wherein the address comprises a network address.
36. The system of claim 21 , wherein the address references pertinent information related to the document.
37. The system of claim 21 , wherein the mobile device is further caused to execute operations comprising automatically acquiring the image.
38. The system of claim 37 , wherein the mobile device is further caused to execute operations comprising automatically acquiring the image upon identification of the document.
39. The system of claim 21 , wherein the mobile device is further caused to execute operations comprising automatically recognizing that the image is to be acquired.
40. A computer implemented method initiating a transaction based on an image, the method comprising:
digitally capturing, via a mobile device, a video stream of a scene via an image sensor;
identifying, via the mobile device, a document using image characteristics from the digitally captured video stream;
acquiring, via the mobile device, an image of at least part of the document in the scene;
identifying symbols, including alphanumeric, in the image based on locations within the image of the document;
processing the symbols according to their symbol type;
obtaining an address related to the identified document and the processed symbols; and
initiating a transaction associated with the identified document and the address via a server.
41. The method of claim 40 , wherein the step of acquiring the image includes automatically acquiring the image.
42. The method of claim 41 , wherein the step of acquiring the image includes automatically acquiring the image upon identification of the document.
43. The method of claim 40 , further including automatically recognizing that the image is to be acquired.
44. The method of claim 40 , wherein the transaction is with a bank account.
45. The method of claim 40 , wherein the transaction is with at least one of the following types of accounts: an account liked to a user, an account linked to the mobile device, or a credit card account.
46. The method of claim 40 , wherein the symbols include at least one of the following symbol types: text, numeric characters, a barcode, or a matrix code.
47. A computer program product, storable on a non-transitory computer readable memory, comprising software instructions that when executed by at least one processor cause the at least one processor to:
digitally capture a video stream of a scene via an image sensor;
identify a document using image characteristics from the digitally captured video stream;
acquire an image of at least part of the document in the scene;
identify symbols in the image based on locations within the image of the document;
process the symbols according to their symbol type;
obtain an address related to the identified document and the processed symbols; and
initiate a transaction associated with the identified document and the address via a server.
48. The computer program product of claim 47 , wherein the operation to acquire the image includes an operation to automatically acquire the image.
49. The computer program product of claim 48 , wherein the operation to acquire the image includes an operation to automatically acquire the image upon identification of the document.
50. The computer program product of claim 47 , further including a step to automatically recognize that the image is to be acquired.
51. The computer program product of claim 47 , wherein the transaction is with a bank account.
52. The computer program product of claim 47 , wherein the transaction is with at least one of the following types of accounts: an account liked to a user, an account linked to the mobile device, or a credit card account.
53. The computer program product of claim 47 , wherein the symbols include at least one of the following symbol types: text, numeric characters, a barcode, or a matrix code.