Automated document recognition, identification, and data extraction
A method for automated document recognition, identification, and data extraction is described herein. The method comprises receiving, by the processor, an image of a document associated with a user. The image is analyzed using optical character recognition to obtain image data, wherein the image data includes text zones. Based on the image data, the image is compared to one or more document templates. Based on the comparison, a document template having the highest degree of coincidence with the image is determined. The text zones of the image are associated with text zones of the document template to determine a type of data in each text zone. The data is structured into a standard format to obtain structured data.
1. A system comprising:
a processor; and
a memory communicatively coupled to the processor, the memory storing instructions executable to perform a method, the method including:
receiving an image of an identity document, the image being produced using a video stream;
recognizing a plurality of text elements in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template;
making the completed form accessible on the system;
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on the system.
2. The system of claim 1 wherein the method further includes:
ascertaining an authenticity characteristic in the image; and
providing the authenticity characteristic for biometric verification.
3. The system of claim 1 wherein the method further includes:
storing the completed form in a data store.
4. The system of claim 1 wherein the identity document is at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
5. The system of claim 1 wherein the method further includes:
improving the received image by removing blurring, adjusting brightness, and adjusting colors.
6. The system of claim 1 wherein the plurality of text elements includes at least one of: a first name, last name, address, document number, document expiration date, gender, age, state, city, zip code, and vehicle class.
7. The system of claim 1 wherein each of the plurality of templates is associated with at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
8. The system of claim 1 wherein the respective location in the image for each of the text elements includes Cartesian coordinates where the origin lies at a corner of the image.
9. The system of claim 8 wherein the respective location in the image for each of the text elements further includes a distance from another location in the image for another text element and a distance from an edge of the image, the distance determined using respective Cartesian coordinates of each of the text elements, the another text element, and the edge of the image.
10. A computer-implemented method comprising:
receiving an image of an identity document, the image being produced using a video stream;
recognizing a plurality of text in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template;
making the completed form accessible on a system;
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on a system.
11. The method of claim 10 further comprising:
ascertaining an authenticity characteristic in the image; and
providing the authenticity characteristic for biometric verification.
12. The method of claim 10 further comprising:
storing the completed form in a data store.
13. The method of claim 10 wherein the identity document is at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
14. The method of claim 10 further comprising:
improving the received image by removing blurring, adjusting brightness, and adjusting colors.
15. The method of claim 10 wherein the plurality of text elements includes at least one of: a first name, last name, address, document number, document expiration date, gender, age, state, city, zip code, and vehicle class.
16. The method of claim 10 wherein each of the plurality of templates is associated with at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
17. The method of claim 10 wherein the respective location in the image for each of the text elements includes Cartesian coordinates where the origin lies at a corner of the image.
18. The method of claim 17 wherein the respective location in the image for each of the text elements further includes a distance from another location in the image for another text element and a distance from an edge of the image, the distance determined using respective Cartesian coordinates of each of the text elements, the another text element, and the edge of the image.
19. A non-transitory computer-readable medium having a program embodied thereon, the program executable by a processor to perform a method, the method comprising:
receiving an image of an identity document, the image being produced using a video stream;
recognizing a plurality of text in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template;
making the completed form accessible on a system;
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on a system.
20. A system comprising:
a processor; and
a memory communicatively coupled to the processor, the memory storing instructions executable to perform a method, the method including:
receiving an image of an identity document, the image being produced using a video stream;
improving the image, wherein the improving includes removing blurring, adjusting brightness, and adjusting colors;
recognizing a plurality of text elements in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template; and
making the completed form accessible on the system.
21. The system of claim 20 wherein the method further includes:
ascertaining an authenticity characteristic in the image; and
providing the authenticity characteristic for biometric verification.
22. The system of claim 20 wherein the method further includes:
storing the completed form in a data store.
23. The system of claim 20 wherein the method further includes:
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on the system.
24. The system of claim 20 wherein the identity document is at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
25. The system of claim 20 wherein the plurality of text elements includes at least one of: a first name, last name, address, document number, document expiration date, gender, age, state, city, zip code, and vehicle class.
26. The system of claim 20 wherein each of the plurality of templates is associated with at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
27. The system of claim 20 wherein the respective location in the image for each of the text elements includes Cartesian coordinates where the origin lies at a corner of the image.
28. The system of claim 27 wherein the respective location in the image for each of the text elements further includes a distance from another location in the image for another text element and a distance from an edge of the image, the distance determined using respective Cartesian coordinates of each of the text elements, the another text element, and the edge of the image.
29. A system comprising:
a processor; and
a memory communicatively coupled to the processor, the memory storing instructions executable to perform a method, the method including:
receiving an image of an identity document, the image being produced using a video stream;
recognizing a plurality of text elements in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element, wherein the respective location in the image for each of the text elements includes Cartesian coordinates where the origin lies at a corner of the image and a distance from another location in the image for another text element and a distance from an edge of the image, the distance determined using respective Cartesian coordinates of each of the text elements, the another text element, and the edge of the image;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template; and
making the completed form accessible on the system.
30. The system of claim 29 wherein the method further includes:
ascertaining an authenticity characteristic in the image; and
providing the authenticity characteristic for biometric verification.
31. The system of claim 29 wherein the method further includes:
storing the completed form in a data store.
32. The system of claim 29 wherein the method further includes:
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on the system.
33. The system of claim 29 wherein the identity document is at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
34. The system of claim 29 wherein the method further includes:
improving the received image by removing blurring, adjusting brightness, and adjusting colors.
35. The system of claim 29 wherein the plurality of text elements includes at least one of: a first name, last name, address, document number, document expiration date, gender, age, state, city, zip code, and vehicle class.
36. The system of claim 29 wherein each of the plurality of templates is associated with at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
37. A computer-implemented method comprising:
receiving an image of an identity document, the image being produced using a video stream;
improving the image, wherein the improving includes removing blurring, adjusting brightness, and adjusting colors;
recognizing a plurality of text elements in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template; and
making the completed form accessible on a system.
38. The method of claim 37 further comprising:
ascertaining an authenticity characteristic in the image; and
providing the authenticity characteristic for biometric verification.
39. The method of claim 37 further comprising:
storing the completed form in a data store.
40. The method of claim 37 further comprising:
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on a system.
41. The method of claim 37 wherein the identity document is at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
42. The method of claim 37 wherein the plurality of text elements includes at least one of: a first name, last name, address, document number, document expiration date, gender, age, state, city, zip code, and vehicle class.
43. The method of claim 37 wherein each of the plurality of templates is associated with at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
44. The method of claim 37 wherein the respective location in the image for each of the text elements includes Cartesian coordinates where the origin lies at a corner of the image.
45. The method of claim 44 wherein the respective location in the image for each of the text elements further includes a distance from another location in the image for another text element and a distance from an edge of the image, the distance determined using respective Cartesian coordinates of each of the text elements, the another text element, and the edge of the image.
46. A computer-implemented method comprising:
receiving an image of an identity document, the image being produced using a video stream;
recognizing a plurality of text elements in the image using optical character recognition;
finding a document template of a plurality of templates having a high degree of coincidence with the image using a substantially rectangular shape of the image overall, at least one of the text elements, and a respective location in the image for the at least one text element, wherein the respective location in the image for each of the text elements includes Cartesian coordinates where the origin lies at a corner of the image and a distance from another location in the image for another text element and a distance from an edge of the image, the distance determined using respective Cartesian coordinates of each of the text elements, the another text element, and the edge of the image;
associating each of the text elements with a respective field of the document template using the text elements and a respective location in the image for each of the text elements;
placing at least one of the associated text elements in a respective field of a form, the respective field of the form corresponding to the respective associated field of the document template; and
making the completed form accessible on a system.
47. The method of claim 46 further comprising:
ascertaining an authenticity characteristic in the image; and
providing the authenticity characteristic for biometric verification.
48. The method of claim 46 further comprising:
storing the completed form in a data store.
49. The method of claim 46 further comprising:
placing at least one of the associated text elements in a respective field of a second form, the respective field of the second form corresponding to the respective associated field of the document template; and
making the second completed form accessible on a system.
50. The method of claim 46 wherein the identity document is at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.
51. The method of claim 46 further comprising:
improving the received image by removing blurring, adjusting brightness, and adjusting colors.
52. The method of claim 46 wherein the plurality of text elements includes at least one of: a first name, last name, address, document number, document expiration date, gender, age, state, city, zip code, and vehicle class.
53. The method of claim 46 wherein each of the plurality of templates is associated with at least one of: a government issued identity document, a student identity document, an employment identity document, a driver's license, a passport, and a travel document.