IP Library Granted Patent US 10,614,334
Granted Patent B2
US 10,614,334 · App. 16/402,186 · Granted Apr 7, 2020

Extraction of data from a digital image

Inventors: Henry Allan Rowley (Sunnyvale, CA); Ashok Chhabedia Popat (Menlo Park, CA); Michael Edward Jahr (San Francisco, CA); Zhifei Li (Sunnyvale, CA)
Assignee: Google LLC
G06K9/2054G06K9/00449G06K9/18G06K9/46G06K9/6267G06K9/72G06Q20/102G06K2209/01G06Q20/3567G06Q20/382
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,614,334
App. No.
16/402,186
Granted
Apr 7, 2020
Kind
B2
Abstract

Capturing information from an imprinted item comprises a computing device that receives an image of a back side of an imprinted item, the payment instrument comprising information imprinted thereon such that the imprinted information protrudes from a front side of the imprinted item and the imprinted information is indented into the back side of the imprinted item. The computing device extracts sets of characters from the image of the back side of the imprinted item based on the imprinted information indented into the back side of the imprinted item and depicted in the image of the back side of the imprinted item. The computing device applies a first character recognition application to process the sets of characters extracted from the image of the back side of the imprinted item and categorizes each of the sets of characters into one of a plurality of categories relating to the information.

Claims (59)

1. A computer-implemented method for capturing information from imprinted items, comprising:

by one or more computing devices,

receiving an image of a back side of an imprinted item;

extracting sets of characters from the image of the back side of the imprinted item based on imprinted information indented into the back side of the imprinted item; and

categorizing sets of recognized characters from a first character recognition application into one of a plurality of categories relating to information required to use data from the imprinted item.

2. The computer-implemented method of claim 1 , further comprising communicating the sets of recognized characters and the categories associated with the sets of recognized characters to a third party application.

3. The computer-implemented method of claim 1 , further comprising reversing the imprinted information from the back side of the imprinted item in connection with applying the first character recognition application.

4. The computer-implemented method of claim 1 , further comprising:

receiving an image of a front side of the imprinted item;

extracting sets of characters from the image of the front side of the imprinted item based on the imprinted information protruding from the front side of the imprinted item and depicted in the image of the front side of the imprinted item;

applying a second character recognition application to process the sets of characters extracted from the image of the front side of the imprinted item;

categorizing each of the sets of characters into one of the plurality of categories relating to information required to use data from the imprinted item;

comparing a processed set of characters from the front side of the imprinted item associated with a particular one of the categories to a processed set of characters from the back side of the imprinted item associated with the particular one of the categories; and

refining the processing of the compared sets of characters from the front side and the back side of the imprinted item based on the comparison of the compared sets of characters from the front side and the back side of the imprinted item.

5. The computer-implemented method of claim 4 , further comprising:

displaying a request for a validation or correction of at least one of the sets of characters, in response to the comparison determining that the processed set of characters from the front side of the imprinted item associated with the particular one of the categories differ from the processed set of characters from the back side of the imprinted item associated with the particular one of the categories.

6. The computer-implemented method of claim 4 , wherein the first and second character recognition applications are a same application.

7. The computer-implemented method of claim 4 , wherein the first and second character recognition applications are different.

8. The computer-implemented method of claim 1 , further comprising:

receiving an image of a front side of the imprinted item;

determining a first set of characters from the front side of the imprinted item that are in a location on the imprinted item that corresponds to a second set of characters on the back side of the imprinted item; and

combining the images of the first set of characters and the second set of characters to produce a combined set of characters,

wherein the first character recognition process is applied to the combined set of characters.

9. The computer-implemented method of claim 1 , wherein the image of back side of the imprinted item is captured by a camera operating on the one or more computing devices.

10. The computer-implemented method of claim 1 , wherein the categories comprise one or more of a user account number, a user name, an account expiration date, a phone number of an issuer of the account, and a signature of the user.

11. A computer program product, comprising:

a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to capture information from imprinted items, the computer-executable program instructions comprising instructions to:

receive an image of a back side of an imprinted item;

extract sets of characters from the image of the back side of the imprinted item based on imprinted information indented into the back side of the imprinted item; and

categorize sets of recognized characters from a first character recognition application into one of a plurality of categories relating to information required to use data from the imprinted item.

12. The computer program product of claim 11 , further comprising computer-executable program instructions to communicate the sets of recognized characters and the categories associated with the sets of recognized characters to a third party application.

13. The computer program product of claim 11 , further comprising computer-executable program instructions to receive the imprinted information from the back side of the imprinted item in connection with applying the first character recognition application.

14. The computer program product of claim 11 , further comprising computer-executable program instructions to:

receive an image of a front side of the imprinted item;

extract sets of characters from the image of the front side of the imprinted item based on the imprinted information protruding from the front side of the payment instrument and depicted in the image of the front side of the imprinted item;

apply a second character recognition application to process the sets of characters extracted from the image of the front side of the imprinted item;

categorize each of the sets of characters into one of the plurality of categories relating to information required to use data from the imprinted item;

compare a processed set of characters from the front side of the imprinted item associated with a particular one of the categories to a processed set of characters from the back side of the imprinted item associated with the particular one of the categories; and

refine the processing of the compared sets of characters from the front side and the back side of the imprinted item based on the comparison of the compared sets of characters from the front side and the back side of the imprinted item.

15. A system to select payment instruments for capturing information from imprinted items, the system comprising:

a storage resource; and

a processor communicatively coupled to the storage resource, wherein the processor executes application code instructions that are stored in the storage resource and that cause the system to:

receive an image of a back side of an imprinted item;

extract sets of characters from the image of the back side of the imprinted item based on imprinted information indented into the back side of the imprinted item; and

categorize sets of recognized characters from a first character recognition application into one of a plurality of categories relating to information required to use data from the imprinted item.

16. The system of claim 15 , the processor executing further application code instructions that are stored in the storage resource device and that cause the system to:

receive an image of a front side of the imprinted item;

extract sets of characters from the image of the front side of the imprinted item based on the imprinted information protruding from the front side of the imprinted item and depicted in the image of the front side of the imprinted item;

apply a second character recognition application to process the sets of characters extracted from the image of the front side of the imprinted item;

categorize each of the sets of characters into one of the plurality of categories relating to information required to use data from the imprinted item;

compare a processed set of characters from the front side of the imprinted item associated with a particular one of the categories to a processed set of characters from the back side of the imprinted item associated with the particular one of the categories; and

refine the processing of the compared sets of characters from the front side and the back side of the imprinted item based on the comparison of the compared sets of characters from the front side and the back side of the imprinted item.

17. The system of claim 16 , the processor executing further application code instructions that are stored in the storage resource device and that cause the system to display a request for a validation or correction of at least one of the sets of characters, in response to the comparison determining that the processed set of characters from the front side of the imprinted item associated with the particular one of the categories differ from the processed set of characters from the back side of the imprinted item associated with the particular one of the categories.

18. The system of claim 16 , wherein the first and second character recognition applications are a same application.

19. The system of claim 15 , the processor executing further application code instructions that are stored in the storage resource and that cause the system to:

receive an image of the front side of the imprinted item;

determine a first set of characters from the front side of the imprinted item that are in a location on the imprinted item that corresponds to a second set of characters on the back side of the imprinted item; and

combine the first set of characters and the second set of characters to produce an image of a combined set of characters,

wherein the first character recognition process is applied to the combined set of characters.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2019
From: ROWLEY, HENRY ALLAN; POPAT, ASHOK CHHABEDIA; JAHR, MICHAEL EDWARD; LI, ZHIFEI
To: GOOGLE INC.
Reel/Frame 049135/0331 →
ENTITY CONVERSION Recorded May 10, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 049148/0532 →