IP Library Granted Patent US 10,318,835
Granted Patent B2
US 10,318,835 · App. 15/915,054 · Granted Jun 11, 2019

Extraction of data from a digital image

Inventors: Henry Allan Rowley (Sunnyvale, CA); Ashok Chhabedia Popat (Menlo Park, CA); Michael Edward Jahr (San Francisco, CA); Zhifei Li (Sunnyvale, CA)
Assignee: GOOGLE LLC
G06K9/2054G06K9/00449G06K9/18G06K9/46G06K9/6267G06K9/72G06Q20/102G06K2209/01G06Q20/3567G06Q20/382
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,318,835
App. No.
15/915,054
Granted
Jun 11, 2019
Kind
B2
Abstract

Capturing information from an imprinted item comprises a computing device that receives an image of a back side of an imprinted item, the payment instrument comprising information imprinted thereon such that the imprinted information protrudes from a front side of the imprinted item and the imprinted information is indented into the back side of the imprinted item. The computing device extracts sets of characters from the image of the back side of the imprinted item based on the imprinted information indented into the back side of the imprinted item and depicted in the image of the back side of the imprinted item. The computing device applies a first character recognition application to process the sets of characters extracted from the image of the back side of the imprinted item and categorizes each of the sets of characters into one of a plurality of categories relating to the information.

Claims (60)

1. A computer-implemented method for capturing information from imprinted items, comprising:

receiving, using one or more computing devices, an image of a back side of an imprinted item, the imprinted item comprising information imprinted thereon such that the imprinted information protrudes from a front side of the imprinted item and the imprinted information is indented into the back side of the imprinted item;

extracting, using the one or more computing devices, sets of characters from the image of the back side of the imprinted item based on the imprinted information indented into the back side of the imprinted item and depicted in the image of the back side of the imprinted item;

applying, using the one or more computing devices, a first character recognition application to process the sets of characters extracted from the image of the back side of the imprinted item; and

categorizing, using the one or more computing devices, each of the sets of characters into one of a plurality of categories relating to information required to use data from the imprinted item.

2. The computer-implemented method of claim 1 , further comprising communicating, using the one or more computing devices, the sets of characters and the categories associated with the sets of characters to a third party application.

3. The computer-implemented method of claim 1 , further comprising reversing, using the one or more computing devices, the imprinted information from the back side of the imprinted item in connection with applying the first character recognition application.

4. The computer-implemented method of claim 1 , further comprising:

receiving, using the one or more computing devices, an image of a front side of the imprinted item;

extracting, using the one or more computing devices, sets of characters from the image of the front side of the imprinted item based on the imprinted information protruding from the front side of the imprinted item and depicted in the image of the front side of the imprinted item;

applying, using the one or more computing devices, a second character recognition application to process the sets of characters extracted from the image of the front side of the imprinted item;

categorizing, using the one or more computing devices, each of the sets of characters into one of the plurality of categories relating to information required to use data from the imprinted item;

comparing, using the one or more computing devices, a processed set of characters from the front side of the imprinted item associated with a particular one of the categories to a processed set of characters from the back side of the imprinted item associated with the particular one of the categories; and

refining, using the one or more computing devices, the processing of the compared sets of characters from the front side and the back side of the imprinted item based on the comparison of the compared sets of characters from the front side and the back side of the imprinted item.

5. The computer-implemented method of claim 4 , further comprising:

displaying, using the one or more computing devices, a request for a validation or correction of at least one of the sets of characters, in response to the comparison determining that the processed set of characters from the front side of the imprinted item associated with the particular one of the categories differ from the processed set of characters from the back side of the imprinted item associated with the particular one of the categories.

6. The computer-implemented method of claim 4 , wherein the first and second character recognition applications are a same application.

7. The computer-implemented method of claim 4 , wherein the first and second character recognition applications are different.

8. The computer-implemented method of claim 1 , further comprising:

receiving, using the one or more computing devices, an image of the front side of the imprinted item;

determining, using the one or more computing devices, a first set of characters from the front of the imprinted item that are in a location on the imprinted item that corresponds to a second set of characters on the back side of the imprinted item; and

combining, using the one or more computing devices, the images of the first set of characters and the second set of characters to produce a combined set of characters,

wherein the first character recognition process is applied to the combined set of characters.

9. The computer-implemented method of claim 1 , wherein the image of back side of the imprinted item is captured by a camera operating on the one or more computing devices.

10. The computer-implemented method of claim 1 , wherein the categories comprise one or more of a user account number, a user name, an account expiration date, a phone number of an issuer of the account, and a signature of the user.

11. A computer program product, comprising:

a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to capture information from imprinted items, the computer-executable program instructions comprising:

computer-executable program instructions to receive an image of a back side of an imprinted item, the imprinted item comprising information imprinted thereon such that the imprinted information protrudes from a front side of the imprinted item and the imprinted information is indented into the back side of the imprinted item;

computer-executable program instructions to extract sets of characters from the image of the back side of the imprinted item based on the imprinted information indented into the back side of the imprinted item and depicted in the image of the back side of the imprinted item;

computer-executable program instructions to apply a first character recognition application to process the sets of characters extracted from the image of the back side of the imprinted item; and

computer-executable program instructions to categorize each of the sets of characters into one of a plurality of categories relating to information required to use data from the imprinted item.

12. The computer program product of claim 11 , further comprising computer-executable program instructions to communicate the sets of characters and the categories associated with the sets of characters to a third party application.

13. The computer program product of claim 11 , further comprising computer-executable program instructions to reverse the imprinted information from the back side of the imprinted item in connection with applying the first character recognition application.

14. The computer program product of claim 11 , further comprising:

computer-executable program instructions to receive an image of a front side of the imprinted item;

computer-executable program instructions to extract sets of characters from the image of the front side of the imprinted item based on the imprinted information protruding from the front side of the imprinted item and depicted in the image of the front side of the imprinted item;

computer-executable program instructions to apply a second character recognition application to process the sets of characters extracted from the image of the front side of the imprinted item;

computer-executable program instructions to categorize each of the sets of characters into one of the plurality of categories relating to information required to use data from the imprinted item;

computer-executable program instructions to compare a processed set of characters from the front side of the imprinted item associated with a particular one of the categories to a processed set of characters from the back side of the imprinted item associated with the particular one of the categories; and

computer-executable program instructions to refine the processing of the compared sets of characters from the front side and the back side of the imprinted item based on the comparison of the compared sets of characters from the front side and the back side of the imprinted item.

15. A system for capturing information from imprinted items, the system comprising:

a storage resource; and

a processor communicatively coupled to the storage resource, wherein the processor executes application code instructions that are stored in the storage resource and that cause the system to:

receive an image of a back side of an imprinted item, the imprinted item comprising information imprinted thereon such that the imprinted information protrudes from a front side of the imprinted item and the imprinted information is indented into the back side of the imprinted item;

extract sets of characters from the image of the back side of the imprinted item based on the imprinted information indented into the back side of the imprinted item and depicted in the image of the back side of the imprinted item;

apply a first character recognition application to process the sets of characters extracted from the image of the back side of the imprinted item; and

categorize each of the sets of characters into one of a plurality of categories relating to information required to use data from the imprinted item.

16. The system of claim 15 , the processor executing further application code instructions that are stored in the storage device and that cause the system to:

receive an image of a front side of the imprinted item;

extract sets of characters from the image of the front side of the imprinted item based on the imprinted information protruding from the front side of the imprinted item and depicted in the image of the front side of the imprinted item;

apply a second character recognition application to process the sets of characters extracted from the image of the front side of the imprinted item;

categorize each of the sets of characters into one of the plurality of categories relating to information required to use data from the imprinted item;

compare a processed set of characters from the front side of the imprinted item associated with a particular one of the categories to a processed set of characters from the back side of the imprinted item associated with the particular one of the categories; and

refine the processing of the compared sets of characters from the front side and the back side of the imprinted item based on the comparison of the compared sets of characters from the front side and the back side of the imprinted item.

17. The system of claim 16 , the processor executing further application code instructions that are stored in the storage device and that cause the system to display a request for a validation or correction of at least one of the sets of characters, in response to the comparison determining that the processed set of characters from the front side of the imprinted item associated with the particular one of the categories differ from the processed set of characters from the back side of the imprinted item associated with the particular one of the categories.

18. The system of claim 16 , wherein the first and second character recognition applications are a same application.

19. The system of claim 16 , the processor executing further application code instructions that are stored in the storage device and that cause the system to:

receive an image of the front side of the imprinted item;

determine a first set of characters from the front of the imprinted item that are in a location on the imprinted item that corresponds to a second set of characters on the back side of the imprinted item; and

combine the first set of characters and the second set of characters to produce an image of a combined set of characters, wherein the first character recognition process is applied to the combined set of characters.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2018
From: ROWLEY, HENRY ALLAN; POPAT, ASHOK CHHABEDIA; JAHR, MICHAEL EDWARD; LI, ZHIFEI
To: GOOGLE INC.
Reel/Frame 045829/0816 →
CHANGE OF NAME Recorded May 17, 2018
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 046173/0799 →
Continuity (3)
Continuation 14743455 · Jun 18, 2015
Continuation 13798026 · Mar 12, 2013
Related Publication 20180239983A1 · Aug 23, 2018