IP Library Granted Patent US 10,440,197
Granted Patent B2
US 10,440,197 · App. 16/223,860 · Granted Oct 8, 2019

Devices and methods for enhanced image capture of documents

Inventors: Peter Horvath (Toronto, CA); Eric Paul Kaiser, Jr. (Auburn, ME); Steven Gervais (Newmarket, CA); John Jong-Suk Lee (Toronto, CA); Arun Victor Jagga (Toronto, CA)
Assignee: The Toronto-Dominion Bank
H04N1/00129G06F17/241G06K9/00449G06K9/00463G06T11/00G06T11/60H04N1/19594H04N1/32106H04N5/23229H04N5/23293H04N5/272G06K2209/01H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,440,197
App. No.
16/223,860
Granted
Oct 8, 2019
Kind
B2
Abstract

A computer-implemented method for processing images of a document is disclosed. The method includes: capturing an image of at least part of a document by a camera of an electronic device, the document having one or more data fields; determining, by the electronic device, one or more data entry items from analyzing the one or more data fields in the image; and displaying, on a display of the electronic device, aim a preview of the document including annotation overlays on the preview, each annotation overlay containing a respective one of the one or more data entry items and being displayed in association with its respective data field in the preview.

Claims (45)

1. An electronic device comprising:

a display;

a camera;

a memory storing an image capture application module; and

a processor coupled to the display, the camera and the memory, the processor being configured to:

receive an image of at least part of a document captured by the camera, the document having one or more data fields;

determine, from the image, one or more data entry items representing content of the one or more data fields; and

display, on the display, a preview of the document including annotation overlays on the preview, each annotation overlay containing a respective content of one of the one or more data entry items and being displayed in association with its respective data field in the preview.

2. The electronic device of claim 1 , wherein the processor is further configured to display, on the display, a first user interface element for initiating a first action using the one or more data entry items, the first user interface element being displayed concurrently with the preview of the document.

3. The electronic device of claim 2 , wherein the processor is further configured to:

receive a selection of the first user interface element; and

in response to receiving the selection of the first user interface element, transmit, to a remote server, at least a subset of the one or more data entry items in association with respective corresponding data fields.

4. The electronic device of claim 1 , wherein determining the one or more data entry items comprises:

identifying regions of the image corresponding to the one or more data fields;

for each of the identified regions:

detecting an image representation of a data entry item in the identified region; and

converting the image representation of the data entry item to text format.

5. The electronic device of claim 4 , wherein converting the image representation of the data entry item to text format comprises processing the image representation of the data entry item using optical character recognition.

6. The electronic device of claim 1 , wherein one or more of the annotation overlays on the preview comprise editable text fields.

7. The electronic device of claim 1 , wherein the annotation overlays associated with the one or more data entry items are positioned in predetermined regions of the preview associated with the respective corresponding data fields.

8. The electronic device of claim 7 , wherein a predetermined region of the preview associated with a data field is defined by boundaries surrounding a representation of the data field on the preview.

9. The electronic device of claim 1 , wherein an annotation overlay associated with a first one of the one or more data entry item is positioned in spaced relation to a representation of the first one data entry item on the preview.

10. The electronic device of claim 1 , wherein the preview comprises the image captured by the camera.

11. A computer-implemented method, comprising:

capturing an image of at least part of a document by a camera of an electronic device, the document having one or more data fields;

determining, by the electronic device, from the image one or more data entry items representing content of the one or more data fields; and

displaying, on a display of the electronic device, a preview of the document including annotation overlays on the preview, each annotation overlay containing a respective content of one of the one or more data entry items and being displayed in association with its respective data field in the preview.

12. The method of claim 11 , further comprising displaying, on the display, a first user interface element for initiating a first action using the one or more data entry items, the first user interface element being displayed concurrently with the preview of the document.

13. The method of claim 12 , further comprising:

receiving a selection of the first user interface element; and

in response to receiving the selection of the first user interface element, transmitting, to a remote server, at least a subset of the one or more data entry items in association with respective corresponding data fields.

14. The method of claim 13 , wherein determining the one or more data entry items comprises:

identifying regions of the image corresponding to the one or more data fields;

for each of the identified regions:

detecting an image representation of a data entry item in the identified region; and

converting the image representation of the data entry item to text format.

15. The method of claim 14 , wherein converting the image representation of the data entry item to text format comprises processing the image representation of the data entry item using optical character recognition.

16. The method of claim 11 , wherein one or more of the annotation overlays on the preview comprise editable text fields.

17. The method of claim 11 , wherein the annotation overlays associated with the one or more data entry items are positioned in predetermined regions of the preview associated with the respective corresponding data fields.

18. The method of claim 17 , wherein a predetermined region of the preview associated with a data field is defined by boundaries surrounding a representation of the data field on the preview.

19. The method of claim 11 , wherein the preview comprises the image captured by the camera.

20. A non-transitory computer-readable storage medium comprising processor-executable instructions which, when executed, configure a processor to:

receive an image of at least part of a document captured by a camera of an electronic device, the document having one or more data fields;

determine, from the image, one or more data entry items representing content of the one or more data fields in the image; and

display, on a display of the electronic device, a preview of the document including annotation overlays on the preview, each annotation overlay containing a respective content of one of the one or more data entry items and being displayed in association with its respective data field in the preview.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2018
From: HORVATH, PETER; KAISER, ERIC PAUL, JR; JAGGA, ARUN VICTOR; LEE, JOHN JONG-SUK; GERVAIS, STEVEN
To: THE TORONTO-DOMINION BANK
Reel/Frame 047950/0948 →
Continuity (2)
Continuation 15726429 · Oct 6, 2017
Related Publication 20190124213A1 · Apr 25, 2019
Cited By (24)
US 12,499,241 US 12,517,812 US 12,536,264 US 12,541,894 US 12,566,541 US 12,585,435 US 12,591,559 US 12,592,301 US 12,625,680 US 12,641,178 US 12,645,429 US 12,645,689 US 12,645,838 US 12,646,051 US 12,650,836 US 12,657,566 US 12,670,334 US 12,670,640 US 12,682,179 US 12,688,620 US 12,693,842 US 12,699,556 US 12,705,398 US 12,711,683