IP Library Granted Patent US 9,661,216
Granted Patent B2
US 9,661,216 · App. 15/056,972 · Granted May 23, 2017

Automatic image capture

Inventors: Christopher E. Tilt (Portland, OR); Rex H. Stevens (Beavertson, OR)
H04N5/23222G06K9/186G06T1/0007H04N1/00137H04N1/00167H04N5/232H04N5/23293H04N7/18H04N2101/00H04N2201/0084H04N2201/0086
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,661,216
App. No.
15/056,972
Granted
May 23, 2017
Kind
B2
Abstract

An improved automatic image capture system for an intelligent mobile device having a camera guides a user to position the camera so only a single image needs to be automatically captured. Syntactic features, using a view finder on a display of the intelligent mobile device, are used to guide a user to maximize the occupancy of the view finder with the document so that the document is maximized within the view finder based upon detected corners of the document. When occupancy is maximized, the camera automatically captures the image of the document for post-processing using semantic knowledge of the document. A confidence level is computed based on the semantic knowledge to qualify an image with greater accuracy, and without user intervention, prior to transmission to a remote site.

Claims (62)

1. A method of automatic image capture of a target document using an intelligent mobile device having a camera comprising the steps of:

showing a view finder on a display of the intelligent mobile device and a secondary view finder of corresponding shape to the view finder;

lining up the two view finders until the secondary view finder superimposed on the view finder;

guiding a user to maximize occupancy of the view finder with an image of the target document as a first condition;

automatically capturing the target document image when the occupancy is maximized to produce a captured image; and

semantically processing the captured image to qualify the captured image for transmission to a remote site.

2. The method as recited in claim 1 further comprising the step of:

testing the target document for sufficient brightness and contrast with respect to a background for the target document prior to the capturing step.

3. The method as recited in claim 2 further comprising the step of:

determining the corners of the target document image within the view finder prior to the capturing step.

4. The method as recited in claim 3 further comprising the step of:

maximizing the occupancy of the target document image within the view finder after the corner determining step and prior to the capturing step.

5. The method as recited in claim 4 further comprising the step of:

assuring focus of the camera with respect to the target document prior to the capturing step.

6. The method as recited in claim 5 further comprising the step of checking stability of the camera with respect to the target document prior to the capturing step.

7. A method of automatic image capture of a target document using an intelligent mobile device having a camera comprising the steps of:

showing a view finder on a display of the intelligent mobile device and a secondary view finder of corresponding shape to the view finder;

lining up the two view finders until the secondary view finder superimposed on the view finder;

guiding a user to maximize occupancy of the view finder with an image of the target document as a first condition;

automatically capturing the target document image when the occupancy is maximized to produce a captured image; and

semantically processing the captured image to qualify the captured image for transmission to a remote site, wherein the semantically processing step comprising the steps of:

providing semantic knowledge of the target document within the mobile device;

by using symbol character recognition, measuring a confidence level of each symbol in the target document image based upon the semantic knowledge of the target document; and

qualifying the target document image for transmission to a remote site when an average confidence level for all the symbols achieves a specified score.

8. A method of automatic image capture of a target document using an intelligent mobile device having a camera comprising the steps of:

showing a trapezoidal view finder on a display of the intelligent mobile device and

a secondary view finder of corresponding shape to the trapezoidal view finder;

lining up the trapezoidal view finder and the secondary view finder until the secondary view finder superimposed on the trapezoidal view finder;

determining the corners of the target document image within the trapezoidal view finder using edge detection and line projection;

maximizing the target document image within the trapezoidal view finder using the determined corners;

automatically capturing the target document image for post-processing; and

semantically processing the captured image to qualify the captured image for transmission to a remote site, wherein the semantically processing step comprises the steps of:

providing semantic knowledge of the target document within the mobile device;

by using optical symbol recognition, measuring a confidence level of each symbol in the target document image based upon the semantic knowledge of the target document; and

qualifying the target document image for transmission to a remote site when an average confidence level for all the symbols achieves a specified score.

9. The method as recited in claim 8 further comprising the step of:

assuring focus of the camera with respect to the target document prior to the capturing step.

10. The method as recited in claim 9 further comprising the step of:

semantically processing the captured image to qualify the captured image for transmission to a remote site.

11. The method as recited in claim 10 wherein the semantically processing step comprises the steps of:

providing semantic knowledge of the target document within the mobile device;

by using optical character recognition, measuring a confidence level of each character in the target document image based upon the semantic knowledge of the target document; and

qualifying the target document image for transmission to a remote site when an average confidence level for all the characters achieves a specified score.

12. The method as recited in claim 8 further comprising the steps of:

modifying capture parameters when the average confidence level is less than the specified score; and

repeating the measuring and modifying steps until the specified score is achieved.

13. The method as recited in claim 8 further comprising the step of:

comparing specific symbols identified by the optical symbol recognition to expected results based upon the semantic knowledge of the test document in order to improve the average confidence level prior to transmission to the remote site.

14. The method as recited in claim 13 further comprising the steps of:

modifying capture parameters when the average confidence level is less than the specified score; and

repeating the measuring, comparing and modifying steps until the specified score is achieved.

15. The method as recited in claim 7 wherein the view finder has a trapezoidal shape.

16. The method as recited in claim 7 further comprising the step of:

testing the target document for sufficient brightness and contrast with respect to a background for the target document prior to the capturing step.

17. The method as recited in claim 16 , further comprising the step of:

determining the corners of the target document image within the view finder prior to the capturing step.

18. The method as recited in claim 16 , further comprising the step of:

maximizing the occupancy of the target document image within the view finder after the corner determining step and prior to the capturing step.

19. The method as recited in claim 18 further comprising the step of:

assuring focus of the camera with respect to the target document prior to the capturing step.

20. The method as recited in claim 19 further comprising

the step of checking stability of the camera with respect to the target document prior to the capturing step.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2026
From: NORTHWEST IP, LLC
To: CAPITAL ONE, N.A.
Reel/Frame 073927/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: STEGGALL, RICHARD; URBAN FT, INC.; IPARSE, LLC; UFT (NORTH AMERICA), LLC; URBAN FT GROUP, INC.; FINTECH IMAGING SOLUTIONS, INC.; URBAN FT CLIENT SOLUTIONS, LLC; UFT PROFESSIONAL SERVICES, LLC; X-35 FINANCIAL TECHNOLOGIES, LLC; X-35 FINTECH HOLDINGS, INC.
To: NORTHWEST IP, LLC
Reel/Frame 064088/0103 →
COURT ORDER Recorded Sep 29, 2021
From: STEVENS, REX
To: IPARSE LLC
Reel/Frame 057646/0372 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2021
From: STEVENS, REX; STEVENS, JUDY; TILT, CHRIS; PEIFFER, JEFF; HINZ, KAYLA
To: NORTHWEST IP, LLC
Reel/Frame 055449/0500 →
TRANSFER STATEMENT Recorded Feb 26, 2021
From: URBAN FT, INC.; IPARSE LLC
To: STEVENS, REX; STEVENS, JUDY; TILT, CHRIS; PEIFFER, JEFF; HINZ, KAYLA
Reel/Frame 056858/0623 →
COURT ORDER Recorded Oct 27, 2020
From: IPARSE LLC; URBAN FT, INC.
To: STEVENS, REX
Reel/Frame 054186/0378 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2020
From: IPARSE, LLC
To: URBAN FT (NORTH AMERICA), LLC
Reel/Frame 052943/0092 →
SECURITY INTEREST Recorded Jul 12, 2017
From: IPARSE, LLC; URBAN FT
To: STEVENS, REX
Reel/Frame 043176/0872 →
Continuity (3)
Continuation 13998209 · Oct 11, 2013
Continuation In Part 13136958 · Aug 16, 2011
Related Publication 20160182819A1 · Jun 23, 2016