IP Library Granted Patent US 9,275,281
Granted Patent B2
US 9,275,281 · App. 14/804,276 · Granted Mar 1, 2016

Mobile image capture, processing, and electronic form generation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,275,281
App. No.
14/804,276
Granted
Mar 1, 2016
Kind
B2
Abstract

In various embodiments, methods, systems, and computer program products for capturing and processing digital images captured by a mobile device are disclosed. In one embodiment, a method includes capturing image data using a mobile device, the image data depicting a digital representation of a document; defining, based on the image data, a plurality of candidate edge points corresponding to the document; defining four sides of a tetragon based on at least some of the plurality of candidate edge points; determining a plurality of fields within the tetragon; for each field, determining at least a field location and a field data type; associating each determined field location with each field data type to generate a plurality of metadata labels; and associating the plurality of metadata labels with an image of an electronic form.

Claims (55)

1. A computer implemented method, comprising:

capturing image data using a mobile device, the image data depicting a digital representation of a document;

defining, using a possessor and based on the image data, a plurality of candidate edge points corresponding to the document;

defining four sides of a tetragon based on at least some of the plurality of candidate edge points;

determining a plurality of fields within the tetragon;

for each field, determining at least a field location and a field data type;

associating each determined field location with each field data type to generate a plurality of metadata labels;

associating the plurality of metadata labels with an image of an electronic form

extracting data from the tetragon; and

populating the electronic form with the extracted data.

2. The method as recited in claim 1 , wherein the electronic form is the digital representation of the document within the tetragon.

3. The method as recited in claim 1 , further comprising generating the electronic form based on the digital representation of the document within the tetragon.

4. The method as recited in claim 3 , wherein generating the electronic form comprises:

extracting the tetragon;

rectangularizing the tetragon;

rendering the rectangularized tetragon as a background layer of a digital image;

overlaying a plurality of fields on the background layer; and

associating one of the metadata labels with each of the plurality of fields based on a location of the field.

5. The method as recited in claim 1 , further comprising generating the electronic form based on an image of a standard form.

6. The method as recited in claim 1 , further comprising determining a type of the document, wherein determining the plurality of fields within the tetragon is based at least in part on the determined type of document.

7. The method as recited in claim 1 , further comprising validating the extracted data.

8. The method as recited in claim 1 , wherein the electronic form comprises a fillable printable document format (PDF) document.

9. A system, comprising: a processor configured to execute logic, the logic being configured to cause the processor to:

receive image data captured using a mobile device, the image data depicting a digital representation of a document;

define, based on the image data, a plurality of candidate edge points corresponding to the document;

define four sides of a tetragon based on at least some of the plurality of candidate edge points;

determine a plurality of fields within the tetragon;

for each field, determine at least a field location and a field data type;

associate each determined field location with each field data type to generate a plurality of metadata labels;

associate the plurality of metadata labels with an image of an electronic form

extract data from the tetragon; and

populate the electronic form with the extracted data.

10. The system as recited in claim 9 , wherein the electronic form is the digital representation of the document within the tetragon.

11. The system as recited in claim 9 , further comprising logic configured to cause the processor to generate the electronic form based on the digital representation of the document within the tetragon.

12. The system as recited in claim 11 , wherein the logic configured to cause the processor to generate the electronic form comprises logic configured to cause the processor to:

extracting the tetragon;

rectangularizing the tetragon;

rendering the rectangularized tetragon as a background layer of a digital image;

overlaying a plurality of fields on the background layer; and

associating one of the metadata labels with each of the plurality of fields based on a location of the field.

13. The system as recited in claim 9 , further comprising logic configured to cause the processor to generate the electronic form based on an image of a standard form.

14. The system as recited in claim 9 , further comprising logic configured to cause the processor to determine a type of the document, wherein determining the plurality of fields within the tetragon is based at least in part on the determined type of document.

15. The system as recited in claim 9 , further comprising logic configured to cause the processor to validate the extracted data.

16. The system as recited in claim 9 , wherein the electronic form comprises a fillable printable document format (PDF) document.

17. The system as recited in claim 16 , further comprising transmitting the PDF document via electronic mail.

18. A computer program product comprising a non-transitory computer readable medium having embodied therewith computer readable program code, the computer readable program code comprising:

computer readable program code configured to capture image data using a mobile device, the image data depicting a digital representation of a document;

computer readable program code configured to define, based on the image data, a plurality of candidate edge points corresponding to the document;

computer readable program code configured to define four sides of a tetragon based on at least some of the plurality of candidate edge points; and

computer readable program code configured to determine a plurality of fields within the tetragon;

computer readable program code configured to for each field, determine at least a field location and a field data type;

computer readable program code configured to associate each determined field location with each field data type to generate a plurality of metadata labels;

computer readable program code configured to associate the plurality of metadata labels with an image of an electronic form

extract data from the tetragon; and

populate the electronic form with the extracted data.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: KOFAX, INC.
To: TUNGSTEN AUTOMATION CORPORATION
Reel/Frame 067428/0392 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2022
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: KAPOW TECHNOLOGIES, INC.; KOFAX, INC.
Reel/Frame 060805/0161 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A. AS COLLATERAL AGENT
Reel/Frame 060757/0565 →
SECURITY INTEREST Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 060768/0159 →
SECURITY INTEREST Recorded Jul 7, 2017
From: KOFAX, INC.
To: CREDIT SUISSE
Reel/Frame 043108/0207 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2016
From: MACCIOLA, ANTHONY
To: KOFAX, INC.
Reel/Frame 037545/0142 →