IP Library Granted Patent US 9,396,389
Granted Patent B2
US 9,396,389 · App. 14/509,188 · Granted Jul 19, 2016

Techniques for detecting user-entered check marks

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,396,389
App. No.
14/509,188
Granted
Jul 19, 2016
Kind
B2
Abstract

A digital camera associated with a mobile processing apparatus is used to produce a file containing a 2D digitized image of a document having pre-formatted fields for user's check marks. The image is electronically matched to a digital template of the document for extracting digitized images of the pre-formatted fields, which are thereafter analyzed for presence therein of user-entered check marks.

Claims (44)

1. A method of using a mobile processing apparatus to process check marks in a document having pre-formatted fields for entering the check marks, the method comprising:

using a digital camera associated with the apparatus to produce a first electronic file containing a 2D digitized image of the document; and

using the apparatus for:

(a) in the first file, detecting identifiers of the document and markers identifying location and orientation of portions containing the pre-formatted fields;

(b) producing a second file wherein the 2D digitized image is modified to match a digital template of the document;

(c) using the digital template for electronically extracting digitized images of the pre-formatted fields from the second file; and

(d) detecting presence of the check marks in the digitized images of the pre-formatted fields based on analysis therein of non-background pixels.

2. The method of claim 1 , wherein: the apparatus is a mobile phone, a mobile computing device, or a digital camera.

3. The method of claim 1 , wherein: the document is a form, a checklist, a questionnaire, or a plurality thereof; and the document is a single-page article or a multi-page article which pages are provided with selective identifiers.

4. The method of claim 1 , further comprising: using as the markers (i) pre-selected graphical symbols or graphical images, or (ii) at least a portion of the pre-formatted fields.

5. The method of claim 1 , wherein the step (b) further comprises one or more of: electronically cropping, determining page orientation, correcting perspective distortions and scaling the 2D digitized image of the document.

6. The method of claim 1 , wherein the step (c) further comprises: deleting the second file.

7. The method of claim 1 , wherein the step (d) further comprises: in the extracted digitized images (i) subtracting background pixels and determining if a number of remaining pixels exceeds a first pre-selected threshold, or (ii) determining if a ratio of non-background pixels to all pixels exceeds a second pre-selected threshold.

8. The method of claim 1 , wherein the step (d) further comprises: using the apparatus for saving, in a pre-selected format, results of detecting the detected check marks.

9. The method of claim 1 further comprising performing steps (a)-(d) for a plurality of documents having pre-formatted fields for entering the check marks.

10. The method of claim 9 further comprising accumulating data based on the check marks detected in the plurality of documents, in a pre-selected format; and analyzing the accumulated data.

11. The method of claim 1 , wherein the apparatus are coupled to resources of a computer network or a cloud computing architecture.

12. A platform for processing check marks in a document having pre-formatted fields for entering the check marks, the platform comprising:

a mobile processing apparatus associated with a digital camera adapted to produce a first file containing a 2D digitized image of the document; and

a local processor provided with hardware or software resources configured to perform:

(a) in the first file, detecting identifiers of the document and markers identifying location and orientation of portions containing the pre-formatted fields;

(b) producing a second file wherein the 2D digitized image is modified to match a digital template of the document;

(c) using the digital template for electronically extracting digitized images of the pre-formatted fields from the second file; and

(d) detecting presence of the check marks in the digitized images of the pre-formatted fields based on analysis therein of non-background pixels.

13. The platform of claim 12 , wherein: the apparatus is a mobile phone, a mobile computing device, or a digital camera;

the document is a form, a checklist, a questionnaire, or a plurality thereof;

the document is a single-page article or a multi-page article which pages are provided with selective identifiers;

the check marks are handwritten, stamped or printed check marks; and

results of detecting the check marks are saved, in a pre-selected format, using the apparatus.

14. The platform of claim 12 , wherein (i) the markers are pre-selected graphical symbols or graphical images, or (ii) at least a portion of the pre-formatted fields is used as the markers.

15. The platform of claim 12 , wherein the local is configured for one or more of electronically cropping, determining page orientation, correcting perspective distortions and scaling the 2D digitized image of the document.

16. The platform of claim 12 , wherein the apparatus are coupled to resources of a computer network or a cloud computing architecture.

17. A non-transitory medium storing processor-readable instructions for processing check marks in a document having pre-formatted fields for entering the check marks, the instructions which, responsive to execution in a mobile processing apparatus associated with a digital camera, cause the apparatus to perform:

using the camera to produce a first file containing a 2D digitized image of the document; and

selectively using the apparatus for:

(a) in the first file, detecting identifiers of the document and markers identifying location and orientation of portions containing the pre-formatted fields;

(b) producing a second file wherein the 2D digitized image is modified to match a digital template of the document;

(c) using the digital template for electronically extracting digitized images of the pre-formatted fields from the second file; and

(d) detecting presence of the check marks in the digitized images of the pre-formatted fields based on analysis therein of non-background pixels.

18. The non-transitory medium of claim 17 , wherein the instructions further cause: using as the markers (i) pre-selected graphical symbols or graphical images, or (ii) at least a portion of the pre-formatted fields.

19. The non-transitory medium of claim 17 , wherein the instructions for the step (b) further cause one or more of: electronically cropping, determining page orientation, correcting perspective distortions and scaling the 2D digitized image of the document.

20. The non-transitory medium of claim 17 , wherein the instructions for the step (c) further cause: deleting the second file.

21. The non-transitory medium of claim 17 , wherein the instructions for the step (d) further cause: in the extracted digitized images (i) subtracting background pixels and determining if a number of remaining pixels exceeds a first pre-selected threshold, or (ii) determining if a ratio of non-background pixels to all pixels exceeds a second pre-selected threshold.

22. The non-transitory medium of claim 17 , wherein the instructions for the step (d) further cause: using the apparatus for saving, in a pre-selected format, results of detecting the detected check marks.

Assignments (4)
SECURITY INTEREST Recorded Aug 14, 2023
From: ABBYY INC.; ABBYY USA SOFTWARE HOUSE INC.; ABBYY DEVELOPMENT INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 064730/0964 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 25, 2022
From: ABBYY PRODUCTION LLC
To: ABBYY DEVELOPMENT INC.
Reel/Frame 059249/0873 →
MERGER Recorded Dec 31, 2018
From: ABBYY DEVELOPMENT LLC
To: ABBYY PRODUCTION LLC
Reel/Frame 047997/0652 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2014
From: KUZNETSOV, SERGEY ANATOLYEVICH
To: ABBYY DEVELOPMENT LLC
Reel/Frame 034144/0691 →