IP Library Granted Patent US 9,137,417
Granted Patent B2
US 9,137,417 · App. 14/340,460 · Granted Sep 15, 2015

Systems and methods for processing video data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,137,417
App. No.
14/340,460
Granted
Sep 15, 2015
Kind
B2
Abstract

A method includes storing raw or normalized video data in a computer accessible storage medium; analyzing portions of the video data with a first analytic engine to: determine whether the raw video data is within a first set of parameters; and generate with the first analytic engine a first set of processor settings; processing the raw or normalized video data with the first set of processor settings; and analyzing portions of the processed data with a second analytic engine to determine whether the processed data is within a second set of parameters; generating with the second analytic engine a second set of processor settings to reprocess the raw or normalized video data, sending the second set of processor settings to the first analytic engine; and reprocessing the raw or normalized video data with the first analytic engine using the second set of processor settings.

Claims (91)

1. A method, comprising:

storing raw or normalized video data from a data capture device in a computer accessible storage medium;

analyzing at least portions of the raw or normalized video data with a first analytic engine to:

determine whether the raw video data is within a first set of parameters; and

generate with the first analytic engine a first set of processor settings in response to determining the raw video data is not within the first set of parameters;

processing the raw or normalized video data with the first set of processor settings to generate processed data; and

analyzing at least portions of the processed data with a second analytic engine to determine whether the processed data is within a second set of parameters;

generating with the second analytic engine a second set of processor settings to reprocess the raw or normalized video data in response to determining the processed data is not within the second set of parameters,

sending the second set of processor settings to the first analytic engine; and

reprocessing the raw or normalized video data with the first analytic engine using the second set of processor settings, and

wherein the second set of parameters is different than the first set of parameters.

2. The method as recited in claim 1 , wherein at least one of the first set of processor settings and the second set of processor settings relate to one or more image characteristics selected from: brightness, contrast, gamma, erosion, orientation, segmentation, saturation, color rendering, resolution, warp angle, skew angle, despeckling, dilation and sequence detection.

3. The method as recited in claim 2 , wherein both of the first set of processor settings and the second set of processor settings relate to the one or more image characteristics selected from: brightness, contrast, gamma, erosion, orientation, segmentation, saturation, color rendering, resolution, warp angle, skew angle, despeckling, dilation and sequence detection.

4. The method as recited in claim 1 , wherein the second set of parameters comprises a predetermined metric.

5. The method as recited in claim 1 , further comprising: sending metadata relating to the raw or normalized video data to the first analytic engine.

6. The method as recited in claim 5 , wherein the metadata are sent to the first analytic engine with the second set of processor settings.

7. The method as recited in claim 5 , wherein the processing is further based at least in part on the metadata.

8. The method as recited in claim 5 , wherein the reprocessing is further based at least in part on the metadata.

9. The method as recited in claim 5 , further comprising storing the metadata in the computer accessible storage medium, the metadata relating to one or more of the raw or normalized video data and the processed data.

10. The method as recited in claim 5 , wherein the metadata comprise one or more of:

a tag identifying the stored raw or normalized video data;

a tag identifying a subsection of the stored raw or normalized video data;

a tag identifying a storage location of the stored raw or normalized video data;

an acquisition timestamp corresponding to the stored raw or normalized video data;

a sequence number;

an indicator corresponding to a beginning of a video data band;

an indicator corresponding to an end of the video data band; and

a pointer corresponding to a second video data band.

11. The method as recited in claim 5 , further comprising displaying the metadata and video data relating to the metadata; and

receiving user input relating to one or more of the displayed metadata and the displayed video data relating to the metadata.

12. The method as recited in claim 1 , wherein at least one of the analyzing at least portions of the raw or normalized video data with the first analytic engine and the analyzing at least portions of the processed data with the second analytic engine comprises performing one or more analyses selected from:

page boundary detection;

streak detection;

page border detection;

page border shadow detection;

blank page detection;

color representation conversion;

luminescence measurement;

grayscale intensity histogram analysis;

color intensity histogram analysis;

geometric analysis; and

textual orientation analysis.

13. The method as recited in claim 1 , wherein at least one of the analyzing at least portions of the raw or normalized video data with the first analytic engine and the analyzing at least portions of the processed data with the second analytic engine comprises performing one or more analyses selected from:

streak detection;

blank page detection;

shadow detection;

color representation conversion;

luminescence measurement;

grayscale intensity histogram analysis; and

color intensity histogram analysis.

14. The method as recited in claim 1 , wherein the processing comprises applying at least one of a detection orientation algorithm, a detect bleed-through algorithm, a background smoothing algorithm, and a detection of scanned page boundaries algorithm.

15. The method as recited in claim 1 , wherein the reprocessing comprises applying at least one of a detection orientation algorithm, a detect bleed-through algorithm, a background smoothing algorithm, and a detection of scanned page boundaries algorithm.

16. A method, comprising:

invoking an image capture interface via a mobile device, the capture interface comprising a viewfinder represented on a display of the mobile device;

analyzing a plurality of frames of video data captured via the capture interface, wherein the analyzing comprises determining:

whether an object exhibiting one or more defining characteristics is depicted within the viewfinder; and

whether the object depicted within the viewfinder satisfies one or more predetermined quality control criteria; and

in response to determining a frame fails one or more of the predetermined quality control criteria, displaying an indication of the frame failure on the mobile device display; and

in response to determining the object depicted within the viewfinder satisfies the one or more predetermined quality control criteria, one or more of:

displaying an indication that the object depicted in the viewfinder exhibits the one or more defining characteristics;

automatically capturing an image of the object, wherein the image is characterized by a resolution higher than a resolution of the video data; and

automatically storing one or more of the frames to a memory, the frame(s) being frame(s) in which the object satisfying the predetermined quality control criteria is depicted in the viewfinder.

17. The method as recited in claim 16 , further comprising processing at least one of the automatically captured image and the automatically stored frame(s) at least in part using a processor of the mobile device, wherein the processing comprises one or more of:

tracking the object depicted within the viewfinder in real-time

classifying the object depicted within the viewfinder; and

extracting data from the object depicted in the viewfinder.

18. The method as recited in claim 17 , wherein the processing comprises simultaneously tracking a multiple pages across multiple of the frames.

19. A system, comprising:

a processor; and

logic in and/or executable by the processor, the logic being configured to cause the processor to:

store raw or normalized video data from a data capture device in a computer accessible storage medium;

analyze at least portions of the raw or normalized video data with a first analytic engine to:

determine whether the raw video data is within a first set of parameters; and

generate with the first analytic engine a first set of processor settings in response to determining the raw video data is not within the first set of parameters;

process the raw or normalized video data with the first set of processor settings to generate processed data; and

analyze at least portions of the processed data with a second analytic engine to determine whether the processed data is within a second set of parameters;

generate with the second analytic engine a second set of processor settings to reprocess the raw or normalized video data in response to determining the processed data is not within the second set of parameters,

send the second set of processor settings to the first analytic engine; and

reprocess the raw or normalized video data with the first analytic engine using the second set of processor settings, and

wherein the second set of parameters is different than the first set of parameters.

20. A computer program product comprising a non-transitory computer-readable storage medium having embodied thereon computer readable program code, the computer readable program code being executable by a processor, and configured to cause the processor to:

store raw or normalized video data from a data capture device in a computer accessible storage medium;

analyze at least portions of the raw or normalized video data with a first analytic engine to:

determine whether the raw video data is within a first set of parameters; and

generate with the first analytic engine a first set of processor settings in response to determining the raw video data is not within the first set of parameters;

process the raw or normalized video data with the first set of processor settings to generate processed data; and

analyze at least portions of the processed data with a second analytic engine to determine whether the processed data is within a second set of parameters;

generate with the second analytic engine a second set of processor settings to reprocess the raw or normalized video data in response to determining the processed data is not within the second set of parameters,

send the second set of processor settings to the first analytic engine; and

reprocess the raw or normalized video data with the first analytic engine using the second set of processor settings, and

wherein the second set of parameters is different than the first set of parameters.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: KOFAX, INC.
To: TUNGSTEN AUTOMATION CORPORATION
Reel/Frame 067428/0392 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2022
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: KAPOW TECHNOLOGIES, INC.; KOFAX, INC.
Reel/Frame 060805/0161 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A. AS COLLATERAL AGENT
Reel/Frame 060757/0565 →
SECURITY INTEREST Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 060768/0159 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2017
From: MACCIOLA, ANTHONY; AMTRUP, JAN W.; MA, JIYONG; BORREY, ROLAND G.; SCHMIDTLER, MAURITIUS A.R.; ASURI, HARI S.; FECHTER, JOEL S.; TAYLOR, ROBERT A., MR.
To: KOFAX, INC.
Reel/Frame 043148/0556 →
SECURITY INTEREST Recorded Jul 7, 2017
From: KOFAX, INC.
To: CREDIT SUISSE
Reel/Frame 043108/0207 →
RELEASE OF SECURITY INTEREST Recorded May 26, 2015
From: BANK OF AMERICA, N.A.
To: KOFAX, INC.; ATALASOFT, INC.; KAPOW TECHNOLOGIES, INC.
Reel/Frame 035773/0930 →
SECURITY INTEREST Recorded Oct 29, 2014
From: KOFAX, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 034063/0057 →