IP Library Granted Patent US 9,584,729
Granted Patent B2
US 9,584,729 · App. 14/981,759 · Granted Feb 28, 2017

Systems and methods for improving video captured using mobile devices

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,584,729
App. No.
14/981,759
Granted
Feb 28, 2017
Kind
B2
Abstract

Systems, methods, and computer program products for capturing and analyzing image data, preferably video data, are disclosed. The inventive concepts include using multiple frames of image data to generate a composite image, where the composite image may be characterized by a higher resolution than one or more of the individual frames used to generate the composite image, and/or absence of a blurred region present in one or more of the individual frames. Inventive techniques also include determining a minimum capture resolution appropriate for capturing images of particular objects for downstream processing, and optionally triggering generation of a composite image having sufficient resolution to facilitate the downstream processing in response to detecting one or more frames of image data are characterized by a resolution, and/or a region having a resolution, less than the minimum capture resolution appropriate for capturing images of those particular objects.

Claims (43)

1. A computer-implemented method, comprising:

receiving image data via a mobile device, the image data comprising a plurality of frames; and

generating a composite image based on at least two of the plurality of frames;

determining whether one or more of the frames depict an object exhibiting one or more defining characteristics; and

in response to determining one or more of the frames depict the object, setting a minimum capture resolution for capturing other objects exhibiting the one or more defining characteristics.

2. The method as recited in claim 1 , wherein the at least two of the plurality of frames are each characterized by a reduced resolution; and wherein the composite image is characterized by a higher resolution.

3. The method as recited in claim 2 ,

wherein the higher resolution is at least about 1000 pixels by about 1000 pixels.

4. The method as recited in claim 1 , wherein the at least two of the plurality of frames are each characterized by a blurred region; and

wherein the composite image is characterized by an absence of the blurred region.

5. The method as recited in claim 4 , wherein a location of the blurred region in each of the at least two of the plurality of frames is the same; and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.

6. The method as recited in claim 1 , wherein each of the at least two of the plurality of frames comprises binary image data, and the method comprising one or more of comparing and extracting data from one or more of the composite image and the at least two of the plurality of frames.

7. The method as recited in claim 6 , wherein the data comprises text characters.

8. The method as recited in claim 1 , comprising capturing the image data, wherein the image data comprise video data.

9. The method as recited in claim 1 , wherein each of the plurality of frames is characterized by a different resolution ranging from about 25 pixels by about 25 pixels to about 256 pixels by about 256 pixels.

10. The method as recited in claim 9 , comprising determining whether one or more of the frame(s) determined to depict the object satisfy one or more predetermined quality control criteria.

11. The method as recited in claim 10 , wherein the predetermined quality control criteria are selected from a group consisting of: a minimum illumination level; a maximum illumination level; a minimum illumination evenness; a minimum resolution; a minimum sharpness; a minimum projection; a glare presence; and a classification of the object.

12. The method as recited in claim 10 , comprising determining whether the one or more frames satisfying the one or more predefined control criteria correspond to a high-resolution image stored on the mobile device; and

processing the high-resolution image upon determining the one or more frames satisfying the one or more predefined control criteria correspond to the high-resolution image.

13. The method as recited in claim 1 , comprising receiving user feedback confirming or negating whether the one or more frames depict the object, wherein the minimum capture resolution is set in further response to determining the user feedback confirms the one or more frames depict the object.

14. The method as recited in claim 1 , wherein the minimum capture resolution is at least as high as a lowest resolution of the one or more frames determined to depict the object.

15. A computer program product comprising: a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a processor to:

receive image data via a mobile device, the image data comprising a plurality of frames;

generate a composite image based on at least two of the plurality of frames;

determine whether one or more of the frames depict an object exhibiting one or more defining characteristics; and

in response to determining one or more of the frames depict the object, set a minimum capture resolution for capturing other objects exhibiting the one or more defining characteristics.

16. The computer program product as recited in claim 15 , wherein the at least two of the plurality of frames are each characterized by a reduced resolution; and

wherein the composite image is characterized by a higher resolution.

17. The computer program product as recited in claim 15 , wherein the at least two of the plurality of frames are each characterized by a blurred region; and

wherein the composite image is characterized by an absence of the blurred region.

18. The computer program product as recited in claim 15 , wherein the minimum capture resolution is at least as high as a lowest resolution of the one or more frames determined to depict the object.

19. The computer program product as recited in claim 15 , wherein the at least two of the plurality of frames are each characterized by a blurred region;

wherein the composite image is characterized by an absence of the blurred region

wherein a location of the blurred region in each of the at least two of the plurality of frames is the same; and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.

20. A computer-implemented method, comprising:

receiving image data via a mobile device, the image data comprising a plurality of frames; and

generating a composite image based on at least two of the plurality of frames;

wherein the at least two of the plurality of frames are each characterized by a blurred region;

wherein the composite image is characterized by an absence of the blurred region;

wherein a location of the blurred region in each of the at least two of the plurality of frames is the same; and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: KOFAX, INC.
To: TUNGSTEN AUTOMATION CORPORATION
Reel/Frame 067428/0392 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2022
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: KAPOW TECHNOLOGIES, INC.; KOFAX, INC.
Reel/Frame 060805/0161 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A. AS COLLATERAL AGENT
Reel/Frame 060757/0565 →
SECURITY INTEREST Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 060768/0159 →
SECURITY INTEREST Recorded Jul 7, 2017
From: KOFAX, INC.
To: CREDIT SUISSE
Reel/Frame 043108/0207 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2017
From: AMTRUP, JAN W.; MA, JIYONG; MACCIOLA, ANTHONY
To: KOFAX, INC.
Reel/Frame 040976/0281 →