IP Library Granted Patent US 7,809,197
Granted Patent B2
US 7,809,197 · App. 11/008,437 · Granted Oct 5, 2010

Method for automatically determining the acceptability of a digital image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,809,197
App. No.
11/008,437
Granted
Oct 5, 2010
Kind
B2
Abstract

A method for automatically determining the acceptability of an input image for a predetermined output operation, such as printing, includes the steps of: (a) identifying one or more important areas in the input image; (b) calculating a salient acceptability feature for each of the important areas; (c) determining the acceptability of the input image from the salient acceptability features of the important areas; and (d) implementing the predetermined output operation based on the acceptability of the input image determined in step (c).

Claims (40)

1. A method for automatically determining the acceptability of an input image for a predetermined output operation, said method comprising the steps of:

(a) identifying one or more important areas in the input image;

(b) calculating a salient acceptability feature for each of the important areas using image data;

(c) automatically determining the acceptability of the input image from the salient acceptability features of the important areas; and

(d) implementing the predetermined output operation based on the acceptability of the input image determined in step (c);

wherein the input image is obtained from a digital camera, steps (a)-(d) are performed in the digital camera, and the output operation implemented in step (d) includes a deletion operation, whereby an input image found to be unacceptable is deleted.

2. The method as claimed in claim 1 wherein the one or more important areas are identified in step (a) by using a measure of edge occurrence to identify edge pixels in the image.

3. The method as claimed in claim 2 wherein the one or more important areas are identified in step (a) by identifying the areas with the greatest number of edge pixels.

4. The method as claimed in claim 2 wherein the one or more important areas that are identified in step (a) includes at least an area having an edge pixel with a maximum edge gradient.

5. The method as claimed in claim 2 wherein the one or more important areas that are identified in step (a) includes at least a central area of the input image.

6. The method as claimed in claim 1 wherein the one or more important areas are identified in step (a) by detecting one or more areas in the input image where the main subject is located.

7. The method as claimed in claim 1 wherein the one or more important areas are identified in step (a) by selecting one or areas in the input image based on coordinates provided by a human operator of the digital camera.

8. The method as claimed in claim 1 , further comprising tracking the eve gaze of a user to determine eye fixations for each of one or more fixation areas in the input image, wherein the one or more important areas are identified in step (a) by detecting the one or more fixation areas in the input image that have the greatest number of eye fixations.

9. The method as claimed in claim 1 wherein the one or more important areas are identified in step (a) by algorithmically detecting one or more areas in the input image that have a human figure.

10. The method as claimed in claim 1 wherein the one or more important areas identified in step (a) comprise at least two areas of the input image.

11. The method as claimed in claim 1 wherein the salient acceptability feature is a measure of edge occurrence.

12. The method as claimed in claim 11 wherein the measure of edge occurrence is an edge density in the image data.

13. The method as claimed in claim 1 wherein the salient acceptability measure is selected from the group comprising edge occurrences, gradient values, Laplacian values, edge height values, edge width values, noise values, contrast values, color rendering values, overexposure values, and underexposure values derived from the input image.

14. The method as claimed in claim 1 wherein the step (c) of determining the acceptability of the input image from the salient acceptability features of the important areas comprises the step of using a statistical measure of the salient acceptability features over all the important areas.

15. The method as claimed in claim 14 wherein the salient acceptability feature is an edge density for each of the important areas and the statistical measure of the salient acceptability features is the mean of the edge densities over all the important areas.

16. The method as claimed in claim 1 wherein the output operation implemented in step (d) includes a printing operation, whereby an input image found to be unacceptable is not printed.

17. The method as claimed in claim 1 additionally comprising the step of suggesting to a camera user that the image be deleted and obtaining the user's approval for the deletion operation before deleting the image.

18. The method as claimed in claim 1 wherein the input image is obtained from a digital camera and the output operation implemented in step (d) includes instructing a camera operator to recapture the image.

19. The method as claimed in claim 1 wherein the output operation implemented in step (d) includes an image processing operation, whereby an input image found to be unacceptable is submitted to the image processing operation.

20. The method as claimed in claim 1 wherein step (a) comprises the steps of:

detecting edge pixels that represent edges observed in the input image;

obtaining an edge map of the edge pixels;

dividing the edge map into a plurality of blocks, where each block may contain edge pixels from the edge map;

identifying two or more blocks having the largest number of edge pixels; and

selecting two or more important areas in the input image that correspond to the two or more blocks.

21. The method as claimed in claim 20 wherein step (b) comprises the step of calculating a salient acceptability feature based upon edge occurrence in each of the important areas.

22. The method as claimed in claim 21 wherein step (c) comprises the steps of calculating a statistical measure of edge occurrence from the salient acceptability features and using the statistical measure of edge occurrence to determine the acceptability of the digital input image for printing.

23. A system for automatically determining the acceptability of an input image for a predetermined output operation, said system comprising:

an input stage for identifying one or more important areas in the input image;

a processing stage for (a) calculating a salient acceptability feature for each of the important areas using image data and (b) automatically determining the acceptability of the input image from the salient acceptability features of the important areas; and

an output stage for implementing the predetermined output operation based on the acceptability of the input image determined in the processing stage;

wherein the input image is obtained from a digital camera, the system is contained in the digital camera, and the output operation includes a deletion operation, whereby an input image found to be unacceptable is deleted.

24. The system as claimed in claim 23 wherein the input stage includes algorithms for (a) detecting edge pixels that represent edges observed in the input image; (b) obtaining an edge map of the edge pixels; (c) dividing the edge map into a plurality of blocks; (d) identifying two or more blocks having the largest number of edge pixels; and (e) selecting two or more important areas in the input image that correspond to the two or more blocks.

25. The system as claimed in claim 23 wherein the processing stage includes algorithms for (a) calculating a salient acceptability feature based upon edge occurrence in each of the important areas and (b) calculating a statistical measure of edge occurrence from the salient acceptability features and using the statistical measure of edge occurrence to determine the acceptability of the digital input image for printing.

26. The method of claim 1 , wherein step d is performed automatically.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041941/0079 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2013
From: EASTMAN KODAK COMPANY
To: INTELLECTUAL VENTURES FUND 83 LLC
Reel/Frame 030262/0750 →
PATENT RELEASE Recorded Feb 1, 2013
From: CITICORP NORTH AMERICA, INC.; WILMINGTON TRUST, NATIONAL ASSOCIATION
To: EASTMAN KODAK COMPANY; EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.; FAR EAST DEVELOPMENT LTD.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; KODAK AVIATION LEASING LLC; KODAK PHILIPPINES, LTD.; NPEC INC.; FPC INC.; KODAK IMAGING NETWORK, INC.; PAKON, INC.; QUALEX INC.; CREO MANUFACTURING AMERICA LLC
Reel/Frame 029913/0001 →
SECURITY INTEREST Recorded Feb 21, 2012
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: CITICORP NORTH AMERICA, INC., AS AGENT
Reel/Frame 028201/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2005
From: FEDOROVSKAYA, ELENA A.; NIEDERBAUMER, JAMES R., BY LORRIE CLAVER, EXECUTRIX FOR THE ESTATE OF JAMES R. NIEDERBAUMER
To: EASTMAN KODAK COMPANY
Reel/Frame 016372/0030 →