IP Library Granted Patent US 8,731,291
Granted Patent B2
US 8,731,291 · App. 13/624,985 · Granted May 20, 2014

Estimating the clutter of digital images

Inventors: Wei Hao (Superior, CO); Alexander C. Loui (Penfield, NY); Cathleen D. Cerosaletti (Rochester, NY)
Assignee: Eastman Kodak Company
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,731,291
App. No.
13/624,985
Granted
May 20, 2014
Kind
B2
Abstract

A method for determining an estimated clutter level of an input digital image based on an inequality index. The inequality index is determined by partitioning the input digital image into small sub-images and analyzing the sub-images to determine a set of image features. The image features are associated with a set of designated reference features, and the inequality index is determined based on the statistical variation of the reference features. The inequality index is compared to a predefined threshold to classify the input digital image as a rich-content image or a low-content image. For rich-content images, the estimated clutter level is determined responsive to a set of scene content features relating to spatial structures or semantic content of the input digital image is determined by analyzing the input digital image. For low-content images, the estimated clutter level is determined responsive to an overall luminance level.

Claims (56)

1. A method for determining an estimated clutter level of an input digital image, the method being performed at least in part using a data processor, comprising:

designating a set of reference features;

partitioning the input digital image into small sub-images;

determining a set of image features by automatically analyzing the sub-images;

associating each of the determined image features with one of the reference features;

forming a frequency distribution representing a frequency of occurrence of the associated reference features for the input digital image;

analyzing the frequency distribution to determine an inequality index, the inequality index being a measure of statistical variation of the reference features;

comparing the inequality index to a predefined threshold to classify the input digital image as a rich-content image or a low-content image;

if the input digital image is classified as a rich-content image:

analyzing the input digital image to automatically determine scene content features relating to spatial structures in the input digital image or semantic content of the input digital image; and

determining the estimated clutter level responsive to the scene content features; and

if the input digital image is classified as a low-content image:

analyzing the input digital image to automatically determine an overall luminance level; and

determining the estimated clutter level responsive to the determined overall luminance level.

2. The method of claim 1 wherein the inequality index is an entropy value.

3. The method of claim 2 wherein the entropy value is determined according to the equation:

E

=

-

k

p

k

log

(

p

k

)

where E is the entropy value, p k is a probability of occurrence of the k th reference feature, and log(•) is a logarithm function.

4. The method of claim 1 wherein the inequality index is a Gini coefficient.

5. The method of claim 4 wherein the Gini coefficient is determined according to the equation:

G

=

k

(

p

k

)

2

where G is the Gini coefficient, and p k is a probability of occurrence of the k th reference feature.

6. The method of claim 1 wherein the scene content features relating to spatial structures in the input digital image includes a scene asymmetry score providing an indication of a degree of asymmetry of scene content in the input digital image.

7. The method of claim 1 wherein the scene content features relating to spatial structures in the input digital image includes a vanishing point score determined responsive to detecting vanishing points in the input digital image.

8. The method of claim 1 wherein the scene content features relating to semantic content of the input digital image includes a depicted person score determined responsive to depicted person features relating to one or more persons depicted in the input digital image.

9. The method of claim 8 wherein the depicted person features for a depicted person includes a face location, a face size or an identity of the depicted person.

10. The method of claim 1 wherein the scene content features relating to semantic content of the input digital image includes a main subject score determined responsive to one or more main subject features relating to one or more main subjects depicted in the input digital image.

11. The method of claim 10 wherein the main subject features for a main subject include a brightness feature, a contrast feature, an edge distribution feature, a color histogram feature and an inequality index feature, a spatial location feature, a size feature or a subject type feature.

12. The method of claim 1 wherein the reference features and the determined image features are characterized by a set of feature attributes.

13. The method of claim 12 wherein the feature attributes include texture attributes and color attributes.

14. The method of claim 1 wherein a particular image feature is associated with a particular reference feature by:

determining a distance metric between the particular image feature and each of the reference features, and

designating the reference feature having the smallest distance metric to be the associated reference feature.

Assignments (13)
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 4, 2021
From: EASTMAN KODAK COMPANY
To: ALTER DOMUS (US) LLC
Reel/Frame 056733/0681 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 4, 2021
From: EASTMAN KODAK COMPANY
To: ALTER DOMUS (US) LLC
Reel/Frame 056734/0233 →
NOTICE OF SECURITY INTERESTS Recorded Mar 4, 2021
From: EASTMAN KODAK COMPANY
To: BANK OF AMERICA, N.A., AS AGENT
Reel/Frame 056984/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 4, 2021
From: EASTMAN KODAK COMPANY
To: ALTER DOMUS (US) LLC
Reel/Frame 056734/0001 →
RELEASE OF SECURITY INTEREST Recorded Jan 24, 2020
From: BARCLAYS BANK PLC
To: NPEC INC.; EASTMAN KODAK COMPANY; FAR EAST DEVELOPMENT LTD.; FPC INC.; KODAK (NEAR EAST) INC.; KODAK AMERICAS LTD.; KODAK REALTY INC.; LASER PACIFIC MEDIA CORPORATION; QUALEX INC.; KODAK PHILIPPINES LTD.
Reel/Frame 052773/0001 →
RELEASE OF SECURITY INTEREST Recorded Jul 30, 2019
From: JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: EASTMAN KODAK COMPANY; FAR EAST DEVELOPMENT LTD.; PFC, INC.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK IMAGING NETWORK, INC.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER PACIFIC MEDIA CORPORATION; PAKON, INC.; QUALEX, INC.; KODAK PHILIPPINES, LTD.; NPEC, INC.; CREO MANUFACTURING AMERICA LLC; KODAK AVIATION LEASING LLC
Reel/Frame 049901/0001 →
RELEASE OF SECURITY INTEREST Recorded Jul 22, 2019
From: JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: EASTMAN KODAK COMPANY; FAR EAST DEVELOPMENT LTD.; FPC, INC.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK IMAGING NETWORK, INC.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER PACIFIC MEDIA CORPORATION; PAKON, INC.; QUALEX, INC.; KODAK PHILIPPINES, LTD.; NPEC, INC.; CREO MANUFACTURING AMERICA LLC; KODAK AVIATION LEASING LLC
Reel/Frame 050239/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT (ABL) Recorded Sep 5, 2013
From: EASTMAN KODAK COMPANY; FAR EAST DEVELOPMENT LTD.; FPC INC.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK IMAGING NETWORK, INC.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; PAKON, INC.; QUALEX INC.; KODAK PHILIPPINES, LTD.; NPEC INC.; CREO MANUFACTURING AMERICA LLC; KODAK AVIATION LEASING LLC
To: BANK OF AMERICA N.A., AS AGENT
Reel/Frame 031162/0117 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Sep 5, 2013
From: CITICORP NORTH AMERICA, INC., AS SENIOR DIP AGENT; WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT
To: EASTMAN KODAK COMPANY; PAKON, INC.
Reel/Frame 031157/0451 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT (FIRST LIEN) Recorded Sep 5, 2013
From: EASTMAN KODAK COMPANY; FAR EAST DEVELOPMENT LTD.; FPC INC.; KODAK (NEAR EAST), INC.; KODAK IMAGING NETWORK, INC.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; PAKON, INC.; QUALEX INC.; KODAK PHILIPPINES, LTD.; NPEC INC.; CREO MANUFACTURING AMERICA LLC; KODAK AVIATION LEASING LLC; KODAK AMERICAS, LTD.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE
Reel/Frame 031158/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT (SECOND LIEN) Recorded Sep 5, 2013
From: EASTMAN KODAK COMPANY; FAR EAST DEVELOPMENT LTD.; FPC INC.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK IMAGING NETWORK, INC.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; PAKON, INC.; QUALEX INC.; KODAK PHILIPPINES, LTD.; NPEC INC.; CREO MANUFACTURING AMERICA LLC; KODAK AVIATION LEASING LLC
To: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT
Reel/Frame 031159/0001 →
PATENT SECURITY AGREEMENT Recorded Apr 1, 2013
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 030122/0235 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2012
From: HAO, WEI; LOUI, ALEXANDER C.; CEROSALETTI, CATHLEEN D.
To: EASTMAN KODAK
Reel/Frame 029370/0093 →
Continuity (1)
Related Publication 20140086487A1 · Mar 27, 2014