IP Library Granted Patent US 8,515,131
Granted Patent B2
US 8,515,131 · App. 13/324,352 · Granted Aug 20, 2013

Computation of intrinsic perceptual saliency in visual environments, and applications

Inventors: Christof Koch (Seattle, WA); Laurent Itti (Los Angeles, CA)
Assignee: California Institute of Technology
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,515,131
App. No.
13/324,352
Granted
Aug 20, 2013
Kind
B2
Abstract

Detection of image salience in a visual display of an image. The image is analyzed at multiple spatial scales and over multiple feature channels to determine the likely salience of different portions of the image. One application for the system is in an advertising context. The detection may be improved by second order statistics, e.g. mean and the standard deviations of different image portions relative to other portions. Different edges may be considered as being extended edges by looking at the edges over multiple spatial scales. One set of feature channels can be optimized for use in moving images, and can detect motion or flicker. The images can be obtained over multiple spectral ranges the user can be instructed about how to maximize the saliency. This can be applied to automatically evaluate and optimize sales or advertisement displays.

Claims (14)

1. A method, comprising:

using a computer or processor to transform an image representation into a two dimensional spatial map to predict which parts in said image may be perceived as visually conspicuous by a human observer, the transforming comprising:

using the computer or processor to obtain information about the image in at least a first spectral range and a second spectral range that is a different spectral range than said first spectral range; and

using the computer or processor to correlate said information about the image in said first spectral range to information in said second spectral range, determine salient portions of the image from said correlating, without looking for specific content of the image.

2. A method as in claim 1 , wherein said analyzing comprises using said salient portions to determine an effectiveness of said image when displayed in a display medium.

3. A method as in claim 2 , wherein said analyzing comprises analyzing pixels of said image using mean pixel values.

4. A method as in claim 2 , wherein said analyzing comprises analyzing pixels on said image using second higher order statistical variations.

5. A method as in claim 2 , wherein said image comprises a single image at a single time.

6. A method as in claim 2 , wherein said image comprises a sequence of images in time representing a moving scene.

7. A method as in claim 1 , further comprising using said analyzing to optimize a display of visual information.

8. A method as in claim 1 , wherein the image is received from an image sensor.

9. A method as in claim 8 , wherein the image sensor is a multi-spectral image sensor.

10. A method as in claim 9 , wherein the multi-spectral image sensor operates in at least one of an infra-red spectrum or a visible spectrum.

11. A method as in claim 2 , wherein the display medium is at least one of an electronic display medium or a print medium.

Assignments (3)
CONFIRMATORY LICENSE Recorded Apr 9, 2012
From: CIT
To: NAVY,SECRETARY OF THE UNITED STATES OF AMERICA
Reel/Frame 028147/0728 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE ASSIGNEE, PREVIOUSLY RECORDED AT REEL 027377 FRAME 0912. Recorded Dec 20, 2011
From: KOCH, CHRISTOF; ITTI, LAURENT
To: CALIFORNIA INSTITUTE OF TECHNOLOGY
Reel/Frame 027653/0457 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2011
From: KOCH, CHRISTOF; ITTI, LAURENT
To: CALIFORNIA INSITUTE OF TECHNOLOGY
Reel/Frame 027377/0912 →
Continuity (5)
Division 11430684 · May 8, 2006
Continuation 09912225 · Jul 23, 2001
Provisional Application 60274674 · Mar 8, 2001
Provisional Application 60288724 · May 4, 2001
Related Publication 20120106850A1 · May 3, 2012