IP Library Granted Patent US 8,154,615
Granted Patent B2
US 8,154,615 · App. 12/495,411 · Granted Apr 10, 2012

Method and apparatus for image display control according to viewer factors and responses

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,154,615
App. No.
12/495,411
Granted
Apr 10, 2012
Kind
B2
Abstract

A device and system and a method for selecting and displaying images in accordance with attention responses of an image viewer. An image capture device captures a viewer image of a spatial region potentially containing a viewer of the image display device and a viewer detection mechanism analyzes the viewer image and determines whether a potential viewer is observing the display screen. A gaze pattern analysis mechanism identifies a viewer response to a currently displayed image by analysis of the viewer's emotional response as revealed by the viewer's facial expression and other sensory inputs, and the selection of an image to be displayed is then modified in accordance with the indicated viewer's attention response.

Claims (46)

1. An image display mechanism for controlling the display of images on an image display device in accordance with attention characteristics of a viewer to a displayed image, comprising:

an image control mechanism for:

determining attention characteristics for the viewer to a currently displayed image on the image display device;

classifying the attention characteristics as exogenous attention or endogenous attention; and

controlling the display of one or more images on the image display device responsive to whether the attention characteristics are exogenous attention or endogenous attention.

2. The image display mechanism of claim 1 , wherein the image control mechanism comprises:

an image capture device for capturing at least one viewer image in a spatial region potentially containing a viewer of the image display device;

a viewer detection mechanism for analyzing the at least one viewer image and determining whether a viewer of the image display screen is present in the spatial region; and

a line of vision process for determining whether a viewer present in the spatial region is gazing at the image display screen;

and wherein the attention characteristics for the viewer are determined include an indication of whether the viewer present in the spatial region is gazing at the image display screen.

3. The image display mechanism of claim 1 , wherein the image control mechanism comprises:

a gaze pattern analysis mechanism for determining a gaze pattern for a viewer gazing at the image display screen;

and wherein the attention characteristics for the viewer include the determined gaze pattern.

4. The image display mechanism of claim 1 , wherein:

the display of the one or more images is controlled by modifying at least one image, by controlling the timing between the display of successive images, by controlling the transitions between images, by controlling the display sequence for a set of images, by adding sound accompaniment or by controlling the selection of an image or a set of images from an image library.

5. The image display mechanism of claim 1 , wherein the attention characteristics for the viewer are determined based on the changes in the viewer's facial features, body language characteristics, vocal or verbal reactions, gaze pattern, or combinations thereof,

in response to the content of the currently displayed image.

6. The image display mechanism of claim 2 , further comprising:

a viewer facial library for storing facial features of at least one user, and

a viewer identification mechanism for extracting viewer facial features from the viewer image and comparing the viewer facial features from the viewer image with the facial features for the at least one user, and

wherein when the viewer identification mechanism identifies a correspondence between the viewer facial features extracted from the viewer image and the facial features for a particular user, the display of the one or more images is controlled by selecting at least one image to be displayed from an image set associated with the particular user.

7. The image display mechanism of claim 6 , wherein the image set associated with the particular user contains imaged subjects that correspond in a predefined manner with the particular user.

8. The image display mechanism of claim 7 , wherein:

personalized content associated with the particular user is displayed on the image display device.

9. A method for controlling the display of images in accordance with attention characteristics of a viewer, comprising the steps of:

displaying at least one image from an image library on an image display device,

determining attention characteristics for the viewer to the displayed at least one image;

classifying the attention characteristics as exogenous attention or endogenous attention; and

controlling the display of one or more images on the image display device responsive to whether the attention characteristics are exogenous attention or endogenous attention.

10. The method of claim 9 wherein the control of the display of one or more images on the image display device is also responsive to an analysis of a displayed image being viewed by the viewer.

11. The method of claim 9 , further comprising the steps of:

capturing at least one viewer image of a spatial region potentially containing a viewer of the image display device,

analyzing the at least one viewer image and determining whether a viewer of the image display screen is present in the spatial region,

determining whether the spatial region includes a region identifiable as a face,

determining whether the viewer present in the spatial region is observing the image display screen, and

determining a gaze pattern for the viewer present in the spatial region and observing the image display screen and wherein the control of the display of the one or more images on the image display device is further responsive to the determined gaze pattern.

12. The method of claim 9 wherein the control of the display of the one or more images includes:

modifying the selection of images from the image library in accordance with the determined gaze pattern.

13. The method of claim 11 wherein the classification of the attention characteristics as exogenous attention or endogenous attention is made according to-predefined data stored in a data storage medium of exogenous or endogenous attention.

14. The method of claim 9 wherein the display of the one or more images is controlled by modifying image data for at least one image, by controlling the timing between the display of successive images, by controlling the transitions between images, by controlling the display sequence for a set of images, by adding sound accompaniment or by controlling the selection of an image or a set of images from an image library.

15. The method of claim 9 wherein the control of the display of the one or more images includes, selecting an image having a predetermined relationship to the current image in accordance with the attention characteristics.

16. The method of claim 9 , further comprising the steps of:

accessing a viewer facial library for storing facial features of at least one user, and

extracting viewer facial features from the viewer image and identifying a user by comparing the viewer facial features from the viewer image with the facial features for the at least one user;

selecting or modifying at least one next image associated with the identified user.

17. The method of claim 16 , further comprising the steps of selecting images to be displayed from an image set corresponding to image subjects having a predetermined association with the user.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041941/0079 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2013
From: EASTMAN KODAK COMPANY
To: INTELLECTUAL VENTURES FUND 83 LLC
Reel/Frame 030264/0522 →
PATENT RELEASE Recorded Feb 1, 2013
From: CITICORP NORTH AMERICA, INC.; WILMINGTON TRUST, NATIONAL ASSOCIATION
To: EASTMAN KODAK COMPANY; EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.; FAR EAST DEVELOPMENT LTD.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; KODAK AVIATION LEASING LLC; KODAK PHILIPPINES, LTD.; NPEC INC.; FPC INC.; KODAK IMAGING NETWORK, INC.; PAKON, INC.; QUALEX INC.; CREO MANUFACTURING AMERICA LLC
Reel/Frame 029913/0001 →
SECURITY INTEREST Recorded Feb 21, 2012
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: CITICORP NORTH AMERICA, INC., AS AGENT
Reel/Frame 028201/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2009
From: FEDOROVSKAYA, ELENA A.; NEUSTAEDTER, CARMAN G.
To: EASTMAN KODAK COMPANY
Reel/Frame 022904/0875 →