IP Library Granted Patent US 6,985,158
Granted Patent B2
US 6,985,158 · App. 10/838,667 · Granted Jan 10, 2006

Method and system for displaying an image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 6,985,158
App. No.
10/838,667
Granted
Jan 10, 2006
Kind
B2
Abstract

A method and system for displaying an image, includes steps and means for: storing image data in a manner that enables retrieval of different spatial regions of an image at different fidelities; determining an viewer's point of gaze on a display; retrieving image data for each spatial region of an image at a fidelity that is a decreasing function of the distance of the regions from the point of gaze; and displaying the retrieved image data on the display.

Claims (56)

1. A method for transmitting a compressed digital image to a display that is viewed by a human observer having a first point of gaze and then a second point of gaze, comprising the steps of:

sending first data of the digital image to fill all regions of the display with a minimum resolution level of image information;

detecting the first point of gaze:

then sending second data of said digital image to refine image details, starting with data that corresponds to the first point of gaze and progressing outward away from said detected first point of gaze;

detecting the second point of gaze; and

then continuing sending of said second data of said digital image as a decreasing function of distance of said regions from said detected second point of gaze.

2. The method of claim 1 , wherein the compressed digital image is compressed using the JPEG 2000 compression standard to contain one or more tiles and one or more precincts.

3. The method of claim 2 , wherein the first data is sent using a resolution level-layer-component-position progression ordering.

4. The method of claim 2 , wherein the second data is sent using a component-position-resolution level-layer progression ordering.

5. The method according to claim 4 , wherein the second data is organized so that all data packets for each tile are contiguous and all data packets for each precinct within a tile are contiguous.

6. The method of claim 2 , wherein the first data represent all precincts from one or more low resolution levels.

7. The method of claim 2 , wherein the second data represent precincts from one or more resolution levels that are prioritized in order of closest distance to furthest distance from the point of gaze.

8. A method for transmitting compressed image data to a display that is viewed by a human observer having a point of gaze, comprising the steps of:

a) sending first data to fill all regions of the display with a minimum resolution level of image information; and

b) sending second data to refine image details, starting with data that corresponds to the point of gaze and progressing outward away from the point of gaze;

wherein the sending of the second data is prioritized according to an eccentricity dependent model of the contrast threshold function of the human visual system.

9. The method of claim 8 , wherein the sending of the second data is adjusted for transmission bandwidth by varying the rate of change of the contrast threshold with eccentricity.

10. A method for transmitting compressed image data to a display that is viewed by a human observer having a point of gaze, comprising the steps of:

a) sending first data to fill all regions of the display with a minimum resolution level of image information; and

b) sending second data to refine image details, starting with data that corresponds to the point of gaze and progressing outward away from the point of gaze;

wherein: the compressed image data is compressed using the JPEG 2000 compression standard to contain one or more tiles and one or more precincts, the second data represent precincts from one or more resolution levels that are prioritized in order of closest distance to furthest distance from the point of gaze, and the number of transmitted bit planes for each precinct are determined using an eccentricity dependent model of the contrast threshold function of the human visual system.

11. The method of claim 10 , wherein the number of transmitted bit planes for each precinct is adjusted for transmission bandwidth by varying the rate of change of the contrast threshold with eccentricity.

12. The method of claim 10 , wherein the number of transmitted bit planes for each precinct is also a function of the viewer's viewing distance.

13. The method of claim 10 , wherein the number of transmitted bit planes is also a function of the ambient display environment.

14. The method of claim 10 , wherein the number of transmitted bit planes is also a function of one or more display characteristics selected from the group comprising display resolution, maximum display luminance; minimum display luminance; display reflectance; and display size.

15. A method for transmitting a compressed digital image to a display that is viewed by a human observer having a point of gaze, comprising the steps of:

sending first data of the digital image to fill all regions of the display with a minimum resolution level of image information;

determining the point of gaze of the human observer; and

then sending second data of said digital image to refine image details, starting with data that corresponds to said point of gaze and progressing outward away from said point of gaze.

16. The method of claim 15 , wherein said determining further comprises determining the observer's point of gaze with an eye tracking device.

17. The method of claim 1 , wherein said determining further comprises analyzing the image content to determine the point of gaze.

18. A method for transmitting compressed image data to a display that is viewed by a human observer having a point of gaze, comprising the steps of:

sending first data to fill all regions of the display with a minimum resolution level of image information;

determining the point of gaze; and

sending second data to refine image details, starting with data that corresponds to said point of gaze and progressing outward away from said point of gaze;

wherein said determining further comprises measuring points of gaze of a plurality of viewers of an image and determining said point of gaze as a function of the measured points.

19. A method for transmitting compressed image data to a display that is viewed by a plurality of human observers, each having a point of gaze, comprising the steps of:

sending first data to fill all regions of the display with a minimum resolution level of image information; and

sending second data to refine image details, as a function of the points of gaze of the plurality of human observers, in alternation, starting with data that corresponds to said points of gaze and progressing outward away from the respective said points of gaze.

20. The method of claim 19 , wherein the compressed image data is compressed using the JPEG 2000 compression standard to contain one or more tiles and one or more precincts; and said sending is by precinct.

21. The method of claim 1 , wherein said sending steps each include decompressing the respective said data of the digital image.

22. The method of claim 8 , wherein the compressed digital image is compressed using the JPEG 2000 compression standard to contain one or more tiles and one or more precincts.

23. The method of claim 22 , wherein the second data represent precincts from one or more resolution levels that are also prioritized in order of closest distance to furthest distance from the point of gaze.

24. The method of claim 15 wherein said sending second data continues until said digital image is complete in all of said regions.

25. The method of claim 15 further comprising one or more interations of:

detecting a new point of gaze of the human observer; and

then continuing sending said second data in an outward progression relative to said new point of gaze; wherein said sending of said second data concludes when said digital image is complete in all of said regions.

26. The method of claim 15 , wherein the digital image is part of a video sequence and said determining further comprises estimating a future point of gaze.

27. A method for transmitting a compressed digital image to a display that is viewed by a human observer having a changing point of gaze comprising the steps of:

sending first data of the digital image to fill all regions of the display with a minimum resolution level of image information;

then sending second data of said digital image to refine image details, progressing outward relative to the point of gaze until the point of gaze changes;

then iterating said sending step.

28. A method for transmitting compressed a digital image to a display that is viewed by a human observer having a first point of gaze and then a second point of gaze, comprising the steps of

sending first data of the digital image to fill all regions of the display with a minimum resolution level of image information;

then sending second data of said digital image to refine image details as a decreasing function of distance of said regions from said first point of gaze; and

then sending second data of said digital image to continue refining image details as a decreasing function of distance of said regions from said second point of gaze.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041941/0079 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2013
From: EASTMAN KODAK COMPANY
To: INTELLECTUAL VENTURES FUND 83 LLC
Reel/Frame 030297/0769 →
PATENT RELEASE Recorded Feb 1, 2013
From: CITICORP NORTH AMERICA, INC.; WILMINGTON TRUST, NATIONAL ASSOCIATION
To: EASTMAN KODAK COMPANY; EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.; FAR EAST DEVELOPMENT LTD.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; KODAK AVIATION LEASING LLC; KODAK PHILIPPINES, LTD.; NPEC INC.; FPC INC.; KODAK IMAGING NETWORK, INC.; PAKON, INC.; QUALEX INC.; CREO MANUFACTURING AMERICA LLC
Reel/Frame 029913/0001 →
SECURITY INTEREST Recorded Feb 21, 2012
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: CITICORP NORTH AMERICA, INC., AS AGENT
Reel/Frame 028201/0420 →