IP Library Granted Patent US 7,903,166
Granted Patent B2
US 7,903,166 · App. 11/948,959 · Granted Mar 8, 2011

Methods and systems for display viewer motion compensation based on user image data

Assignee: Sharp Laboratories of America, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,903,166
App. No.
11/948,959
Granted
Mar 8, 2011
Kind
B2
Abstract

Embodiments of the present invention comprise systems and methods for compensating for motion of a viewer relative to a display device.

Claims (32)

1. A method for displaying a motion-compensated image, said method comprising:

a) capturing a first user image of a user of a display device with an imaging device;

b) identifying a user facial feature in said first user image;

c) calculating a first user position relative to said display device from said user facial feature;

d) capturing a second user image of said user of said display device with said imaging device;

e) identifying said user facial feature in said second user image;

f) calculating a second user position relative to said display device from said user facial feature;

g) calculating a user motion characteristic using said first user position and said second user position

h) receiving an input image;

i) modifying said input image by shifting said image relative to said display device in a direction related to said user motion characteristic, thereby creating a modified input image;

j) applying a soft aperture region to said modified input image, wherein the extent of said soft aperture region varies with the magnitude of said user motion characteristic.

2. A method as described in claim 1 further comprising filtering said modified image to compensate for image blur due to display temporal response, thereby creating a filtered, modified input image.

3. A method as described in claim 2 wherein said filtering comprises a motion-compensated spatial inverse filtering operation.

4. A method as described in claim 2 wherein said filtering is based on display temporal response parameters.

5. A method as described in claim 2 wherein said filtering is based on a global velocity of said input image relative to said display.

6. A method as described in claim 1 further comprising modifying said input image with a zoom operation in response to said user motion characteristic indicating motion of said user's head in the direction of said display device.

7. A method as described in claim 1 further comprising expanding said input image to a size that is larger than the size of said display.

8. A method as described in claim 1 wherein said soft aperture region comprises matching a color in a soft aperture region to a display device color surrounding a display screen on said display device.

9. A system for displaying a motion-compensated image with a display device, said system comprising:

a) an imaging device for capturing user images of a user of a display device ;

b) a facial feature or face indicator identifier for identifying a user facial feature or face indicator in said user images;

c) a user position calculator for calculating a user position relative to said display device using said user facial feature;

d) a motion characteristic calculator for calculating a user motion characteristic using a plurality of said user positions calculated with said user position calculator;

e) an image receiver for receiving an input image;

f) an image modifier for modifying said input image by shifting said image relative to said display in a direction related to said user motion characteristic, thereby creating a modified input image; and

g) a soft aperture processor for applying a soft aperture region to said input image, wherein the extent of said soft aperture region applied by said soft aperture processor varies with the magnitude of a change in position of a user's head relative to said display.

10. A system as described in claim 9 wherein said image modifier further modifies said input image with a zoom operation in response to a distance between said user's head and said display as determined with said user motion characteristic.

11. A system as described in claim 9 further comprising a filter for filtering said modified image to compensate for image blur.

12. A system as described in claim 11 wherein said filtering comprises a motion-compensated spatial inverse filtering operation.

13. A system as described in claim 11 wherein said filtering is based on a display temporal response.

14. A system as described in claim 11 wherein said filtering is based on a global velocity of said input image relative to said display.

15. A system as described in claim 9 wherein said soft aperture processor matches a color in a soft aperture region to a display case color under ambient illumination.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2011
From: SHARP LABORATORIES OF AMERICA INC.
To: SHARP KABUSHIKI KAISHA
Reel/Frame 026072/0138 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2007
From: DALY, SCOTT J.
To: SHARP LABORATORIES OF AMERICA, INC.
Reel/Frame 020183/0608 →
Continuity (3)
Continuation In Part 11680522 · Feb 28, 2007
Provisional Application 60890897 · Feb 21, 2007
Related Publication 20080199049A1 · Aug 21, 2008