IP Library Granted Patent US 9,355,431
Granted Patent B1
US 9,355,431 · App. 13/624,713 · Granted May 31, 2016

Image correction for physical projection-surface irregularities

Inventor: Skeets Jonathan Norquist (Duvall, WA)
Assignee: Amazon Technologies, Inc.
G06T3/005G06T3/0043
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,355,431
App. No.
13/624,713
Granted
May 31, 2016
Kind
B1
Abstract

A source image to be projected onto a projection surface is transformed based on a three-dimensional representation of the projection surface to create a modified source image. When the modified source image is projected onto the projection surface, a resulting display image is less distorted as compared to the original source image than a resulting display image would be if the original source image were projected onto the projection surface.

Claims (40)

1. A system comprising:

a processor;

a memory;

a spatial analysis module comprising computer-executable instructions stored in the memory and executed on the processor to determine a physical topology of a projection surface onto which a source image is to be displayed;

a user identification module comprising computer-executable instructions stored in the memory and executed on the processor to determine a view direction of a user; and

a coordinate transformation module comprising computer-executable instructions stored in the memory and executed on the processor to generate a modified source image based at least in part on the source image, the physical topology of the projection surface, and on the determined view direction.

2. The system as recited in claim 1 , further comprising a camera for capturing images of the projection surface, wherein the spatial analysis module is configured to determine the physical topology of the projection surface based at least in part on the captured images.

3. The system as recited in claim 1 , wherein the coordinate transformation module is configured to:

generate a three-dimensional coordinate system to represent the physical topology of the projection surface; and

transform a two-dimensional representation of the source image to a two-dimensional representation of the modified source image based at least in part on the three-dimensional coordinate system.

4. The system as recited in claim 1 ,

wherein the user identification module is configured to determine the view direction of the user based at least in part on a location of the user's eyes.

5. The system as recited in claim 4 , further comprising a camera to capture images of the user within an environment, wherein the user identification module is configured to determine the view direction of the user based at least in part on the images of the user captured by the camera.

6. A method comprising:

under control of one or more computer systems configured with executable instructions,

determining a physical topology of a projection surface onto which a source image is to be displayed;

determining a view direction of a user; and

generating a modified source image based at least in part on the source image, the physical topology of the projection surface, and on the determined view direction.

7. The method as recited in claim 6 , wherein the modified source image comprises a first area of one or more pixels that are compressed as compared to a corresponding area in the source image.

8. The method as recited in claim 6 , wherein the modified source image comprises a first area of one or more pixels that are expanded as compared to a corresponding area in the source image.

9. The method as recited in claim 8 , wherein the modified source image comprises a second area of one or more pixels that are compressed as compared to a corresponding area in the source image.

10. The method as recited in claim 6 , wherein the projection surface comprises:

a first area that is a first distance from a projector; and

a second area that is a second, different distance from the projector.

11. The method as recited in claim 6 , further comprises:

defining a projection coordinate system through which an image passes when projected from a projector toward the projection surface;

defining a surface coordinate system that represents the physical topography of the projection surface;

defining a visual coordinate system using the view direction of the user;

wherein generating the modified source image comprises:

defining a transformation from the visual coordinate system using the view direction of the user through the surface coordinate system that represents the topography of the projection surface to the projection coordinate through which the image passes when projected from the projector toward the projection surface; and

projecting the modified source image onto the projection surface.

12. The method as recited in claim 11 , wherein the projection coordinate system is a two-dimensional coordinate system.

13. The method as recited in claim 11 , wherein the visual coordinate system is a two-dimensional coordinate system.

14. The method as recited in claim 11 , wherein the projection coordinate system has a first angle relative to the projection surface and the visual coordinate system has a second angle, different from the first angle, relative to the projection surface.

15. The method as recited in claim 11 , wherein defining a transformation from the visual coordinate system through the surface coordinate system to the projection coordinate system comprises:

defining a first transformation from the projection coordinate system through the surface coordinate system to the visual coordinate system; and

defining the transformation from the visual coordinate system through the surface coordinate system to the projection coordinate system as an inverse of the first transformation.

16. The method as recited in claim 11 , wherein defining the transformation from the visual coordinate system through the surface coordinate system to the projection coordinate system comprises:

defining a first transformation for a first set of one or more pixels within an area of the original source image that corresponds to a first area of the projection surface that is a first distance from the projector; and

defining a second transformation for a second set of one or more pixels within an area of the original source image that corresponds to the second area of the projection surface that is a second distance from the projector.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2015
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 037103/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2013
From: NORQUIST, SKEETS JONATHAN
To: RAWLES LLC
Reel/Frame 029672/0732 →