IP Library Granted Patent US 10,063,818
Granted Patent B1
US 10,063,818 · App. 15/416,468 · Granted Aug 28, 2018

Methods and systems for projecting a target portion of an image at a higher resolution

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,063,818
App. No.
15/416,468
Granted
Aug 28, 2018
Kind
B1
Abstract

Example embodiments may relate to methods and systems for providing a higher-resolution segment within a larger lower-resolution projection onto a projection surface. For example, the system may receive pose data corresponding to a viewing location relative to the projection surface. The system may then determine, based on the pose data, a target portion of an image frame of image data. As a result, the system may cause a first projector to project at least the target portion onto the projection surface and cause a second projector to project at least a remaining portion of the image frame of the image data onto the projection surface. The projections of the target portion and the remaining portion may collectively provide a complete projection of the image data on the projection surface and a projection-surface resolution of the target portion may be higher than a projection-surface resolution of the remaining portion.

Claims (61)

1. A system comprising:

a plurality of projectors configured to project imagery, wherein the plurality of projectors comprises at least a first projector and a second projector; and

a control system configured to:

receive a predefined image to be projected by the plurality of projectors, wherein the predefined image includes predefined image content;

make a determination, based on pose data, that a pose of a user relative to a projection surface corresponds to a target portion of the predefined image content, wherein the target portion is at least partially different from a remaining portion of the predefined image content; and

in response to making the determination, cause (i) the first projector to project the target portion of the predefined image content onto the projection surface at a first resolution that is higher than a second resolution and (ii) the second projector to project the remaining portion of the predefined image content onto the projection surface at the second resolution, wherein the projections of the target portion and the remaining portion collectively provide on the projection surface a complete projection of the predefined image content included in the received predefined image.

2. The system of claim 1 , wherein the target portion being at least partially different from the remaining portion of the predefined image content comprises the remaining portion being a portion of the predefined image content that is outside of the target portion.

3. The system of claim 1 , wherein the pose data is indicative of one or more of: (a) a distance between the projection surface and a viewing location of the user, (b) a viewing orientation of the user with respect to the projection surface, and (c) a height of the viewing location.

4. The system of claim 1 , wherein the control system being configured to make the determination based on the pose data comprises the control system being configured to:

determine, based on the pose data, a distance between the projection surface and a viewing location of the user; and

determine a size of the target portion based on the distance between the projection surface and the viewing location of the user,

wherein the control system being configured to cause the first projector to project the target portion comprises the control system being configured to cause the first projector to project the target portion such that the target portion is projected onto the projection surface in accordance with the determined size.

5. The system of claim 1 , wherein the control system being configured to make the determination based on the pose data comprises the control system being configured to:

determine, based on the pose data, (i) a distance between the projection surface and a viewing location of the user and (ii) a viewing angle at the viewing location; and

determine, based at least in part on the determined distance and the determined viewing angle, a location of the target portion within the predefined image.

6. The system of claim 1 , wherein the control system is further configured to:

determine a location on the projection surface that corresponds to a location of the target portion within the predefined image,

wherein the control system being configured to cause the first projector to project the target portion comprises the control system being configured to cause the first projector to project the target portion onto the determined location on the projection surface.

7. The system of claim 1 ,

wherein the control system being configured to cause the first projector to project the target portion comprises the control system being configured to send, to the first projector, control instructions indicating that the first projector should project the target portion onto the projection surface at the first resolution, and

wherein the control system being configured to cause the second projector to project the remaining portion comprises the control system being configured to send, to the second projector, control instructions indicating that the second projector should project the remaining portion onto the projection surface at the second resolution.

8. The system of claim 1 , further comprising an optical system arranged between the first projector and the projection surface, wherein the optical system is configured to adjust the projection of the target portion onto the projection surface, and wherein the control system is configured to control the projection of the target portion, at least in part, through control of the optical system.

9. The system of claim 1 , wherein the control system is further configured to determine a buffer area in the predefined image, wherein the target portion and the remaining portion overlap in the buffer area.

10. The system of claim 9 ,

wherein the control system being configured to cause the first projector to project the target portion comprises the control system being configured to cause the first projector to project the target portion such that luminosity of the first projector decreases from a higher luminosity at an inner edge of the buffer area to a lower luminosity at an outer edge of the buffer area, and

wherein the control system being configured to cause the second projector to project the remaining portion comprises the control system being configured to cause the second projector to project the remaining portion such that luminosity of the second projector decreases from a higher luminosity at the outer edge of the buffer area to a lower luminosity at the inner edge of the buffer area.

11. The system of claim 1 , wherein the plurality of projectors further comprises a third projector, wherein the pose of the user comprises a first pose of a first user, wherein the pose data is indicative of the first pose and also of a second pose of a second user relative to the projection surface, wherein the target portion is a first target portion, and wherein the control system is further configured to:

make a further determination, based on the pose data indicative of the second pose, that the second pose corresponds to a second target portion of the predefined image content, wherein the first and second target portions are each at least partially different from the remaining portion; and

in response to making the further determination, cause the third projector to project the second target portion of the predefined image content onto the projection surface at a third resolution that is higher than the second resolution, wherein the projections of the first and second target portions and the remaining portion collectively provide on the projection surface another complete projection of the predefined image content included in the received predefined image.

12. The system of claim 1 , wherein the pose comprises a first pose, wherein the predefined image including predefined image content comprises a first predefined image including first predefined image content, wherein the target portion comprises a first target portion, wherein the remaining portion comprises a first remaining portion, and wherein the control system is further configured to:

make a further determination, based on further pose data, that a second pose of the user relative to the projection surface corresponds to a second target portion of second predefined image content included in a second predefined image, wherein the second target portion is at least partially different from a second remaining portion of the second predefined image content; and

in response to making the further determination, cause (i) the first projector to project the second target portion of the second predefined image content onto the projection surface at a third resolution that is higher than a fourth resolution and (ii) the second projector to project the second remaining portion of the second predefined image content onto the projection surface at the fourth resolution, wherein the projections of the second target portion and the second remaining portion collectively provide on the projection surface a complete projection of the second predefined image content included in the second predefined image.

13. The system of claim 12 , wherein the first predefined image is different from the second predefined image.

14. The system of claim 12 , wherein the first predefined image and the second predefined image are the same predefined image.

15. The system of claim 14 , wherein the first target portion is different from the second target portion.

16. The system of claim 12 ,

wherein the control system being configured to make the determination based on the pose data comprises the control system being configured to:

determine, based on the pose data, a first distance between the projection surface and a first viewing location of the user;

determine a first size of the first target portion based on the first distance,

wherein the control system being configured to make the further determination based on the further pose data comprises the control system being configured to:

determine, based on the further pose data, a second distance between the projection surface and a second viewing location of the user; and

determine a second size of the second target portion based on the second distance,

wherein the control system being configured to cause the first projector to project the first target portion comprises the control system being configured to cause the first projector to project the first target portion such that the first target portion is projected onto the projection surface in accordance with the determined first size, and

wherein the control system being configured to cause the first projector to project the second target portion comprises the control system being configured to cause the first projector to project the second target portion such that the second target portion is projected onto the projection surface in accordance with the determined second size.

17. The system of claim 12 , wherein the control system is further configured to:

based on the pose data, determine a first location on the projection surface onto which to project the first target portion; and

based on the further pose data, determine a second location on the projection surface onto which to project the second target portion,

wherein the control system being configured to cause the first projector to project the first target portion comprises the control system being configured to cause the first projector to project the first target portion onto the determined first location on the projection surface, and

wherein the control system being configured to cause the first projector to project the second target portion comprises the control system being configured to cause the first projector to project the second target portion onto the determined second location on the projection surface.

18. The system of claim 1 , wherein the pose comprises a first pose, wherein the predefined image including predefined image content comprises a first predefined image including first predefined image content, wherein the target portion comprises a first target portion, wherein the remaining portion comprises a first remaining portion, and wherein the control system is further configured to:

predict a change from the first pose to a second pose at a future time;

in response to predicting the change from the first pose to the second pose, make a further determination that the second pose corresponds to a second target portion of second predefined image content included in a second predefined image, wherein the second target portion is at least partially different from a second remaining portion of the second predefined image content; and

in response to making the further determination and at the further time, cause (i) the first projector to project the second target portion of the second predefined image content onto the projection surface at a third resolution that is higher than a fourth resolution and (ii) the second projector to project the second remaining portion of the second predefined image content onto the projection surface at the fourth resolution, wherein the projections of the second target portion and the second remaining portion collectively provide on the projection surface a complete projection of the second predefined image content included in the second predefined image.

19. A method comprising:

receiving, by a control system, a predefined image to be projected by a plurality of projectors, wherein the predefined image includes predefined image content, and wherein the plurality of projectors comprises at least a first projector and a second projector;

making a determination, by the control system based on pose data, that a pose of a user relative to a projection surface corresponds to a target portion of the predefined image content, wherein the target portion is at least partially different from a remaining portion of the predefined image content; and

in response to making the determination, causing, by the control system, (i) the first projector to project the target portion of the predefined image content onto the projection surface at a first resolution that is higher than a second resolution and (ii) the second projector to project the remaining portion of the predefined image content onto the projection surface at the second resolution, wherein the projections of the target portion and the remaining portion collectively provide on the projection surface a complete projection of the predefined image content included in the received predefined image.

20. A non-transitory computer readable medium having stored therein instructions executable by a control system to cause the control system to perform functions comprising:

receiving a predefined image to be projected by a plurality of projectors, wherein the predefined image includes predefined image content, and wherein the plurality of projectors comprises at least a first projector and a second projector;

making a determination, based on pose data, that a pose of a user relative to a projection surface corresponds to a target portion of the predefined image content, wherein the target portion is at least partially different from a remaining portion of the predefined image content; and

in response to making the determination, causing (i) the first projector to project the target portion of the predefined image content onto the projection surface at a first resolution that is higher than a second resolution and (ii) the second projector to project the remaining portion of the predefined image content onto the projection surface at the second resolution, wherein the projections of the target portion and the remaining portion collectively provide on the projection surface a complete projection of the predefined image content included in the received predefined image.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2017
From: STOWELL LINNELL, LLC D/B/A AUTOFUSS
To: GOOGLE LLC
Reel/Frame 044263/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2017
From: GOOGLE LLC
To: X DEVELOPMENT LLC
Reel/Frame 044263/0400 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2017
From: LINNELL, JEFFREY
To: AUTOFUSS
Reel/Frame 041094/0120 →
Cited By (1)
US 12,244,975