Granted Patent B2

US 12,204,281 · App. 18/225,603 · Granted Jan 21, 2025

Inventors: Alexis Hornstein (Brooklyn, NY); Kyle Appelgate (Brooklyn, NY); Lee Shiu Pong (Brooklyn, NY); Shi Yun Liu (Brooklyn, NY); Shawn Michael Frayne (Brooklyn, NY)

Assignee: Looking Glass Factory, Inc.

G03H1/2249G03H1/0005H04N13/368H04N13/376G03H2001/0088G03H2001/2273

Abstract

Claims (34)

1. A system comprising:

an autostereoscopic display configured to project each of a plurality of views to a different spatial direction, wherein the plurality of views comprises at least four distinct views;

a tracking sensor proximal the autostereoscopic display configured to determine a pose of one or more viewers; and

a processor configured to:

generate the plurality of views from a three-dimensional subject;

based on the pose of the one or more viewers modify a subset of the plurality of views projected into a spatial direction coincident with the pose of the one or more viewers, wherein the processor is configured to modify the subset of the plurality of views by:

modifying a perspective of the subset of the plurality of views;

modifying the subset of the plurality of views to improve a resolution of the three-dimensional image;

modifying the subset of the plurality of views such that the three-dimensional subject appears to interact with the one or more viewers;

modifying the subset of the plurality of views to account for motion of the one or more viewers; or

modifying an aspect ratio of the subset of the plurality of views; and

when a first viewer and a second viewer are in positions corresponding to a first view, shift a view alignment such that the position of the second viewer no longer corresponds to the first view; wherein when the first viewer and a second viewer are in positions corresponding to the first view, the first view is projected in a first direction corresponding to the position of the first viewer and is projected in a second direction corresponding to the position of the second viewer, wherein shifting the view alignment such that the position of the second viewer no longer corresponds to the first view comprises adjusting a calibration of the autostereoscopic display such that the first view is no longer projected in the second direction.

2. The system of claim 1 , wherein the processor is further configured to not modify a second subset of the plurality of views, wherein the second subset of the plurality of views comprises views that are not coincident with the pose of the one or more viewers, wherein the second subset of the plurality of views is different from the subset of the plurality of views.

3. The system of claim 1 , wherein the processor is configured to modify the subset of the plurality of views when a number of viewers is less than a threshold number of viewers.

4. The system of claim 3 , wherein the threshold number of viewers depends on an accuracy of the tracking sensor to track the threshold number of viewers.

5. The system of claim 3 , wherein when a number of the one or more viewers is greater than or equal to the threshold number of viewers, the processor is configured to not modify any of the plurality of views based on the pose of the one or more viewers.

6. The system of claim 5 , wherein the processor is further configured to gradually transition the modified subset of the plurality of views to not modified views when the number of the one or more viewers is equal to or greater than the threshold number of viewers.

7. The system of claim 6 , where gradually transitioning the modified subset of the plurality of views comprises transitioning the modified subset of the plurality of views over a time window of between 0.1 and 60s.

8. The system of claim 1 , wherein modifying the subset of views comprises: identifying a primary viewer of the one or more viewers based on a distance between each viewer and the autostereoscopic display; and modifying the subset of views based on a pose of the primary viewer of the one or more viewers.

9. The system of claim 1 , wherein generating the plurality of views from a three-dimensional subject comprises:

receiving a plurality of images of the three-dimensional subject; and

aligning each image of the plurality of images to pixels of the autostereoscopic display based on a calibration of the autostereoscopic display.

10. The system of claim 9 , wherein receiving the plurality of images comprises generating the plurality of images using a virtual camera, wherein modifying a view of the subset of views comprises modifying a position of the virtual camera relative to the three-dimensional subject for the respective view.

11. The system of claim 9 , wherein the calibration comprises a convergent calibration parameter and an orthographic calibration parameter.

12. The system of claim 1 , wherein the tracking sensor comprises a camera system.

13. The system of claim 12 , wherein the processor is further configured to determine the pose of the one or more viewers using images acquired by the camera system.

14. The system of claim 1 , wherein the autostereoscopic display comprises:

a light source;

a lenticular array comprising one-dimensional lenticular lenses optically coupled to the light source, wherein each view of the plurality of views is directed in a different direction by the lenticular array.

15. The system of claim 14 , wherein the one-dimensional lenticular lenses are oriented at an angle of more than zero but less than ninety degrees relative to the addressable columns of the light source.

16. The system of claim 1 , wherein modifying the perspective of the subset of the plurality of views comprises modifying the subset of the plurality of views to accommodate a vertical parallax in the subset of the plurality of views.

17. The system of claim 1 , wherein modifying the subset of the plurality of views to improve a resolution of the three-dimensional image comprises changing a second view to match a first view, wherein the first view is transmitted in a spatial direction coincident with an eye pose of the one or more viewers, wherein the second view is transmitted in a spatial directional immediately adjacent to the first view.

18. The system of claim 17 , wherein modifying the subset of the plurality of views to improve a resolution of the three-dimensional image further comprises not projecting a third view wherein the third view would be transmitted in a spatial direction between the eye pose of the one or more viewer and a second eye pose of the one or more viewers.

19. The system of claim 1 , wherein the tracking sensor is further configured to track a pose of a face or eyes of each of the one or more viewers, wherein the processor is configured to modify the subset of the plurality of views based on the poses when a number of the one or more viewers is less than a threshold number, and wherein the subset of the plurality of views is not modified based on the poses when the number of the one or more viewers is greater than the threshold number.

Assignments (2)

Continuity (5)

References Cited (220)