IP Library Granted Patent US 11,425,363
Granted Patent B2
US 11,425,363 · App. 17/226,404 · Granted Aug 23, 2022

System and method for generating light field images

Inventors: Kyle Appelgate (Brooklyn, NY); Evan Kahn (Brooklyn, NY); Alexis Hornstein (Brooklyn, NY); Shawn Michael Frayne (Brooklyn, NY); Matthew Collins (Brooklyn, NY); Char Stiles (Brooklyn, NY)
Assignee: Looking Glass Factory, Inc.
H04N13/351G03H1/0005G03H1/26G06T3/4038H04N13/15H04N13/161H04N13/302H04N19/597G03H2001/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,425,363
App. No.
17/226,404
Granted
Aug 23, 2022
Kind
B2
Abstract

A system and method can include receiving a set of views, encoding the set of views, and displaying the set of views such that they are perceived as a holographic image.

Claims (37)

1. A method for displaying a holographic image comprising:

receiving a set of images, each image associated with a different perspective of a scene;

generating a quilt image by arranging the set of images starting with a first image associated with a first perspective and ending at a second image associated with a second perspective, wherein the set of images are arranged in a raster starting at a bottom left and rastering horizontally through views to a top right within the quilt image;

wherein the holographic image is a frame of a holographic video, wherein the holographic video is compressed by:

for each frame of the holographic video:

arranging the images of the quilt image associated with the frame in a linear array; and

appending subsequent frames to the linear array, wherein the images from each subsequent frame are ordered in an opposing order relative to a preceding frame;

compressing the linear array using a video codec;

transmitting the compressed quilt image to a display;

decompressing the compressed quilt image;

lenticularizing the decompressed quilt image based on a calibration associated with the display;

duplicating each pixel of the lenticularized quilt image at least once to generate the holographic image, wherein each duplicated pixel is immediately adjacent to the corresponding original pixel; and

displaying the holographic image using the display.

2. The method of claim 1 , wherein the display is operable to concurrently display the holographic image to a plurality of viewers without using a headset.

3. The method of claim 1 , wherein the compressed quilt image is transmitted using a polynomial representation.

4. The method of claim 1 , wherein generating the holographic image comprises appending a first segment of the lenticularized quilt image to a second segment of the lenticularized quilt image, wherein the first segment and second segment share a predetermined number of identical pixels.

5. A method for displaying a holographic image comprising:

receiving a set of images, each image of the set of images comprising color information and depth information, wherein each image of the set of images comprises a different perspective of a common scene;

determining intermediate views associated with perspectives intermediate between perspectives associated with two images of the set of images;

arranging the set of images and the intermediate views into a quilt image based on the pose of a respective source camera, wherein the set of images and the intermediate views are arranged in a raster starting at a bottom left and rastering horizontally through views to a top right within the quilt image, wherein the quilt image is a frame of a holographic video;

compressing the quilt image by:

arranging the images of the quilt image associated with the frame in a linear array;

appending subsequent frames to the linear array, wherein the images from each subsequent frame are ordered in an opposing order relative to a preceding frame; and

compressing the linear array using a video codec;

transmitting the compressed quilt image to a holographic display;

decompressing the compressed quilt image;

lenticularizing the decompressed quilt image based on a calibration of the holographic display to generate the holographic image, wherein the lenticularized quilt image is configured to decrease a chromatic anomaly arising from image compression present in the displayed holographic image; and

displaying the holographic image using the holographic display.

6. The method of claim 5 , wherein the holographic display is operable to concurrently display the holographic image to a plurality of viewers without using a headset.

7. The method of claim 5 , wherein the compressed quilt image is transmitted using a polynomial representation.

8. The method of claim 5 , wherein the quilt image is lenticularized at a remote server.

9. The method of claim 5 , wherein the set of images comprises fewer images than the quilt image.

10. The method of claim 5 , wherein the depth information is determined based on a depth map calculated using two images of the set of images.

11. The method of claim 5 , wherein the quilt image comprises the set of images arranged in a predetermined order starting with an image associated with a first extreme perspective and ending at a second image associated with a second extreme perspective.

12. The method of claim 5 , wherein determining an intermediate view comprises projecting a first image from the set of images to a perspective associated with the intermediate view based on the difference in perspective between the first image and the intermediate view.

13. The method of claim 12 , further comprising projecting a second image from the set of images to the perspective associated with the intermediate view.

14. The method of claim 13 , further comprising repeating projecting the first image and the second image to the perspective associated with the intermediate view after the intermediate view has been determined.

Assignments (2)
SECURITY INTEREST Recorded Apr 9, 2026
From: LOOKING GLASS FACTORY INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075378/0486 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: APPELGATE, KYLE; KAHN, EVAN; HORNSTEIN, ALEXIS; FRAYNE, SHAWN MICHAEL; COLLINS, MATTHEW; STILES, CHAR
To: LOOKING GLASS FACTORY, INC.
Reel/Frame 056312/0552 →
Continuity (3)
Provisional Application 63120007 · Dec 1, 2020
Provisional Application 63007605 · Apr 9, 2020
Related Publication 20210321081A1 · Oct 14, 2021
Cited By (2)
US 12,374,026 US 12,587,630