IP Library Granted Patent US 12,249,019
Granted Patent B2
US 12,249,019 · App. 18/071,119 · Granted Mar 11, 2025

Systems and methods for forming folded focal planes

Inventors: Seppo Valli (Espoo, FI); Pekka Siltanen (Helsinki, FI)
Assignee: Adeia Guides Inc.
G06T15/04G06T15/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,249,019
App. No.
18/071,119
Granted
Mar 11, 2025
Kind
B2
Abstract

Systems and methods for rendering a 3D image are provided. The system receives image data including a texture matrix and a corresponding depth matrix. The system generates a first weight matrix based on a number of least significant bits of each depth value of the depth matrix. The system generating a second weight matrix that is a complement of the first weight matrix. The system generates the first folded focal plane matrix by applying weights of the first weight matrix to the texture matrix. The system generates the second folded focal plane matrix by applying weights of the second weight matrix to the texture matrix. The system provides the first and the second folded focal planes matrices to a display device for generating a 3D representation of the received texture matrix.

Claims (64)

1. A method comprising:

receiving a texture matrix and a corresponding depth matrix;

generating, based on the texture matrix, a first and second folded focal planes matrices by:

generating a first weight matrix based on a number of least significant bits of each depth value of the depth matrix;

generating a second weight matrix that is a complement of the first weight matrix;

generating the first folded focal plane matrix by applying weights of the first weight matrix to the texture matrix; and

generating the second folded focal plane matrix by applying weights of the second weight matrix to the texture matrix; and

providing the first and the second folded focal planes matrices to a display device for generating a 3D representation of the received texture matrix.

2. The method of claim 1 wherein applying the weights of the first weight matrix to the texture matrix comprises:

extracting luminance values from the texture matrix;

applying corresponding values of the first weight matrix to adjust corresponding luminance values; and

recombining luminance values with color values.

3. The method of claim 1 wherein applying the weights of the second weight matrix to the texture matrix comprises:

extracting luminance values from the texture matrix;

applying corresponding values of the second weight matrix to adjust corresponding luminance values; and

recombining luminance values with color values.

4. The method of claim 1 , further comprising:

generating a control matrix based on a number of most significant bits of each depth value of the depth matrix; and

wherein the display device is configured according to the control matrix.

5. The method of claim 1 , wherein providing the first and the second folded focal planes matrices as input causes generation of light rays based on the first and the second focal planes.

6. The method of claim 1 ,

wherein each value of the depth matrix comprises 8 bits;

wherein the number of least significant bits of each depth value of the depth matrix is equal to 6; and

wherein the number of most significant bits of each depth value of the depth matrix is equal to 2.

7. The method of claim 1 ,

wherein each value of the depth matrix comprises 8 bits;

wherein the number of least significant bits of each depth value of the depth matrix is equal to 5; and

wherein the number of most significant bits of each depth value of the depth matrix is equal to 3.

8. The method of claim 1 , wherein the display device comprises a spatial light modulator (SLM).

9. The method of claim 1 , wherein the display device comprises a set of stacked displays.

10. The method of claim 1 , wherein the display device comprises a head mounted display.

11. A system comprising:

input circuitry configured to:

receive a texture matrix and a corresponding depth matrix; and

control circuitry configured to:

generate, based on the texture matrix, a first and second folded focal planes matrices by:

generating a first weight matrix based on a number of least significant bits of each depth value of the depth matrix;

generating a second weight matrix that is a complement of the first weight matrix;

generating the first folded focal plane matrix by applying weights of the first weight matrix to the texture matrix; and

generating the second folded focal plane matrix by applying weights of the second weight matrix to the texture matrix; and

provide the first and the second folded focal planes matrices to a display device for generating a 3D representation of the received texture matrix.

12. The system of claim 11 , wherein the control circuitry is configured to apply the weights of the first weight matrix to the texture matrix by:

extracting luminance values from the texture matrix;

applying corresponding values of the first weight matrix to adjust corresponding luminance values; and

recombining luminance values with color values.

13. The system of claim 11 wherein the control circuitry is configured to apply the weights of the second weight matrix to the texture matrix by:

extracting luminance values from the texture matrix;

applying corresponding values of the second weight matrix to adjust corresponding luminance values; and

recombining luminance values with color values.

14. The system of claim 11 , wherein the control circuitry is configured to:

generate a control matrix based on a number of most significant bits of each depth value of the depth matrix; and

wherein the display device is configured according to the control matrix.

15. The system of claim 11 , wherein the control circuitry providing the first and the second folded focal planes matrices as input causes generation of light rays based on the first and the second focal planes.

16. The system of claim 11 ,

wherein each value of the depth matrix comprises 8 bits;

wherein the number of least significant bits of each depth value of the depth matrix is equal to 6; and

wherein the number of most significant bits of each depth value of the depth matrix is equal to 2.

17. The system of claim 11 ,

wherein each value of the depth matrix comprises 8 bits;

wherein the number of least significant bits of each depth value of the depth matrix is equal to 5; and

wherein the number of most significant bits of each depth value of the depth matrix is equal to 3.

18. The system of claim 11 , wherein the display device comprises a spatial light modulator (SLM).

19. The system of claim 11 , wherein the display device comprises a set of stacked displays.

20. The system of claim 11 , wherein the display device comprises a head mounted display.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0413 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2023
From: VALLI, SEPPO; SILTANEN, PEKKA
To: ROVI GUIDES, INC.
Reel/Frame 062348/0447 →
Continuity (1)
Related Publication 20240177398A1 · May 30, 2024
References Cited (11)
US 8502821B2 · Louise · 2013 [cited by examiner]
US 20150205126A1 · Schowengerdt · 2015 [cited by examiner]
US 20170142398A1 · Peterson · 2017 [cited by examiner]
US 20180220589A1 · Burden · 2018 [cited by examiner]
Cui et al. “Optical mapping near-eye three-dimensional display with correct focus cues,” Opt Lett., 42:2475-8 (2017) (4 pages). [cited by applicant]
Hua, “Enabling focus cues in head-mounted displays,” in Imaging and Applied Optics 2017, OSA Technical Digest (20 pages). [cited by applicant]
K. Akeley, et al., “a stereo display prototype with multiple focal distances,” CM Trans. Graph. 23, 3, 804-813 (2004). [cited by applicant]
U.S. Appl. No. 17/863,793, “Systems and Methods for Reducing a Number of Focal Planes Used to Display Three-Dimensional Objects,” filed Jul. 13, 2022. [cited by applicant]
U.S. Appl. No. 17/990,023, “System and Method for Preprocessing of Focal Planes Data for Rendering,” filed Nov. 18, 2022. [cited by applicant]
Valli et al., “Advances in Spatially Faithful (3D) telepresence. IntechOpen, 2021,” Augmented Reality and Its Application, IntechOpen, DOI: 10.5772/intechopen.99271 (24 pages). [cited by applicant]
Zhan et al., “Multifocal displays: review and prospect,” PhotoniX 1:10 (2020) https://doi.org/10.1186/s43074-020-00010-0. [cited by applicant]