IP Library Patent Application 18088206
Patent Application
App. No. 18/088,206

SYSTEM AND METHOD FOR DEPTH DATA CODING

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/088,206
Abstract

Systems and methods for encoding/decoding a 3D image are provided. The system accesses an image data that comprises a texture data and a depth map. The system decomposes the depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of multiple focal planes (MFPs) decomposition of the image data. The system generates a plurality of encoded CDM data streams for the plurality of depth ranges, wherein each respective CDM data stream is based at least in part on a respective CDM. The system then transmits the plurality of encoded CDM data streams to a client device to cause the client device to: (a) reconstruct the depth map, and (b) generate for display or for further processing an image based on the reconstructed depth map.

Claims (63)

1 . A method comprising:

accessing image data that comprises a texture data and a depth map;

decomposing the depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of multiple focal plane (MFP) decomposition of the image data;

generating a plurality of encoded CDM data streams for the plurality of depth ranges, wherein each respective CDM data stream is based at least in part on a respective CDM; and

transmitting the plurality of encoded CDM data streams to a client device to cause the client device to:

reconstruct the depth map based on a plurality of decoded CDMs; and

generate for display an image based on the reconstructed depth map.

2 . The method of claim 1 , wherein the plurality of encoded CDM data streams is transmitted in parallel as part of a data container.

3 . The method of claim 2 , wherein:

the plurality of encoded CDM data streams are synchronized with the texture data; and

wherein the transmitting the plurality of encoded CDM data streams to a client device comprises transmitting the plurality of encoded CDM data streams synchronized with the texture data to cause the client device to generate for display an image based on the reconstructed depth map and the synchronized texture data received as part of the data container.

4 . The method of claim 1 , wherein:

decomposing the depth map into the plurality of CDMs comprises applying a reversible decomposition function to the depth map; and

the client is caused to reconstruct the depth map by applying an inverse of the reversible decomposition function to the plurality of CDMs.

5 . The method of claim 4 , wherein the reversible decomposition function is a set of tent functions.

6 . The method of claim 4 , wherein the reversible decomposition function is a set of sinusoid functions.

7 . The method of claim 1 , further comprising:

identifying a key depth range by performing object detection on the image data;

selecting a key CDM of the plurality of CDMs that corresponds to the key depth range;

wherein the generating the plurality of encoded CDM data streams comprises:

encoding the key CDM at higher bit rate than at least one other CDM of the plurality of CDMs.

8 . The method of claim 7 , wherein the selection of the key CDM is performed during live streaming of the image data.

9 . The method of claim 1 , wherein the generating the plurality of encoded CDM data streams comprises:

separately pre-encoding each CDM at a plurality of bit rates.

10 . The method of claim 9 , wherein the transmitting the plurality of encoded CDM data streams comprises:

selecting a first bit rate of the plurality of bit rates for a first CDM of the plurality of CDMs; and

selecting a second bit rate of the plurality of bit rates for a second CDM of the plurality of CDMs;

transmitting data pre-encoded at the first bit rate for the first CDM; and

transmitting data pre-encoded at the second bit rate for the second CDM.

11 . A method comprising:

accessing image data that comprises a texture data and a depth map;

decomposing the depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of multiple focal plane (MFP) decomposition of the image data;

generating a plurality of encoded CDM data streams for the plurality of depth ranges, wherein each respective CDM data stream is based at least in part on a respective CDM; and

transmitting the plurality of encoded CDM data streams to a client device to cause the client device to:

generate a plurality of MFPs based on a plurality of decoded CDMs and the texture data; and

generate for display an image based on the plurality of MFPs.

12 . A system comprising:

control circuitry configured to:

access image data that comprises a texture data and a depth map;

decompose the depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of multiple focal plane (MFP) decomposition of the image data;

generate a plurality of encoded CDM data streams for the plurality of depth ranges, wherein each respective CDM data stream is based at least in part on a respective CDM; and

networking circuitry configured to:

transmit the plurality of encoded CDM data streams to a client device to cause the client device to:

reconstruct the depth map based on a plurality of decoded CDMs; and

generate for display an image based on the reconstructed depth map.

13 . The system of claim 12 , wherein the networking circuitry is configured to transmit plurality of encoded CDM data streams in parallel as part of a data container.

14 . The system of claim 13 , wherein:

the control circuitry is configured to synchronize the plurality of encoded CDM data with the texture data; and

wherein the networking circuitry is configured to transmit the plurality of encoded CDM data streams to a client device by transmitting the plurality of encoded CDM data streams synchronized with the texture data to cause the client device to generate for display an image based on the reconstructed depth map and the synchronized texture data received as part of the data container.

15 . The system of claim 12 , wherein:

the control circuitry is configured to decompose the depth map into the plurality of CDMs by applying a reversible decomposition function to the depth map; and

the client is caused to reconstruct the depth map by applying an inverse of the reversible decomposition function to the plurality of CDMs.

16 . The system of claim 15 , wherein the reversible decomposition function is a set of tent functions.

17 . The system of claim 15 , wherein the reversible decomposition function is a set of sinusoid functions.

18 . The system of claim 12 , wherein the control circuitry is configured to:

identify a key depth range by performing object detection on the image data;

select a key CDM of the plurality of CDMs that corresponds to the key depth range;

wherein the control circuitry is configured to generate the plurality of encoded CDM data streams by:

encoding the key CDM at higher bit rate than at least one other CDM of the plurality of CDMs.

19 . The system of claim 18 , wherein the control circuitry is configured to select the key CDM during live streaming of the image data.

20 . The system of claim 12 , wherein the control circuitry is configured to generate the plurality of encoded CDM data streams by:

separately pre-encoding each CDM at a plurality of bit rates.

21 - 92 . (canceled)

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2023
From: VALLI, SEPPO; SILTANEN, PEKKA
To: ROVI GUIDES, INC.
Reel/Frame 063641/0273 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →