IP Library Granted Patent US 12,695,858
Granted Patent B2
US 12,695,858 · App. 18/821,039 · Granted Jul 28, 2026

System and method for depth data coding

Inventors: Seppo Valli (Espoo, FI); Pekka Siltanen (Helsinki, FI)
Assignee: Adeia Guides Inc.
H04N13/161H04N13/128H04N13/194H04N19/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,695,858
App. No.
18/821,039
Filed
Aug 30, 2024
Granted
Jul 28, 2026
Kind
B2
Art Unit
2482
USPC
348/43
Abstract

Systems and methods for encoding/decoding a 3D image are provided. The system decomposes depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of a multiple focal plane (MFP) decomposition of the image data. The system generates a plurality of component depth map focal planes (CDMFPs) by combining each respective CDM with the depth map. The system scales data in each CDMFP by a respective scaling factor. The system generates for transmission a plurality of encoded scaled CDMFP data streams for the plurality of depth ranges, wherein each respective scaled CDMFP data stream is based at least in part on a respective scaled CDMFP.

Claims (54)

1 . A method comprising:

accessing image data comprising texture data and depth data for a video content item;

decomposing the depth data into a plurality of component depth maps (CDMs);

identifying key depth ranges and non-key depth ranges within the CDMs;

encoding the plurality of CDMs into a plurality of CDM streams;

wherein the encoding comprises coding the key depth ranges with a first bit rate and the non-key depth ranges with a second bit rate, wherein the first bit rate is higher than the second bit rate; and

wherein the encoding comprises separately encoding each respective CDM stream of the plurality of CDM streams using an inter-coding technique for respective frames of the respective CDM stream;

separately transmitting, via at least one network, each respective CDM stream of the encoded CDM streams and the texture for display on a client device.

2 . The method of claim 1 , wherein identifying key depth ranges and non-key depth ranges within the CDMs further comprises:

performing object detection on the image data to identify a plurality of objects;

causing an image processing application to determine a plurality of key objects and a plurality of non-key objects among the plurality of objects; and

identifying respective depth ranges of each key object of the plurality key objects and respective depth ranges of each non-key object of the plurality non-key objects, wherein the respective depth ranges corresponding to the plurality of key objects corresponds to the key depth ranges, and the respective depth ranges corresponding to the plurality of non-key objects corresponds to the non-key depth ranges.

3 . The method of claim 1 , wherein the texture data further comprises color information of the accessed image data.

4 . The method of claim 1 further comprising:

encoding the texture data into an encoded texture data; and

transmitting the encoded texture data to the client device for display synchronized with the transmitting the encoded CDMs to the client device for display.

5 . The method of claim 1 , wherein the client device is a mobile device.

6 . The method of claim 1 , wherein the client device is a head-mounted display.

7 . The method of claim 1 , wherein separately transmitting, via at least one network, each respective CDM stream of the encoded CDM streams and the texture for display on the client device are done in parallel.

8 . The method of claim 1 , wherein each CDM correspond to a focal plane of a multiple focal plane (MFP), the method further comprising:

generating a plurality of component depth map focal planes (CDMFPs).

9 . The method of claim 1 , further comprising:

scaling data in each CDM, wherein each respective CDM is scaled by a respective scaling factor.

10 . The method of claim 1 , further comprising:

causing the client device to reconstruct the plurality of encoded CDM streams by prioritizing the CDM streams corresponding to the key depth ranges.

11 . A system comprising:

control circuitry configured to:

access image data comprising texture data and depth data for a video content item;

decompose the depth data into a plurality of component depth maps (CDMs);

identify key depth ranges and non-key depth ranges within the CDMs;

encode the plurality of CDMs into a plurality of CDM streams;

wherein the encoding comprises coding the key depth ranges with a first bit rate and the non-key depth ranges with a second bit rate, wherein the first bit rate is higher than the second bit rate; and

wherein the encoding comprises separately encoding each respective CDM stream of the plurality of CDM streams using an inter-coding technique for respective frames of the respective CDM stream;

at least one network circuitry configured to:

separately transmit, via at least one network, each respective CDM stream of the encoded CDM streams and the texture for display on a client device.

12 . The system of claim 11 , wherein the control circuitry configured to identify key depth ranges and non-key depth ranges within the CDMs, is further configured to:

comprises:

perform object detection on the image data to identify a plurality of objects;

cause an image processing application to determine a plurality of key objects and a plurality of non-key objects among the plurality of objects; and

identify respective depth ranges of each key object of the plurality key objects and respective depth ranges of each non-key object of the plurality non-key objects, wherein the respective depth ranges corresponding to the plurality of key objects corresponds to the key depth ranges, and the respective depth ranges corresponding to the plurality of non-key objects corresponds to the non-key depth ranges.

13 . The system of claim 11 , wherein the texture data further comprises color information of the accessed image data.

14 . The system of claim 11 , wherein the control circuitry is further configured to:

encode the texture data into an encoded texture data; and

the network circuitry is further configured to:

transmitting the encoded texture data to the client device for display synchronized with the transmitting the encoded CDMs to the client device for display.

15 . The system of claim 11 , wherein the client device is a mobile device.

16 . The system of claim 11 , wherein the client device is a head-mounted display.

17 . The system of claim 11 , wherein separately transmitting, via at least one network, each respective CDM stream of the encoded CDM streams and the texture for display on the client device are done in parallel.

18 . The system of claim 11 , wherein each CDM correspond to a focal plane of a multiple focal plane (MFP), the control circuitry further configured to:

generate a plurality of component depth map focal planes (CDMFPs).

19 . The system of claim 11 , wherein the control circuitry is further configured to:

scale data in each CDM, wherein each respective CDM is scaled by a respective scaling factor.

20 . The system of claim 11 , wherein the control network circuitry is further configured to:

cause the client device to reconstruct the plurality of encoded CDM streams by prioritizing the CDM streams corresponding to the key depth ranges.