System and method for depth data coding

1. A method comprising:

accessing image data that comprises a texture data and a depth map;

decomposing the depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of a multiple focal plane (MFP) decomposition of the image data;

generating a plurality of component depth map focal planes (CDMFPs) by combining each respective CDM with the depth map;

scaling data in each CDMFP, wherein each respective CDMFP is scaled by a respective scaling factor;

generating a plurality of encoded scaled CDMFP data streams for the plurality of depth ranges, wherein each respective scaled CDMFP data stream is based at least in part on a respective scaled CDMFP; and

transmitting the plurality of encoded scaled CDMFP data streams to a client device to cause the client device to:

reconstruct the depth map based on a plurality of decoded scaled CDMFPs; and

generate for display an image based on the reconstructed depth map.

2. The method of claim 1 , wherein the combining each respective CDM with the depth map comprises multiplying each respective CDM by the depth map.

3. The method of claim 1 , wherein each respective scaling factor is based on a maximum value in the respective CDMFP.

4. The method of claim 1 , wherein the plurality of encoded scaled CDMFP data streams are transmitted in parallel as part of a data container.

5. The method of claim 4 , wherein:

the plurality of encoded scaled CDMFP data streams are synchronized with the texture data; and

the transmitting the plurality of encoded CDM data streams to a client device comprises transmitting the plurality of encoded CDMFP data streams synchronized with the texture data to cause the client device to generate for display an image based on the reconstructed depth map and the synchronized texture data received as part of a data container.

6. The method of claim 1 , wherein:

decomposing the depth map into a plurality of CDMs comprises applying a decomposition function to the depth map; and

the client is causes to reconstructing the depth map by summing de-scaled scaled CDMFPs.

7. The method of claim 6 , wherein the decomposition function is a set of tent functions.

8. The method of claim 6 , wherein the decomposition function is a set of sinusoid functions.

9. The method of claim 1 , further comprising:

identifying a key depth range by performing object detection on the image data;

selecting a key CDMFP of the plurality of CDMFPs that corresponds to the key depth range;

wherein the generating the plurality of encoded scaled CDMFP data streams comprises:

encoding the key CDMFP at higher bit rate than at least one other CDMFP of the plurality of CDMFPs.

10. The method of claim 9 , wherein the selection of the key CDMFP is performed during live streaming of the image data.

11. The method of claim 1 , wherein generating the plurality of encoded CDMFP data streams comprises:

separately pre-encoding each CDMFP at a plurality of bit rates.

12. The method of claim 11 , wherein transmitting the plurality of encoded CDMFP data streams comprises:

selecting a first bit rate of the plurality of bit rates for a first CDMFP of the plurality of CDMFPs; and

selecting a second bit rate of the plurality of bit rates for a second CDMFP of the plurality of CDMFPs;

transmitting data pre-encoded at the first bit rate for the first CDMFP; and

transmitting data pre-encoded at the second bit rate for the second CDMFP.

13. A system comprising:

control circuitry configured to:

access image data that comprises a texture data and a depth map;

decompose the depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of a multiple focal plane (MFP) decomposition of the image data;

generate a plurality of component depth map focal planes (CDMFPs) by combining each respective CDM with the depth map;

scaling data in each CDMFP, wherein each respective CDMFP is scaled by a respective scaling factor;

generate a plurality of encoded scaled CDMFP data streams for the plurality of depth ranges, wherein each respective scaled CDMFP data stream is based at least in part on a respective scaled CDMFP; and

networking circuitry configured to:

transmit the plurality of encoded scaled CDMFP data streams to a client device to cause the client device to:

reconstruct the depth map based on a plurality of decoded scaled CDMFPs; and

generate for display an image based on the reconstructed depth map.

14. The system of claim 13 , wherein the control circuitry configured to combine each respective CDM with the depth map by multiplying each respective CDM by the depth map.

15. The system of claim 13 , wherein each respective scaling factor is based on a maximum value in the respective CDMFP.

16. The system of claim 13 , wherein the networking circuitry configured to transmit the plurality of encoded scaled CDMFP data streams in parallel as part of a data container.

17. The system of claim 16 , wherein:

the control circuitry is configured to synchronize the plurality of encoded scaled CDMFP data streams with the texture data; and

the networking circuitry is configured to transmit the plurality of encoded CDM data streams to a client device by transmitting the plurality of encoded CDMFP data streams synchronized with the texture data to cause the client device to generate for display an image based on the reconstructed depth map and the synchronized texture data received as part of a data container.

18. The system of claim 13 , wherein:

the control circuitry is configured to decompose the depth map into a plurality of CDMs by applying a decomposition function to the depth map; and

the client is caused to reconstructing the depth map by summing de-scaled scaled CDMFPs.

19. The system of claim 18 , wherein the decomposition function is a set of tent functions.

20. The system of claim 18 , wherein the decomposition function is a set of sinusoid functions.