Decoder-centric UV codec for free-viewpoint video streaming

1. A method comprising:

preprocessing free viewpoint video content;

encoding, using an encoder, the free viewpoint video content into encoded free viewpoint video content using a decoded geometry;

generating camera identification information, using a decoder, to be utilized to decode the encoded free viewpoint video content into decoded free viewpoint video content;

decoding, using the decoder, the encoded free viewpoint video content into the decoded free viewpoint video content; and

rendering the decoded free viewpoint video content on a device, wherein rendering the decoded free viewpoint video content utilizes decoded shape information, decoded texture information and the camera identification information.

2. The method of claim 1 wherein preprocessing the free viewpoint video content includes mesh generation, mesh tracking, UV atlas generation and texture mapping.

3. The method of claim 2 wherein the UV atlas generation and the texture mapping utilize a decoded shape from the decoder.

4. The method of claim 1 wherein encoding the free viewpoint video content includes encoding vertices coordinates using a geometry encoder and encoding textures using UV texture encoder.

5. The method of claim 1 wherein decoding the free viewpoint video content includes decoding using a geometry decoder and a UV texture decoder.

6. The method of claim 1 further comprising acquiring the free viewpoint video content using at most 10 video cameras.

7. The method of claim 1 further comprising acquiring the free viewpoint video content using video cameras with at least 30 degrees of separation on every axis from other cameras.

8. The method of claim 1 further comprising signaling of usage of a multi-layer texture for view-dependent rendering.

9. The method of claim 1 further comprising associating a camera identification to a pixel in each texture layer of a multi-layer texture representation.

10. An apparatus comprising:

a non-transitory memory for storing an application, the application for:

preprocessing free viewpoint video content;

encoding, using an encoder, the free viewpoint video content into encoded free viewpoint video content using a decoded geometry; and

a processor coupled to the memory, the processor configured for processing the application.

11. The apparatus of claim 10 wherein preprocessing the free viewpoint video content includes mesh generation, mesh tracking, UV atlas generation and texture mapping.

12. The apparatus of claim 11 wherein the UV atlas generation and the texture mapping utilize a decoded shape from the decoder.

13. The apparatus of claim 10 wherein encoding the free viewpoint video content includes encoding vertices coordinates using a geometry encoder and encoding textures using UV texture encoder.

14. An apparatus comprising:

a non-transitory memory for storing an application, the application for:

generating camera identification information, using a decoder, to be utilized to decode encoded free viewpoint video content into decoded free viewpoint video content;

decoding, using the decoder, the encoded free viewpoint video content into the decoded free viewpoint video content by generating the camera identification information at the decoder to be utilized to decode the encoded free viewpoint video content into the decoded free viewpoint video content; and

rendering the decoded free viewpoint video content, wherein rendering the decoded free viewpoint video content utilizes decoded shape information, decoded texture information and the camera identification information; and

a processor coupled to the memory, the processor configured for processing the application.

15. The apparatus of claim 14 wherein decoding the free viewpoint video content includes decoding using a geometry decoder and a UV texture decoder.

16. A system comprising:

a plurality of camera devices each configured for capturing free viewpoint video content;

a first computing device configured for:

preprocessing free viewpoint video content; and

encoding, using an encoder, the free viewpoint video content into encoded free viewpoint video content using a decoded geometry; and

a second computing device configured for:

generating camera identification information, using a decoder, to be utilized to decode the encoded free viewpoint video content into decoded free viewpoint video content;

decoding, using the decoder, the encoded free viewpoint video content into the decoded free viewpoint video content; and

rendering the decoded free viewpoint video content on the second computing device, wherein rendering the decoded free viewpoint video content utilizes decoded shape information, decoded texture information and the camera identification information.

17. The system of claim 16 wherein preprocessing the free viewpoint video content includes mesh generation, mesh tracking, UV atlas generation and texture mapping.

18. The system of claim 16 wherein the UV atlas generation and the texture mapping utilize a decoded shape from the decoder.

19. The system of claim 16 wherein encoding the free viewpoint video content includes encoding vertices coordinates using a geometry encoder and encoding textures using UV texture encoder.

20. The system of claim 16 wherein decoding the free viewpoint video content includes decoding using a geometry decoder and a UV texture decoder.

21. The system of claim 16 wherein the second computing device is further configured for generating the camera identification information at the decoder to be utilized to decode the encoded free viewpoint video content into the decoded free viewpoint video content.