Method and apparatus for encoding and decoding volumetric video
Methods, devices and stream are disclosed to encode and decode a volumetric content. At the encoding, the space of the volumetric content is divided in distinct sectors according to at least two different sectorizations. One atlas is generated for each sectorization or a single atlas is generated encoding all the sectorizations. At the decoding, a sectorization is selected according to the current direction and field of view, according to user's gaze navigation and according to prediction of the upcoming pose of the virtual camera controlled by the user. Sectors are selected according the selected sectorization and the current direction and field of view and only patches encoded in regions of the atlas associated with these sectors are accessed to generate the viewport image representative of the content seen from the current point of view.
1. A method comprising:
selecting a sectorization of a 3D space of a volumetric content among at least two different sectorizations of the 3D space and a sector of the selected sectorization according to a view direction within the 3D space, wherein each of the at least two different sectorizations divides the 3D space in disjointed sectors;
obtaining an atlas image representative of the volumetric content, the atlas image being organized according to the at least two different sectorizations, wherein a region of the atlas image is associated with a sector of each of the at least two different sectorizations; and
rendering the volumetric content for the view direction by accessing regions of the atlas image associated with the disjointed sectors.
2. The method of claim 1 , wherein the atlas image is packing patch pictures, a patch picture belonging to one region of the atlas image and being a projection of points of the volumetric content comprised in the sectors of the 3D space associated with the one region.
3. The method of claim 1 , wherein the selecting a sectorization is performed according to a change of the view direction in time.
4. The method of claim 1 , wherein the volumetric content is a volumetric video and wherein the selecting a sectorization is performed for a group of pictures of the volumetric video.
5. The method of claim 1 , wherein the atlas image is obtained from a data stream comprising metadata associating the region of the atlas image with the sectors of the at least two different sectorizations.
6. The method of claim 1 , wherein the selecting a sectorization is performed according to a prediction of a future value of the view direction.
7. A non-transitory computer readable storage medium having stored thereon instructions for implementing the method of claim 1 when executed by one or more processors.
8. A device comprising a processor configured for:
selecting a sectorization of a 3D space of a volumetric content among at least two different sectorizations of the 3D space and a sector of the selected sectorization according to a view direction within the 3D space, wherein each of the at least two different sectorizations divides the 3D space in disjointed sectors;
obtaining an atlas image representative of the volumetric content, the atlas image being organized according to the at least two different sectorizations, wherein a region of the atlas image is associated with a sector of each of the at least two different sectorizations; and
rendering the volumetric content for the view direction by accessing regions of the atlas image associated with the disjointed sectors.
9. The device of claim 8 , wherein the processor selects a sectorization according to a change of the view direction in time.
10. The device of claim 8 , wherein the volumetric content is a volumetric video and wherein the processor selects a sectorization for a group of pictures of the volumetric video.
11. The device of claim 8 , wherein the processor selects a sectorization is according to a prediction of a future value of the view direction.
12. The device of claim 8 , wherein the atlas image is packing patch pictures, a patch picture belonging to one region of the atlas image and being a projection of points of the volumetric content comprised in the sectors of the 3D space associated with the one region.
13. The device of claim 8 , wherein the atlas image is obtained from a data stream comprising metadata associating the region of the atlas image with the sectors of the at least two different sectorizations.
14. A method comprising:
determining at least two different sectorizations of a 3D space of a volumetric content, wherein a sectorization divides the 3D space in disjointed sectors; and
generating an atlas image divided in regions, wherein each region is associated with a sector of each of the at least two different sectorizations,
wherein points of the volumetric content comprised in sectors of the 3D space are projected into pixels of a region associated with the disjointed sectors.
15. A non-transitory computer readable storage medium having stored thereon instructions for implementing the method of claim 14 when executed by one or more processors.
16. A device comprising a processor configured for:
determining at least two different sectorizations of a 3D space of a volumetric content, wherein a sectorization divides the 3D space in disjointed sectors; and
generating an atlas image divided in regions, wherein each region is associated with a sector of each of the at least two different sectorizations:
wherein points of the volumetric content comprised in sectors of the 3D space are projected into pixels of a region associated with the disjointed sectors.