Method for processing immersive video and method for producing immersive video

1. An immersive video synthesizing method, the method comprising:

receiving a bitstream comprising video data and metadata;

obtaining an atlas by decoding the video data; and

extracting patches required for view synthesis from the atlas based on the metadata,

wherein, based on a threshold value, whether a pixel in a patch is occupied by a valid pixel or an invalid pixel is determined,

wherein the metadata comprises a threshold information flag which indicates whether threshold information is individually decoded for each of patches or not,

wherein when the threshold information flag indicates that threshold information is not individually decoded for each of patches, a threshold value is determined based on first threshold information signaled for a view, and

wherein when the flag indicates that threshold information is individually decoded for each of patches, the threshold value is determined based on second threshold information signaled for the patch.

2. The immersive video synthesizing method of claim 1 , wherein the metadata further comprise minimum value information indicating a minimum depth value in the atlas and maximum value information indicating a maximum depth value in the atlas.

3. The immersive video synthesizing method of claim 1 ,

wherein the metadata further comprise a occupancy embedded flag indicating whether or not occupancy information is embedded into the atlas video or not, and

wherein the threshold information flag is decoded only when the occupancy embedded flag indicates that occupancy information is embedded into the atlas video.

4. The immersive video synthesizing method of claim 3 ,

wherein when the occupancy embedded flag indicates that the occupancy information is not embedded into the atlas, whether the pixel is occupied by the valid pixel or the invalid pixel is determined based on an occupancy map.

5. The immersive video synthesizing method of claim 4 ,

wherein the metadata further comprise a occupancy map size flag indicating whether the occupancy map is allowed to have a different size different from the atlas.

6. The immersive video synthesizing method of claim 1 ,

wherein, in the atlas video, if the pixel has a value smaller than the threshold value, the pixel is determined to be occupied by the invalid pixel, and if the pixel has a value equal or greater than the threshold value, the pixel is determined as occupied by the valid pixel.

7. An immersive video processing method, the method comprising:

determining a priority order of source pictures;

extracting patches from the source pictures by performing pruning based on the priority order;

generating an atlas based on the extracted patches; and

encoding metadata,

wherein, if a pixel in a patch is occupied by a valid pixel, a value of the pixel is equal to or greater than a threshold value, and if a pixel in the patch is occupied by an invalid pixel, a value of the pixel is less than the threshold value,

wherein the metadata comprises a threshold information flag which indicates whether threshold information is individually encoded for each of patches or not is included in the metadata,

wherein when the threshold information flag indicates that threshold information is not individually encoded for each of patches, the threshold value is reflected to first threshold information signaled for a view, and

wherein when the threshold information flag indicates that threshold information is individually encoded for each of patches, the threshold value is reflected to second threshold information encoded for the patch.

8. The immersive video processing method of claim 7 ,

wherein the metadata further comprise minimum value information indicating a minimum depth value in the atlas and maximum value information indicating a maximum depth value in the atlas.

9. The immersive video processing method of claim 7 ,

wherein the threshold information flag is encoded only when occupancy information is not embedded into the atlas.