Method for processing immersive video and method for producing immersive video
Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for input videos; extracting patches from the input videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include information on a priority order of pruning among input videos.
1. An immersive video synthesizing method, the method comprising:
parsing video data and metadata from a bitstream;
obtaining at least one atlas by decoding the video data; and
extracting patches required for synthesizing a viewport video based on the metadata,
wherein the metadata comprise information on pruning priority order between a plurality of views,
wherein the information comprises a flag which is used for determining whether priority view information for a current view is present in the metadata or not,
wherein the priority view information comprises number information indicating a number of priority views and identity information specifying at least one priority view of the current view, and
wherein the at least one priority view is at an upper or lower node of the current view on a pruning graph.
2. The immersive video synthesizing method of claim 1 ,
wherein the viewport video is reconstructed by a weighted sum of the current view and the at least one priority view, and
wherein a weight allocated to each of the current view and the at least one priority view is determined based on pruning priority orders of the current view and the at least one priority view.
3. The immersive video synthesizing method of claim 2 ,
wherein a weight allocated to a parent node among the current view and the at least one priority view has a greater value than a weight allocated to a child node among the current view and the at least one priority view.
4. The immersive video synthesizing method of claim 1 ,
wherein the metadata comprises partition information on an atlas, and
wherein the metadata further comprises information for identifying a tile to which a patch in the atlas belongs.
5. The immersive video synthesizing method of claim 1 ,
wherein the metadata further comprises media information for indicating whether or not heterogeneous media data is comprised in the video data, and
wherein, when the media information indicates that the heterogeneous media data is comprised in the video data, the metadata further comprises media information for indicating a type or attribute of the heterogeneous media data.
6. The method of claim 5 ,
wherein, when the media information indicates that the heterogeneous media data is comprised in the video data, the metadata further comprise ambient light information, and
wherein the ambient light information comprises at least one of first ambient light information for a target space in which an object included in the heterogeneous media data is jointly reproduced or second ambient light information of the object included in the heterogeneous media data.
7. The method of claim 1 ,
wherein the metadata further comprises a complete view flag indicating whether the atlas comprises complete information for a specific view or not.
8. An immersive video processing method, the method comprising:
determining a pruning priority order for input videos;
extracting patches from pruned input videos;
generating at least one atlas based on the extracted patches; and
encoding metadata,
wherein the metadata comprise information on the pruning priority order,
wherein the information comprises a flag used for determining whether priority view information for a current view is present in the metadata or not,
wherein the priority view information comprises number information indicating a number of priority views and identity information specifying at least one priority view of the current view, and
wherein the at least one priority view is at an upper or lower node of the current view on a pruning graph.
9. The immersive video processing method of claim 8 ,
wherein the metadata further comprises partition information on an atlas and information for identifying a tile to which the patch in the atlas belongs.
10. The immersive video processing method of claim 8 ,
wherein the metadata further comprises media information for indicating whether or not heterogeneous media data is comprised in the at least one atlas, and
wherein, when the heterogeneous media data is comprised in the at least one atlas, the metadata further comprises media information for indicating a type or an attribute of the heterogeneous media data.