Method for processing immersive video and method for producing immersive video
Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of view videos into a base view and an additional view, generating a residual video for the additional view video classified as an additional view, packing a patch, which is generated based on the residual video, into an atlas video, and generating metadata for the patch.
1. An immersive video processing method comprising:
classifying a multiplicity of views into a base view and an additional view;
generating a residual image for a first additional view image which corresponds to a first view classified as the additional view;
packing patches, which are generated based on the residual image, into an atlas;
and generating metadata for the patches,
wherein the residual image for the first additional view image is generated through pruning with a second additional view image that corresponds to a second view classified as the additional view, and
wherein the second view is included in a same group as the first view and has a higher priority than the first view.
2. The method of claim 1 , wherein the metadata comprises transformation information for a patch, and
wherein the transformation information comprises information of horizontal translation, information of vertical translation and information of rotation for the patch.
3. The method of claim 2 , wherein the transformation information further comprises scaling information of the patch.
4. The method of claim 1 , wherein the method further comprises generating extended data that is hidden from at least one view.
5. The method of claim 4 ,
wherein the extended data is generated by inpainting a region hidden from the at least one view.
6. The method of claim 4 , wherein the extended data is packed into the atlas as a patch, and
wherein the metadata comprises scaling information for the patch corresponding to the extended data.
7. The method of claim 1 , wherein the residual view for the first additional image is generated by sequentially pruning with a base view image and the second additional view image.