Method and device for processing video signal
The present invention encodes a warp map by using a video codec such as a multi-view texture image by a warp converter, and decodes a warp map by using a video codec such as a multi-view texture image by using a warp inverter. The present invention may incur less additional costs because it does not use a dedicated warp map coder. In addition, the present invention may convert a warp map by using a warp map converter and send the converted map to an encoder and invert decoded warp map information by using a warp map inverter so that the warp map is encoded and decoded by using a video codec such as a multi-view texture image. In addition, it is possible to increase compatibility by enabling various kinds of supplementary data to be used. In addition, it is possible to increase technique compatibility by simply applying a warp map scheme to a 3D video coding technique using a depth map.
1. A video encoding apparatus, comprising:
a warp calculator for generating a warp map from a multiview texture image comprising a plurality of pixels;
a warp converter for converting the warp map into a warp residual; and
a multiview video encoder for encoding the multiview texture image and the warp residual,
wherein the warp map indicates coordinate information corresponding to each pixel of the plurality of pixels of the multiview texture image,
wherein the warp calculator generates shift information using depth information which is extracted from the multiview texture image, estimates saliency map information using the depth information, extracts a vertical edge region from the multiview texture image, and generates the warp map using the shift information, the saliency map information and the vertical edge region,
wherein the shift information indicates a degree by which the each pixel of the plurality of pixels of the multiview texture image is shifted,
wherein the saliency map information indicates a degree of distinctness in the multiview texture image,
wherein the vertical edge region indicates a vertical component of a foreground or background in the multiview texture image.
2. The video encoding apparatus according to claim 1 , wherein the warp converter further comprises a linear predictor for generating a predicted value using the width of the multiview texture image and the width of the warp map and generating the warp residual using the warp map and the predicted value.
3. The video encoding apparatus according to claim 1 , wherein the warp residual includes at least one of a maximum value, a minimum value and a residual precision,
wherein the warp converter further comprises a residual quantizer for converting the warp residual into an integer using at least one of the maximum value, the minimum value and the residual precision.
4. A video decoding apparatus, comprising:
a multiview video decoder for receiving a bitstream including a warp residual and a multiview texture image comprising a plurality of pixels; p 1 a warp reconverter for reconstructing a warp map using the warp residual including at least one of a maximum value, a minimum value, and a residual precision; and
an image domain warper for generating a multiview video using the multiview texture image and the warp map,
wherein the warp map indicates coordinate information corresponding to each pixel of the plurality of pixels of the multiview texture image,
wherein the warp reconverter includes a liner compensator and a residual dequantizer,
wherein liner compensator generates a predicted value using a width of the multiview text image and a width of the warp map,
wherein the residual dequantizer dequantizes the warp residual using at least one of the maximum value, the minimum value, and the residual precision, to obtain a dequantized wrap residual,
wherein the wrap reconverter reconstructs the warp map using the dequantized warp residual and the predicted value.
5. The video decoding apparatus according to claim 4 , wherein the multiview video decoder receives supplementary data type whether supplementary data in the bitstream is depth type or warp map type.
6. The video decoding apparatus according to claim 4 , wherein the maximum value and the minimum value are obtained from a slice header.
7. The video decoding apparatus according to claim 4 , wherein the maximum value and the minimum value are obtained from a sequence.
8. The video decoding apparatus according to claim 4 , wherein the residual precision is obtained using a floating maximum value and a floating minimum value.