Method for generating residual image of multi-view video and apparatus using the same
Disclosed herein are a method and apparatus for generating a residual image of multi-view video. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and detecting outliers in the pruning mask using color information of the basic view image and the additional view image.
1. A method for generating a residual image of multiple-view video, comprising:
generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images; and
revalidating the pruning mask using color information of the basic view image and the additional view image,
wherein revalidating the pruning mask comprises:
defining a color relationship between the basic view image and the additional view image by extracting corresponding pixels of the basic view image and the additional view image, which correspond to pruning candidates of the pruning mask; and
detecting pixels that do not match the color relationship, among pixels of the pruning mask, as outliers.
2. The method of claim 1 , wherein generating the pruning mask comprises:
generating a pruning graph based on information about relationships between the multi-view images.
3. The method of claim 1 , further comprising:
generating patches based on the pruning mask in which the outliers are updated to be preserved.
4. The method of claim 3 , further comprising:
packing the patches in units of atlases.
5. The method of claim 1 , wherein the color relationship is defined using a least square method for the corresponding pixels.
6. The method of claim 1 , wherein the color relationship is defined using all pixels corresponding to the pruning candidates of the pruning mask.
7. The method of claim 2 , wherein the color relationship is defined only between images having a direct relation therebetween in the pruning graph.
8. The method of claim 7 , wherein a color relationship between images having an indirect relation therebetween is estimated using the color relationship between the images having the direct relation therebetween.
9. The method of claim 1 , wherein defining the color relationship is configured to define a representative color relationship between the basic view image and the additional view image at regular intervals.
10. An apparatus for generating a residual image of multiple-view video, comprising:
a first pruning unit for generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images; and
a second pruning unit for revalidating the pruning mask using color information of the basic view image and the additional view image,
wherein the second pruning unit defines a color relationship between the basic view image and the additional view image by extracting corresponding pixels of the basic view image and the additional view image, which correspond to pruning candidates of the pruning mask, and detects pixels that do not match the color relationship, among pixels of the pruning mask, as outliers.
11. The apparatus of claim 10 , wherein the first pruning unit generates a pruning graph based on information about relationships between the multi-view images.
12. The apparatus of claim 10 , further comprising:
a patch generation unit for generating patches based on the pruning mask in which the outliers are updated to be preserved.
13. The apparatus of claim 12 , further comprising:
a packing unit for packing the patches in units of atlases.
14. The apparatus of claim 10 , wherein the color relationship is defined using a least square method for the corresponding pixels.
15. The apparatus of claim 10 , wherein the second pruning unit defines the color relationship using all pixels corresponding to the pruning candidates of the pruning mask.
16. The apparatus of claim 11 , wherein the second pruning unit defines a color relationship only between images having a direct relation therebetween in the pruning graph.
17. The apparatus of claim 16 , wherein a color relationship between images having an indirect relation therebetween is estimated using the color relationship between the images having the direct relation therebetween.
18. The apparatus of claim 10 , wherein the second pruning unit defines a representative color relationship between the basic view image and the additional view image at regular intervals.