IMAGE PROCESSING APPARATUS AND IMAGE PROCESSING METHOD
A multiview video decoding apparatus receives and decodes an encoded stream obtained as a result of encoding residual information, 2D images for N views, and depth images for N views, the residual information being the error between synthetic-view images generated using the 2D images for N views and the depth images for N views, and 2D images for (M−N) views at the view synthesis positions of the synthetic-view images. A view synthesizing apparatus generates the synthetic-view images by using the 2D images and depth images for N views decoded by the multiview video decoding apparatus. A residual information compensating apparatus adds the residual information into the generated synthetic-view images. The apparatus may be applied to a system that conducts view synthesis, for example.
1 - 13 . (canceled)
14 . An image processing apparatus comprising:
receiving means that receives residual information, which is the error between synthetic-view images generated using reference 2D images and depth information, and 2D images at view synthesis positions of the synthetic-view images;
encoding means that generates an encoded stream by encoding the reference 2D images, and generates a residual stream by encoding the residual information received by the receiving means; and
transmitting means that transmits the residual stream generated by the encoding means, the depth information, and the encoded stream generated by the encoding means.
15 . The image processing apparatus according to claim 14 , wherein
the encoding means generates a depth stream by encoding the depth information, and
the transmitting means transmits the residual stream, the depth stream generated by the encoding means, and the encoded stream.
16 . The image processing apparatus according to claim 14 , further comprising:
computing means that computes the residual information by calculating the error between the synthetic-view images and 2D images at the view synthesis positions of the synthetic-view images.
17 . The image processing apparatus according to claim 14 , wherein
the number of views in the reference 2D images is N, and
the number of views in the synthetic-view images is the value obtained by subtracting N from M, where M is greater than N.
18 . The image processing apparatus according to claim 17 , wherein
the number of views in the reference 2D images is 2, and
the number of views in the synthetic-view images is 6.
19 . The image processing apparatus according to claim 14 , wherein
the receiving means also receives residual presence information indicating whether or not residual information exists for the synthetic-view images, and
the transmitting means also transmits the residual presence information received by the receiving means.
20 . The image processing apparatus according to claim 14 , wherein
the residual information is the error between outer synthetic-view images and 2D images at the view synthesis positions of the outer synthetic-view images, the outer synthetic-view images being the synthetic-view images at view synthesis positions farther outward than the views of the reference 2D images.
21 . The image processing apparatus according to claim 20 , wherein
the receiving means receives outer residual presence information indicating whether or not an error exists between the outer synthetic-view images and 2D images at the view synthesis positions of the outer synthetic-view images, and
the transmitting means also transmits the outer residual presence information received by the receiving means.
22 . The image processing apparatus according to claim 14 , wherein
the residual information is the error between inner synthetic-view images and 2D images at the view synthesis positions of the inner synthetic-view images, the inner synthetic-view images being the synthetic-view images at view synthesis positions farther inward than the views of the reference 2D images.
23 . An image processing method comprising:
a receiving in which an image processing apparatus receives residual information, which is the error between synthetic-view images generated using reference 2D images and depth information, and 2D images at view synthesis positions of the synthetic-view images;
an encoding in which the image processing apparatus generates an encoded stream by encoding the reference 2D images, and generates a residual stream by encoding the residual information received in the receiving; and
a transmitting in which the image processing apparatus transmits the residual stream generated in the encoding, the depth information, and the encoded stream generated in the encoding.
24 . An image processing apparatus comprising:
receiving means that receives a residual stream and depth information, the residual stream being an encoded stream of residual information which is the error between synthetic-view images generated using reference 2D images and the depth information, and 2D images at view synthesis positions of the synthetic-view images;
decoding means that decodes the residual stream and an encoded stream obtained as a result of encoding the reference 2D images;
generating means that generates the synthetic-view images using the reference 2D images decoded by the decoding means and the depth information received by the receiving means; and
residual information compensating means that adds the residual information decoded by the decoding means into the synthetic-view images generated by the generating means.
25 . An image processing method comprising:
a receiving in which an image processing apparatus receives a residual stream and depth information, the residual stream being an encoded stream of residual information which is the error between synthetic-view images generated using reference 2D images and the depth information, and 2D images at view synthesis positions of the synthetic-view images;
a decoding in which the image processing apparatus decodes the residual stream and an encoded stream obtained as a result of encoding the reference 2D images;
a generating in which the image processing apparatus generates the synthetic-view images using the reference 2D images decoded in the decoding step and the depth information received in the receiving; and
a residual information compensating in which the image processing apparatus adds the residual information decoded in the decoding into the synthetic-view images generated in the generating.