Image processing apparatus and image processing method
The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a high picture quality texture image of a predetermined viewpoint using an omnidirectional image. A reception section receives a texture image and a depth image as well as a guide image to be referred to upon generation of a display image in which the texture image and the depth image are used. A drawing section compares a pixel value of the display image generated using the texture image and the depth image and a corresponding pixel value of the guide image with each other and executes a process for changing the pixel value in response to a result of the comparison. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.
1. An image processing apparatus, comprising:
a processor configured to:
receive a texture image and a depth image of a first layer, a texture image and a depth image of a second layer, and a guide image;
generate a display image including an occlusion region of the first layer in a viewing range, wherein
the display image is generated using the texture image and the depth image of the second layer based on a change in a viewpoint from a first viewpoint to a second viewpoint, and
the first viewpoint is different from the second viewpoint;
compare a pixel value of the display image with a corresponding pixel value of the guide image; and
execute a process to change the pixel value of the display image in response to a result of the comparison.
2. The image processing apparatus according to claim 1 , wherein
the texture image and the depth image of the first layer include an omnidirectional image.
3. The image processing apparatus according to claim 1 , wherein the processor is further configured to:
compare the pixel value of the display image corresponding to an imaginary region of the texture image of the second layer with the corresponding pixel value of the guide image; and
change the pixel value of the display image in response to the result of the comparison.
4. The image processing apparatus according to claim 1 , wherein the processor is further configured to:
compare the pixel value of the display image corresponding to the occlusion region of the texture image of the second layer with the corresponding pixel value of the guide image; and
change the pixel value of the display image in response to the result of the comparison.
5. The image processing apparatus according to claim 1 , wherein the processor is further configured to:
compare the pixel value of the display image generated using the texture image and the depth image with the corresponding pixel value of the guide image; and
execute a blending process to blend the pixel value of the display image and the corresponding pixel value of the guide image at a given blend ratio in response to the result of the comparison.
6. The image processing apparatus according to claim 1 , wherein the guide image includes depth information.
7. The image processing apparatus according to claim 1 , wherein a resolution of the guide image is lower than a resolution of the texture image.
8. The image processing apparatus according to claim 1 , wherein a frame rate of the guide image is lower than a frame rate of the texture image.
9. An image processing method, comprising:
in an image processing apparatus:
receiving a texture image and a depth image of a first layer, a texture image and a depth image of a second layer, and a guide image;
generating a display image including an occlusion region of the first layer in a viewing range, wherein
the display image is generated using the texture image and the depth image of the second layer based on a change in a viewpoint from a first viewpoint to a second viewpoint, and
the first viewpoint is different from the second viewpoint;
comparing a pixel value of the display image with a corresponding pixel value of the guide image; and
executing a process for changing the pixel value of the display image in response to a result of the comparison.
10. An image processing apparatus, comprising:
a processor configured to:
generate a texture image and a depth image of a first layer, a texture image and a depth image of a second layer, and a guide image; and
transmit the texture image and the depth image of the first layer and the texture image and the depth image of the second layer for generation of a display image including an occlusion region of the first layer in a viewing range, wherein
the display image is generated using the texture image and the depth image of the second layer based on a change in a viewpoint from a first viewpoint to a second viewpoint, and
the first viewpoint is different from the second viewpoint.
11. The image processing apparatus according to claim 10 , wherein
the texture image and the depth image of the first layer include an omnidirectional image.
12. The image processing apparatus according to claim 10 , wherein the guide image includes a first image of a first camera used for the generation of the texture image and the depth image of the first layer.
13. The image processing apparatus according to claim 12 , wherein the guide image further includes a second image of a second camera installed at a position different from a position of the first camera used for the generation of the texture image and the depth image of the first layer.
14. The image processing apparatus according to claim 10 , wherein the guide image further includes depth information.
15. The image processing apparatus according to claim 10 , wherein a resolution of the guide image is lower than a resolution of the texture image.
16. The image processing apparatus according to claim 10 , wherein a frame rate of the guide image is lower than a frame rate of the texture image.
17. An image processing method, comprising:
in an image processing apparatus:
generating a texture image and a depth image of a first layer and a texture image and a depth image of a second layer, and a guide image; and
transmitting the texture image and the depth image of the first layer and the texture image and the depth image of the second layer for generation of a display image including an occlusion region of the first layer in a viewing range, wherein
the display image is generated using the texture image and the depth image of the second layer based on a change in a viewpoint from a first viewpoint to a second viewpoint, and
the first viewpoint is different from the second viewpoint.