Image processing device and image processing method
The present disclosure relates to an image processing device and an image processing method for achieving an easy change of a display mode of each object in live-action content. The image processing device includes an image generation section that changes a display mode of each of objects within a display image on the basis of segment information that indicates a position of a segment in which each of the objects is present, the position of the segment being a position in each of a plurality of layer images that are images generated on the basis of a plurality of captured images and are images classified into a plurality of layers in accordance with distances of the images from a predetermined visual point. For example, the present disclosure is applicable to a display device or the like.
1. An image processing device, comprising:
a central processing unit (CPU) configured to:
generate segment information that indicates a respective position of each segment of a plurality of segments, wherein
the respective position of the each segment is in a respective layer image of a plurality of layer images;
the plurality of layer images corresponds to a plurality of captured images,
each layer image of the plurality of layer images corresponds to a respective layer of a plurality of layers based on a respective distance of the each layer image from a visual point,
a first segment of the plurality of segments includes a first object of a plurality of objects,
the first segment is in a first layer image of the plurality of layer images,
a second segment of the plurality of segments includes a second object of the plurality of objects,
the second segment is in a second layer image of the plurality of layer images, and
the first layer image is different from the second layer image;
determine the first object is same as the second object;
associate the first segment with the second segment based on the determination that the first object in the first segment is same as the second object in the second segment;
generate a display image based on the plurality of layer images, the segment information, and the association of the first segment with the second segment, wherein the display image includes a set of objects of the plurality of objects; and
change a display mode of each object of the set of objects in the display image based on the segment information.
2. The image processing device according to claim 1 , wherein the segment information indicates the respective position of each segment of the plurality of segments in a layer direction and a pixel direction.
3. The image processing device according to claim 2 , wherein
each layer image of the plurality of layer images includes:
a plurality of pixels; and
the plurality of segments, and
the segment information indicates a segment the plurality of segments, corresponding to each pixel of the plurality of pixels, in the respective layer image of the plurality of layer images.
4. The image processing device according to claim 1 , wherein the CPU is further configured to:
divide each layer image of the plurality of layer images into the plurality of segments; and
generate the segment information based on the divide of the each layer image.
5. The image processing device according to claim 1 , wherein the CPU is further configured to
generate the display image based on a pixel of the second segment different from the first segment, without utilization of a pixel of the first segment, wherein
the pixel of the first segment of the first layer image is in a first layer of the plurality of layers,
the pixel of the first segment corresponds to a third object set to a non-display state,
a position of the pixel of the second segment in the second layer image corresponds to a position of the pixel of the first segment in the first layer image of the first layer, and
the pixel of the second segment of the second layer image is in a second layer of the plurality of layers lower than the first layer.
6. The image processing device according to claim 1 , wherein
the plurality of captured images is captured from a plurality of visual points,
visual points of the plurality of visual points are different,
each captured image of the plurality of captured images corresponds to a respective visual point of the plurality of visual points, and
the plurality of visual points surround at least a part of a periphery of a region that includes each object of the plurality of objects.
7. The image processing device according to claim 6 , wherein
generation of the plurality of layer images is based on a three-dimensional model, and
the three-dimensional model is based on the plurality of captured images captured from the plurality of visual points.
8. The image processing device according to claim 1 , wherein images of the plurality of captured images are captured at different times from the visual point.
9. The image processing device according to claim 1 , wherein
each object of the plurality of objects corresponds to a respective layer image of the plurality of layer images,
the each object of the respective layer image is at a distance from the visual point in a visual direction, and
the distance of the each object is one of equal to or larger than a threshold value of the respective layer image.
10. The image processing device according to claim 1 , wherein each layer image of the plurality of layer images includes:
a texture image; and
a depth image.
11. An image processing method, comprising:
generating segment information that indicates a respective position of each segment of a plurality of segments, wherein
the respective position of the each segment is in a respective layer image of a plurality of layer images,
the plurality of layer images is based on a plurality of captured images,
each layer image of the plurality of layer images corresponds to a respective layer of a plurality of layers based on a respective distance of the each layer image from a visual point,
a first segment of the plurality of segments includes a first object of a plurality of objects,
the first segment is in a first layer image of the plurality of layer images,
a second segment of the plurality of segments includes a second object of the plurality of objects,
the second segment is in a second layer image of the plurality of layer images, and
the first layer image is different from the second layer image;
determining the first object is same as the second object;
associating the first segment with the second segment based on the determination that the first object in the first segment is same as the second object in the second segment;
generating a display image based on the plurality of layer images, the segment information, and the association of the first segment with the second segment, wherein the display image includes a set of objects of the plurality of objects; and
changing a display mode of each object of the set of objects in the display image based on the segment information.