Image processing apparatus and image processing method

1. An image processing apparatus, comprising:

a receiving section configured to receive depth image data and a texture image, wherein

the depth image data includes:

a depth image in a Y component in a YCbCr format; and

for each of two pixels of the texture image, auxiliary information in CbCr components in the YCbCr format,

the auxiliary information for a first pixel of the two pixels indicates that the first pixel corresponds to one of a foreground pixel or a background pixel, and

the auxiliary information for a second pixel of the two pixels indicates that the second pixel corresponds to one of the foreground pixel or the background pixel; and

an auxiliary information utilization section configured to execute a specific image process on at least one of the texture image or the depth image, wherein

the specific image process is executed based on the auxiliary information associated with each of the first pixel and the second pixel,

the auxiliary information for each of the first pixel and the second pixel of the texture image further includes N types of gradation values,

N×N gradation values indicate a combination of the auxiliary information associated with the first pixel and the auxiliary information associated with the second pixel, and

the CbCr components further includes a gradation value out of the N×N gradation values.

2. The image processing apparatus according to claim 1 , wherein

the receiving section is further configured to:

receive first texture image data associated with the texture image and the depth image data of a first layer; and

receive second texture image data associated with the texture image and the depth image data of a second layer, and

the auxiliary information utilization section is further configured to execute the specific image process on at least one of the texture image or the depth image for each of the first layer and the second layer.

3. The image processing apparatus according to claim 1 , wherein the YCbCr format includes a YCbCr420 format in which a Cr component and a Cb component are shared among 2×2, that is, four pixels.

4. The image processing apparatus according to claim 1 , wherein the auxiliary information, for each of the first pixel and the second pixel, further includes region information to identify a region associated with the texture image.

5. The image processing apparatus according to claim 1 , wherein

the auxiliary information, for each of the first pixel and the second pixel, further includes edge information that indicates a portion of the texture image, and

the portion of the texture image is an edge portion.

6. The image processing apparatus according to claim 1 , wherein the auxiliary information, for each of the first pixel and the second pixel, further includes information that indicates an alpha value for alpha blending on the texture image.

7. The image processing apparatus according to claim 1 , wherein the auxiliary information, for each of the first pixel and the second pixel, further includes information that indicates a layer number associated with the texture image.

8. The image processing apparatus according to claim 1 , wherein the auxiliary information, for each of the first pixel and the second pixel, further includes information that indicates validity of a triangle patch on the texture image.

9. An image processing method, comprising:

causing an image processing apparatus to receive depth image data and a texture image, wherein

the depth image data includes:

a depth image in a Y component in a YCbCr format,

for each of two pixels of the texture image, auxiliary information in CbCr components in the YCbCr format;

the auxiliary information for a first pixel of the two pixels indicates that the first pixel corresponds to one of a foreground pixel or a background pixel, and

the auxiliary information for a second pixel of the two pixels indicates that the second pixel corresponds to one of the foreground pixel or the background pixel; and

causing the image processing apparatus to execute a specific image process on at least one of the texture image or the depth image, wherein

the specific image process is executed based on the auxiliary information associated with each of the first pixel and the second pixel,

the auxiliary information for each of the first pixel and the second pixel of the texture image further includes N type of gradation value,

N×N gradation values indicate a combination of the auxiliary information associated with the first pixel and the auxiliary information associated with the second pixel, and

the CbCr components further includes a gradation value out of the N×N gradation values.

10. An image processing apparatus, comprising:

an image data generation section configured to:

generate depth image data that includes:

a depth image of an omnidirectional image in a Y component in a YCbCr format, and

for each of two pixels of a texture image of the omnidirectional image, auxiliary information in CbCr components in the YCbCr format, wherein

for each of two pixels of the texture image, the auxiliary information is utilized in a process of at least one of the texture image or the depth image,

the auxiliary information for a first pixel of the two pixels indicates that the first pixel corresponds to one of a foreground pixel or a background pixel,

the auxiliary information for a second pixel of the two pixels indicates that the second pixel corresponds to one of the foreground pixel or the background pixel, and

the auxiliary information for each of the first pixel and the second pixel of the texture image further includes N types of gradation values; and

store a gradation value out of N×N gradation values in the CbCr components, wherein the N×N gradation values indicate a combination of the auxiliary information associated the first pixel and the auxiliary information associated with the second pixel.

11. The image processing apparatus according to claim 10 , wherein the image data generation section is further configured to generate the depth image data associated with each of first depth image of a first layer and second depth image of a second layer.

12. The image processing apparatus according to claim 10 , wherein the YCbCr format includes a YCbCr420 format in which a Cr component and a Cb component are shared among 2×2, that is, four pixels.

13. The image processing apparatus according to claim 12 , wherein the image data generation section is further configured to:

encode the depth image data in the YCbCr420 format;

determine that the gradation value before and after encoding is not lossless;

increase a bitrate of the depth image data based on the determination; and

compress and encode the depth image data in the YCbCr420 format based on the increased bitrate.

14. The image processing apparatus according to claim 13 , wherein based on the increased bitrate of the depth image data, the image data generation section is further configured to:

lower a bitrate of texture image data in which the texture image is stored; and

compress and encode the texture image data.

15. The image processing apparatus according to claim 12 , wherein the image data generation section is further configured to:

encode the depth image data in the YCbCr420 format,

determine that the gradation value before and after the encoding is not lossless,

change a value of types of the gradation values for each pixel of the texture image, wherein the changed value of the types of the gradation values is smaller than a value of the N types of the gradation values, and

compress and encode the depth image data in the YCbCr420 format again.

16. The image processing apparatus according to claim 10 , wherein the auxiliary information further includes region information to identify a region associated with the texture image.

17. The image processing apparatus according to claim 10 , wherein

the auxiliary information further includes edge information that indicates a portion of the texture image, and

the portion of the texture image is an edge portion.

18. An image processing method, comprising:

causing an image processing apparatus to generate depth image data that includes:

a depth image of an omnidirectional image in a Y component in a YCbCr format; and

for each of two pixels of a texture image of the omnidirectional image, auxiliary information in CbCr components in the YCbCr format, wherein

for each of two pixels of a texture image, the auxiliary information is utilized in a process of at least one of the texture image or the depth image,

the auxiliary information for a first pixel of the two pixels indicates that the first pixel corresponds to one of a foreground pixel or a background pixel,

the auxiliary information for a second pixel of the two pixels indicates that the second pixel corresponds to one of the foreground pixel or the background pixel, and

the auxiliary information for each of the first pixel and the second pixel of the texture image further includes N types of gradation values, and

causing the image processing apparatus to store a gradation value out of N×N gradation values in the CbCr components, wherein the N×N gradation values indicates a combination of the auxiliary information associated with the first pixel and the auxiliary information associated with the second pixel.