Image processing efficient transmission or reception of encoded information
The present disclosure relates to an image processing apparatus and a method that enable efficient change of reference relationship of views in multi-view coding. In the present technology, as for inter-view reference images, a used_by_curr flag is also set to an image having a possibility of being referred, in a slice header or syntax of an SPS. Only an image with the used_by_curr flag of 1 is added to a temporal list used in generating a reference list. Therefore, the temporal list (RefPicListTemp0[rldx]) of L0 is generated in an order of a short-term (before) reference image of an index 0, a short-term (after) reference image of an index 1, and inter-view reference images of indexes 2 and 3. The present disclosure can be applied to an image processing apparatus, for example.
1. An image processing apparatus, comprising:
a processor configured to:
decode a bit stream to generate a decoded image; and
generate, by prediction, a predicted image, wherein the prediction is based on a list of reference images,
wherein the list of reference images is generated based on layer reference image information that controls reference images for each layer, and
wherein the reference images are referable in a layer direction and are referred to predict the predicted image:
reverse an order of the reference images referable in an L0 direction; and
insert the reverse ordered reference images into the list of reference images associated with an L1 direction.
2. The image processing apparatus according to claim 1 , wherein the layer reference image information is transmitted at one of fixed intervals or in picture units.
3. The image processing apparatus according to claim 2 , wherein the layer reference image information is set to one of a sequence parameter set or a slice header of the bit stream.
4. The image processing apparatus according to claim 1 , wherein the processor is further configured to generate the list of the reference images, based on the layer reference image information.
5. The image processing apparatus according to claim 1 , wherein the processor is further configured to add a reference image in which the layer reference image information indicates 1, of the reference images referable in the layer direction, to generate the list of reference images.
6. The image processing apparatus according to claim 1 ,
wherein the processor is further configured to add a reference image in which the layer reference image information indicates 1, of the reference images referable in the layer direction, to generate the list of reference images corresponding to the L0 direction, and
wherein the generation of the list of reference images is based on combination of images in an order of a reference image positioned temporally before the decoded image, a reference image positioned temporally after the decoded image, a long-term reference image, and the reference images referable in the layer direction.
7. The image processing apparatus according to claim 1 ,
wherein the processor is further configured to add a reference image in which the layer reference image information indicates 1, of the reference images referable in the layer direction, and to generate the list of reference images corresponding to the L1 direction, and
wherein the generation of the list of reference images is based on combination of images in an order of a reference image positioned temporally after the decoded image, a reference image positioned temporally before the decoded image, a long-term reference image, and the reference images referable in the layer direction.
8. The image processing apparatus according to claim 1 , wherein the layer is a view.
9. An image processing method, comprising:
in an image processing apparatus:
decoding a bit stream to generate a decoded image; and
generating, by prediction, a predicted image, wherein the prediction is based on a list of reference images,
wherein the list of reference images is generated based on layer reference image information that controls reference images for each layer, and
wherein the reference images being referable in a layer direction and referred in predicting the predicted image;
reversing an order of the reference images referable in an L0 direction; and
inserting the reverse ordered reference images into the list of reference images associated with an L1 direction.
10. An image processing apparatus, comprising:
a processor configured to:
set layer reference image information that controls reference images referable in a layer direction;
generate, by prediction, a predicted image, wherein the prediction is based on a list of reference images;
reverse an order of the reference images referable in an L0 direction;
insert the reverse ordered reference images into the list of reference images associated with an L1 direction,
wherein the list of reference images is generated based on the set layer reference image information
encode an image based on the predicted image to generate a bit stream; and
transmit the generated bit stream and the set layer reference image information.
11. The image processing apparatus according to claim 10 , wherein the processor is further configured to transmit the set layer reference image information at one of fixed intervals or in picture units.
12. The image processing apparatus according to claim 11 , wherein the processor is further configured to set the layer reference image information to one of a sequence parameter set or a slice header of the bit stream.
13. The image processing apparatus according to claim 10 , wherein the processor is further configured to generate the list of reference images, based on the set layer reference image information.
14. The image processing apparatus according to claim 10 , wherein the processor is further configured to add a reference image in which the layer reference image information indicates 1, of the reference images referable in the layer direction, to generate the list of reference images.
15. The image processing apparatus according to claim 10 ,
wherein the processor is further configured to add a reference image in which the layer reference image information indicates 1, of the reference images referable in the layer direction, corresponding to the L0 direction, and
wherein the generation of the list of reference images is based on combination of images in an order of a reference image positioned temporally before the image, a reference image positioned temporally after the image, a long-term reference image, and the reference images referable in the layer direction.
16. The image processing apparatus according to claim 10 ,
wherein the processor is further configured to add a reference image in which the layer reference image information indicates 1, of the reference images referable in the layer direction, to generate the list of reference images, with corresponding to the L1 direction, and
wherein the generation of the list of reference images is based on combination of images in an order of a reference image positioned temporally after the image, a reference image positioned temporally before the image, a long-term reference image, and the reference images referable in the layer direction.
17. The image processing apparatus according to claim 10 , wherein the layer is a view.
18. An image processing method, comprising:
in an image processing apparatus:
setting layer reference image information that controls reference images referable in a layer direction;
generating, by prediction, a predicted image, wherein the prediction is based on a list of reference images;
reversing an order of the reference images referable in an L0 direction;
inserting the reverse ordered reference images into the list of reference images associated with an L1 direction,
wherein the list of reference images is generated based on the set layer reference image information;
encoding an image based on the predicted image to generate a bit stream; and
transmitting the generated bit stream and the set layer reference image information.