Image processing device for suppressing deterioration in encoding efficiency
The present disclosure relates to image processing device and method that can suppress the deterioration in encoding efficiency. An image processing device includes: a reception unit that receives encoded data in which an image with a plurality of main layers is encoded, and inter-layer prediction control information controlling whether to perform inter-layer prediction, which is prediction between the plurality of main layers, with the use of a sublayer; and a decoding unit that decodes each main layer of the encoded data received by the reception unit by performing the inter-layer prediction on only the sublayer specified by the inter-layer prediction control information received by the reception unit. The present disclosure can be applied to, for example, an image processing device.
1. An image processing device comprising:
an encoder comprising circuitry configured to encode the image data with a plurality of layers including a base layer and a non-base layer, each layer comprising a plurality of sublayers, by performing inter-layer prediction, which is prediction between the plurality of layers, based on inter-layer prediction control information specifying a highest sublayer used for the inter-layer prediction, from a lowest sublayer to the highest sublayer specified by the inter-layer prediction control information,
wherein the inter-layer prediction is performed only on sublayers of the non-base layer that are lower than or equal to the specified highest sublayer, and
wherein inter-layer prediction includes prediction based on a sublayer of the non-base layer and a sublayer of the base layer.
2. The image processing device according to claim 1 , wherein if a current picture of a current layer belongs to the sublayer specified as the sublayer for which the inter-layer prediction is performed by the inter-layer prediction control information, the circuitry of the encoder is further configured to encode the image data of the current picture using the inter-layer prediction.
3. The image processing device according to claim 1 , wherein the inter-layer prediction control information is set for each layer.
4. The image processing device according to claim 1 , wherein the inter-layer prediction control information is set as parameters common to all the layers.
5. The image processing device according to claim 1 , wherein
the circuitry of the encoder is further configured to:
perform inter-layer pixel prediction as pixel prediction between the plurality of layers based on inter-layer pixel prediction control information that controls whether to perform the inter-layer pixel prediction and that is set as the inter-layer prediction control information, and
perform inter-layer syntax prediction as syntax prediction between the plurality of layers based on inter-layer syntax prediction control information that controls whether to perform the inter-layer syntax prediction and that is set as the inter-layer prediction control information independently from the inter-layer pixel prediction control information.
6. The image processing device according to claim 5 , wherein
the inter-layer pixel prediction control information controls using the information related to the sublayer, whether to perform the inter-layer pixel prediction,
the circuitry of the encoder is further configured to perform the inter-layer pixel prediction on only the sublayer specified by the inter-layer pixel prediction control information,
the inter-layer syntax prediction control information controls whether to perform the inter-layer syntax prediction for each picture or slice, and
the circuitry of the encoder is further configured to perform the inter-layer syntax prediction on only the picture or slice specified by the inter-layer syntax prediction control information.
7. The image processing device according to claim 6 , further comprising a transmitter comprising circuitry configured to transmit the inter-layer pixel prediction control information as a nal unit (nal_unit), a video parameter set (VPS (Video Parameter Set)), or an extension video parameter set (vps_extension).
8. The image processing device according to claim 6 , further comprising a transmitter comprising circuitry configured to transmit the inter-layer syntax prediction control information as a nal_unit (nal_unit), a picture parameter set (PPS (Picture Parameter Set)), or a slice header (SliceHeader).
9. An image processing method comprising:
encoding image data with a plurality of layers including a base layer and a non-base layer, each layer comprising a plurality of sublayers, by performing inter-layer prediction, which is prediction between the plurality of layers, based on inter-layer prediction control information specifying a highest sublayer used for the inter-layer prediction, from a lowest sublayer to the highest sublayer specified by the inter-layer prediction control information,
wherein the inter-layer prediction is performed only on sublayers of the non-base layer that are lower than or equal to the specified highest sublayer, and
wherein inter-layer prediction includes prediction based on a sublayer of the non-base layer and a sublayer of the base layer.
10. The image processing method according to claim 9 , wherein if a current picture of a current layer belongs to the sublayer specified as the sublayer for which the inter-layer prediction is performed by the inter-layer prediction control information, the method further comprises encoding the image data of the current picture using the inter-layer prediction.
11. The image processing method according to claim 9 , wherein the inter-layer prediction control information is set for each layer.
12. The image processing method according to claim 9 , wherein the inter-layer prediction control information is set as parameters common to all the layers.
13. The image processing method according to claim 9 , the method further comprising:
performing inter-layer pixel prediction as pixel prediction between the plurality of layers based on inter-layer pixel prediction control information that controls whether to perform the inter-layer pixel prediction and that is set as the inter-layer prediction control information; and
performing inter-layer syntax prediction as syntax prediction between the plurality of layers based on inter-layer syntax prediction control information that controls whether to perform the inter-layer syntax prediction and that is set as the inter-layer prediction control information independently from the inter-layer pixel prediction control information.
14. The image processing method according to claim 13 , wherein the inter-layer pixel prediction control information controls, using the information related to the sublayer, whether to perform the inter-layer pixel prediction,
the method further comprising:
performing the inter-layer pixel prediction on only the sublayer specified by the inter-layer pixel prediction control information, the inter-layer syntax prediction control information controlling whether to perform the inter-layer syntax prediction for each picture or slice; and
performing the inter-layer syntax prediction on only the picture or slice specified by the inter-layer syntax prediction control information.
15. The image processing method according to claim 14 , the method further comprising transmitting the inter-layer pixel prediction control information as a nal_unit (nal_unit), a video parameter set (VPS (Video Parameter Set)), or an extension video parameter set (vps_extension).
16. The image processing method according to claim 14 , the method further comprising transmitting the inter-layer syntax prediction control information as a nal_unit (nal_unit), a picture parameter set (PPS (Picture Parameter Set)), or a slice header (SliceHeader).