Methods, apparatuses, computer programs and computer-readable media for scalable image coding
For a given image in a set of images, residual data is obtained and is useable by a decoder to reconstruct a first representation of the given image at a first level of quality using a second representation of the given image at the first level of quality. The second representation is based on a representation of the given image at a second, lower level of quality. Configuration data relating to processing of the residual data is generated and output for processing by the decoder. The configuration data comprises a temporal processing parameter ( 754, 854 ) that specifies an extent of temporal processing associated with reconstructing, for the given image, the first representation using the second representation and the residual data, wherein performing temporal processing comprises using data based on multiple images in the set of images.
1. A method comprising:
obtaining, for a given image in a set of images, residual data useable by a decoder to reconstruct a first representation of the given image at a first level of quality in a tiered hierarchy having multiple levels of quality using a second representation of the given image at the first level of quality, the second representation being based on a representation of the given image at a second, lower level of quality in the tiered hierarchy;
accessing configuration data relating to processing of the residual data, wherein:
the configuration data includes a reference to a look-up table that stores possible values of a given configuration parameter,
the configuration data further includes a temporal processing parameter that specifies an extent of temporal processing associated with reconstructing, for the given image, the first representation using the second representation and the residual data,
the temporal processing parameter is a temporal refresh parameter that indicates when temporal data is to be refreshed, and the temporal refresh parameter specifies whether or not a buffer storing the temporal data is to be cleared, and
performing the temporal processing comprises using data based on multiple images in the set of images; and
outputting the configuration data for processing by the decoder to enable the decoder to reconstruct, for the given image, the first representation using the second representation and the residual data.
2. The method according to claim 1 , wherein the temporal processing parameter is output for each image in the set of images.
3. The method according to claim 1 , wherein the temporal data comprises data useable in temporal processing.
4. The method according to claim 1 , wherein a bit-length of a value of the temporal refresh parameter is one bit.
5. The method according to claim 1 , wherein the number of times the temporal processing parameter is output for the set of images is less than the number of images in the set of images.
6. The method according to claim 5 , wherein the number of times the temporal processing parameter is output for the set of images is one.
7. The method according to claim 5 , wherein the temporal processing parameter indicates whether or not temporal processing has been performed.
8. The method according to claim 5 , wherein a value of the temporal processing parameter has a bit-length of one bit.
9. The method according to claim 5 , wherein the data based on multiple images is indicative of an extent of temporal correlation between the residual data for the given image and residual data for one or more further images in the set of images.
10. The method according to claim 9 , wherein the data comprises temporal correlation data based on a difference between the residual data for the given image and the residual data for the one or more further images in the set of images.
11. The method according to claim 9 ,
wherein each of the images in the set of images corresponds to a different time sample of a video, and
wherein the one or more further images corresponds to one or more earlier time samples in the video relative to a time sample corresponding to the given image.
12. The method according to claim 1 , wherein the temporal processing parameter is stored in a predetermined bit in a given byte of the configuration data.
13. An apparatus configured to:
obtain, for a given image in a set of images, residual data useable by a decoder to reconstruct a first representation of the given image at a first level of quality in a tiered hierarchy having multiple levels of quality using a second representation of the given image at the first level of quality, the second representation being based on a representation of the given image at a second, lower level of quality in the tiered hierarchy;
access configuration data relating to processing of the residual data, wherein:
the configuration data includes a reference to a look-up table that stores possible values of a given configuration parameter,
the configuration data further includes a temporal processing parameter that specifies an extent of temporal processing associated with reconstructing, for the given image, the first representation using the second representation and the residual data,
the temporal processing parameter is a temporal refresh parameter that indicates when temporal data is to be refreshed, and the temporal refresh parameter specifies whether or not a buffer storing the temporal data is to be cleared, and
performing the temporal processing comprises using data based on multiple images in the set of images; and
output the configuration data for processing by the decoder to enable the decoder to reconstruct, for the given image, the first representation using the second representation and the residual data.
14. A non-transitory computer-readable medium comprising instructions that are executable by a processor to cause the processor to:
obtain, for a given image in a set of images, residual data useable by a decoder to reconstruct a first representation of the given image at a first level of quality in a tiered hierarchy having multiple levels of quality using a second representation of the given image at the first level of quality, the second representation being based on a representation of the given image at a second, lower level of quality in the tiered hierarchy;
access configuration data relating to processing of the residual data, wherein:
the configuration data includes a reference to a look-up table that stores possible values for a given configuration parameter,
the configuration data further includes a temporal processing parameter that specifies an extent of temporal processing associated with reconstructing, for the given image, the first representation using the second representation and the residual data,
the temporal processing parameter is a temporal refresh parameter that indicates when temporal data is to be refreshed, and the temporal refresh parameter specifies whether or not a buffer storing the temporal data is to be cleared, and
performing the temporal processing comprises using data based on multiple images in the set of images; and
output the configuration data for processing by the decoder to enable the decoder to reconstruct, for the given image, the first representation using the second representation and the residual data.