Modified adaptive loop filter temporal prediction for temporal scalability support
A video coder may reconstruct a current picture of video data. A current region of the current picture is associated with a temporal index indicating a temporal layer to which the current region belongs. Furthermore, for each respective array of a plurality of arrays that correspond to different temporal layers, the video coder may store, in the respective array, sets of adaptive loop filtering (ALF) parameters used in applying ALF filters to samples of regions of pictures of the video data that are decoded prior to the current region and that are in the temporal layer corresponding to the respective array or a lower temporal layer than the temporal layer corresponding to the respective array. The video coder determines, based on a selected set of ALF parameters in the array corresponding to the temporal layer to which the current region belongs, an applicable set of ALF parameters.
1. A device for decoding video data, the device comprising:
a memory; and
a processor coupled to the memory and configured to:
receive a bitstream that includes an encoded representation of a current picture of the video data, wherein a current region of the current picture is associated with a first temporal index indicating a first temporal layer to which the current region belongs;
reconstruct the current picture;
when a set of adaptive loop filtering (ALF) parameters of sets of ALF parameters used in applying ALF filters to samples of regions of pictures of the video data that are decoded prior to the current region are in the first temporal layer corresponding to the first temporal index, store the set of ALF parameters in stored sets of ALF parameters;
when a set of ALF parameters of the sets of ALF parameters are in a temporal layer corresponding to a temporal index that is lower than the first temporal index, store the set of ALF parameters in the stored sets of ALF parameters;
determine, based on a selected set of ALF parameters of the stored sets of ALF parameters, an applicable set of ALF parameters for the current region; and
apply, based on the applicable set of ALF parameters for the current region, adaptive loop filtering to the current region.
2. The device of claim 1 , wherein the number of sets of ALF parameters in the sets of ALF parameters is variable.
3. The device of claim 1 , wherein the processor is further configured to allocate a plurality of arrays, wherein the sets of ALF parameters are stored in the plurality of arrays.
4. The device of claim 1 , wherein the processor is further configured allocate a list data structure, wherein the sets of ALF parameters are stored in the list data structure.
5. The device of claim 1 , wherein the processor is further configured store the applicable set of ALF parameters for the current region by determining, based on differences between a Picture Order Count (POC) value of the current picture and POC values associated with the sets of ALF parameters, which set of ALF parameters to replace with the applicable set of ALF parameters for the current region.
6. The device of claim 1 , wherein it is required that, when determining the applicable set of ALF parameters for the current region, a Picture Order Count (POC) value associated with the applicable set of ALF parameters for the current region is equal to a POC value of a reference picture in a reference picture list of the current picture.
7. The device of claim 1 , wherein the processor is further configured to:
obtain, from the bitstream, a syntax element indicating an index of the selected set of ALF parameters,
wherein determining the applicable set of ALF parameters for the current region comprises determining, based on the syntax element, the selected set of ALF parameters, and
wherein a format of the syntax element is dependent on a temporal index.
8. The device of claim 1 , wherein determining the applicable set of ALF parameters for the current region comprises determining, from the selected set of ALF parameters, class merging information and not filter coefficients.
9. The device of claim 1 , wherein determining the applicable set of ALF parameters for the current region comprises determining, from the selected set of ALF parameters, filter coefficients and not class merging information.
10. The device of claim 1 , wherein the processor is further configured to:
obtain, from the bitstream, an indication of a difference between the selected set of ALF parameters and the applicable set of ALF parameters for the current region,
wherein determining the applicable set of ALF parameters for the current region comprises determining, based on the selected set of ALF parameters and the difference, the applicable set of ALF parameters for the current region.
11. The device of claim 1 , wherein the device comprises a wireless communication device.
12. A method of decoding video data, the method comprising:
receiving a bitstream that includes an encoded representation of a current picture of the video data, wherein a current region of the current picture is associated with a first temporal index indicating a first temporal layer to which the current region belongs;
reconstructing the current picture;
when a set of adaptive loop filtering (ALF) parameters of sets of ALF parameters used in applying ALF filters to samples of regions of pictures of the video data that are decoded prior to the current region are in the first temporal layer corresponding to the first temporal index, storing the set of ALF parameters in stored sets of ALF parameters;
when a set of ALF parameters of the sets of ALF parameters are in a temporal layer corresponding to a temporal index that is lower than the first temporal index, storing the set of ALF parameters in the stored sets of ALF parameters;
determining, based on a selected set of ALF parameters of the stored sets of ALF parameters, an applicable set of ALF parameters for the current region; and
applying, based on the applicable set of ALF parameters for the current region, adaptive loop filtering to the current region.
13. The method of claim 12 , wherein the number of sets of ALF parameters in the sets of ALF parameters is variable.
14. The method of claim 12 , further comprising allocating a plurality of arrays, wherein the sets of ALF parameters are stored in the plurality of arrays.
15. The method of claim 12 , further comprising allocating a list data structure, wherein the sets of ALF parameters are stored in the list data structure.
16. The method of claim 12 , further comprising storing the applicable set of ALF parameters for the current region by determining, based on differences between a Picture Order Count (POC) value of the current picture and POC values associated with the sets of ALF parameters, which set of ALF parameters to replace with the applicable set of ALF parameters for the current region.
17. The method of claim 12 , wherein it is required that, when determining the applicable set of ALF parameters for the current region, a Picture Order Count (POC) value associated with the applicable set of ALF parameters for the current region is equal to a POC value of a reference picture in a reference picture list of the current picture.
18. The method of claim 12 , wherein determining the applicable set of ALF parameters for the current region comprises determining, from the selected set of ALF parameters, class merging information and not filter coefficients.
19. The method of claim 12 , further comprising:
obtaining, from the bitstream, an indication of a difference between the selected set of ALF parameters and the applicable set of ALF parameters for the current region,
wherein determining the applicable set of ALF parameters for the current region comprises determining, based on the selected set of ALF parameters and the difference, the applicable set of ALF parameters for the current region.
20. A non-transitory computer-readable data storage medium storing instructions that, when executed, cause a processor to:
receive a bitstream that includes an encoded representation of a current picture of the video data, wherein a current region of the current picture is associated with a first temporal index indicating a first temporal layer to which the current region belongs;
reconstruct the current picture;
when a set of adaptive loop filtering (ALF) parameters of sets of ALF parameters used in applying ALF filters to samples of regions of pictures of the video data that are decoded prior to the current region are in the first temporal layer corresponding to the first temporal index, store the set of ALF parameters in stored sets of ALF parameters;
when a set of ALF parameters of the sets of ALF parameters are in a temporal layer corresponding to a temporal index that is lower than the first temporal index, store the set of ALF parameters in the stored sets of ALF parameters;
determine, based on a selected set of ALF parameters of the stored sets of ALF parameters, an applicable set of ALF parameters for the current region; and
apply, based on the applicable set of ALF parameters for the current region, adaptive loop filtering to the current region.