Method and apparatus for intra prediction with multiple weighted references
A method of performing intra prediction for encoding or decoding uses multiple layers of reference samples. The layers are formed into reference arrays that are used by a function, such as a weighted combination, to form a final prediction. The prediction is used in encoding or decoding a block of video data. The weights can be determined in a number of ways, and for a given prediction mode, the same weights, or different weights can be used for all pixels in a target block. If the weights are varied, they can depend on the distance of the target pixel from reference arrays.
1. A method, comprising:
obtaining a plurality of reference arrays based on a plurality of reconstructed samples neighboring a block of video data, wherein each respective reference array of the plurality of reference arrays is adjacent to at least one other reference array of the plurality of reference arrays, and one of the plurality of reference arrays borders the block of video data;
obtaining an intra prediction value for a target pixel of the block of video using a weighted combination of at least a first predicted sample from a first reference array of the plurality of reference arrays and a second predicted sample from a second reference array of the plurality of reference arrays, wherein the first reference array is closer to the block than the second reference array, and wherein a first weight applied to the first predicted sample is greater than a second weight applied to the second predicted sample; and
encoding the block of video data using the intra prediction value for the target pixel.
2. The method of claim 1 , wherein each of the plurality of reference arrays is included in a respective layer comprising a row of pixels above the block of video data and a column of pixels to the left of the block of video data.
3. The method of claim 1 , further comprising:
obtaining the first predicted sample and the second predicted sample based on a prediction direction for intra prediction.
4. The method of claim 1 , further comprising:
obtaining the first predicted sample based on interpolation of two reconstructed samples of the first reference array.
5. The method of claim 1 , further comprising:
obtaining the second predicted sample based on interpolation of two reconstructed samples of the second reference array.
6. A method, comprising:
obtaining a plurality of reference arrays based on a plurality of decoded samples neighboring a block of video data, wherein each respective reference array of the plurality of reference arrays is adjacent to at least one other reference array of the plurality of reference arrays, and one of the plurality of reference arrays borders the block of video data;
obtaining an intra prediction value for a target pixel of the block of video using a weighted combination of at least a first predicted sample from a first reference array of the plurality of reference arrays and a second predicted sample from a second reference array of the plurality of reference arrays, wherein the first reference array is closer to the block than the second reference array, and wherein a first weight applied to the first predicted sample is greater than a second weight applied to the second predicted sample; and
decoding the block of video using the intra prediction value for the target pixel.
7. The method of claim 6 , wherein each of the plurality of reference arrays is included in a respective layer comprising a row of pixels above the block of video data and a column of pixels to the left of the block of video data.
8. The method of claim 6 , further comprising:
obtaining the first predicted sample and the second predicted sample based on a prediction direction for intra prediction.
9. The method of claim 6 , further comprising:
obtaining the first predicted sample based on interpolation of two reconstructed samples of the first reference array.
10. The method of claim 6 , further comprising:
obtaining the second predicted sample based on interpolation of two reconstructed samples of the second reference array.
11. An apparatus, comprising:
a processor and a memory which are configured to:
obtain a plurality of reference arrays based on a plurality of reconstructed samples neighboring a block of video data, wherein each respective reference array of the plurality of reference arrays is adjacent to at least one other reference array of the plurality of reference arrays, and one of the plurality of reference arrays borders the block of video data;
obtain an intra prediction value for a target pixel of the block of video using a weighted combination of at least a first predicted sample from a first reference array of the plurality of reference arrays and a second predicted sample from a second reference array of the plurality of reference arrays, wherein the first reference array is closer to the block than the second reference array, and wherein a first weight applied to the first predicted sample is greater than a second weight applied to the second predicted sample; and
encode the block of video data using the intra prediction value for the target pixel.
12. The apparatus of claim 11 , wherein each of the plurality of reference arrays is included in a respective layer comprising a row of pixels above the block of video data and a column of pixels to the left of the block of video data.
13. The apparatus of claim 11 , wherein the processor and the memory are configured to obtain the first predicted sample and the second predicted sample based on a prediction direction for intra prediction.
14. The apparatus of claim 11 , wherein the processor and the memory are configured to obtain the first predicted sample based on interpolation of two reconstructed samples of the first reference array.
15. An apparatus, comprising:
a processor and a memory which are configured to:
obtain a plurality of reference arrays based on a plurality of decoded samples neighboring a block of video data, wherein each respective reference array of the plurality of reference arrays is adjacent to at least one other reference array of the plurality of reference arrays, and one of the plurality of reference arrays borders the block of video data;
obtain a intra prediction value for a target pixel of the block of video using a weighted combination of at least a first predicted sample from a first reference array of the plurality of reference arrays and a second predicted sample from a second reference array of the plurality of reference arrays, wherein the first reference array is closer to the block than the second reference array, and wherein a first weight applied to the first predicted sample is greater than a second weight applied to the second predicted sample; and
decode the block of video data using the intra prediction value for the target pixel of the block of video data.
16. The apparatus of claim 15 , wherein each of the plurality of reference arrays is included in a respective layer comprising a row of pixels above the block of video data and a column of pixels to the left of the block of video data.
17. The apparatus of claim 15 , wherein the processor and the memory are configured to obtain the first predicted sample and the second predicted sample based on a prediction direction for intra prediction.
18. The apparatus of claim 15 , wherein the processor and the memory are configured to obtain the first predicted sample based on interpolation of two reconstructed samples of the first reference array.
19. A non-transitory computer readable medium comprising instructions which, when executed by a computer, cause the computer to carry out the method of claim 10 .
20. A non-transitory computer readable medium comprising instructions which, when executed by a computer, cause the computer to carry out the method of claim 15 .