Method and apparatus for intra prediction with multiple weighted references
A method of performing intra prediction for encoding or decoding uses multiple layers of reference samples. The layers are formed into reference arrays that are used by a function, such as a weighted combination, to form a final prediction. The prediction is used in encoding or decoding a block of video data. The weights can be determined in a number of ways, and for a given prediction mode, the same weights, or different weights can be used for all pixels in a target block. If the weights are varied, they can depend on the distance of the target pixel from reference arrays.
1. A method, comprising:
obtaining a plurality of reference arrays based on a plurality of reconstructed samples neighboring a block of video data, wherein the plurality of reference arrays include a first reference array located one pixel position from the block of video data and one or more second reference arrays respectively located at pixel positions greater than the one pixel position from the block of video data;
obtaining a intra prediction for a target pixel of the block of video, the final intra prediction being based on a function of a plurality of predicted samples respectively from the plurality of reference arrays, wherein the function comprises a weighted combination of the plurality of predicted samples, and wherein a plurality of weights of the weighted combination decrease as distances between the target pixel and the respective reference arrays increase; and
encoding the block of video using the intra prediction.
2. The method of claim 1 , wherein each of the plurality of reference arrays respectively comprises a row of pixels above, and a column of pixels to the left of, said block of video data.
3. The method of claim 1 , wherein the distances between the target pixel and the respective reference arrays are associated with a prediction direction of the intra prediction.
4. The method of claim 1 , wherein at least one of the plurality of predicted samples for the target pixel of the block of video data is based on an interpolation of two adjacent reconstructed samples of a respective one of the plurality of reference arrays.
5. The method of claim 1 , further comprising:
signaling a number of the plurality of reference arrays used to obtain the plurality of predicted samples.
6. A method, comprising:
obtaining a plurality of reference arrays based on a plurality of decoded samples neighboring a block of video data, wherein the plurality of reference arrays include a first reference array located one pixel position from the block of video data and one or more second reference arrays respectively located at pixel positions greater than the one pixel position from the block of video data;
obtaining a intra prediction for a target pixel of the block of video, the intra prediction being based on a function of a plurality of predicted samples respectively from the plurality of reference arrays, wherein the function comprises a weighted combination of the plurality of predicted samples, and wherein a plurality of weights of the weighted combination decrease as distances between the target pixel and the respective reference arrays increase; and
decoding the block of video using the intra prediction.
7. The method of claim 6 , wherein each of the plurality of reference arrays respectively comprises a row of pixels above, and a column of pixels to the left of, said block of video data.
8. The method of claim 6 , wherein the distances between the target pixel and the respective reference arrays are associated with a prediction direction of the intra prediction.
9. The method of claim 6 , wherein the at least one of the plurality of predicted samples for the target pixel of the block of video data is based on an interpolation of two adjacent reconstructed samples of a respective one of the plurality of reference arrays.
10. The method of claim 6 , further comprising:
receiving information signaling a number of the plurality of reference arrays used to obtain the plurality of predicted samples.
11. An apparatus, comprising:
a memory, and
a processor, configured to:
obtain a plurality of reference arrays based on a plurality of reconstructed samples neighboring a block of video data, wherein the plurality of reference arrays include a first reference array located one pixel position from the block of video data and one or more second reference arrays respectively located at pixel positions greater than the one pixel position from the block of video data;
obtain a intra prediction for a target pixel of the block of video, the intra prediction being based on a function of a plurality of predicted samples respectively from the plurality of reference arrays, wherein the function comprises a weighted combination of the plurality of predicted samples, and wherein a plurality of weights of the weighted combination decrease as distances between the target pixel and the respective reference arrays increase; and
encode the block of video using the intra prediction.
12. The apparatus of claim 11 , wherein each of the plurality of reference arrays respectively comprises a row of pixels above, and a column of pixels to the left of, said block of video data.
13. The apparatus of claim 11 , wherein the distances between the target pixel and the respective reference arrays are associated with a prediction direction of the intra prediction.
14. The apparatus of claim 11 , wherein at least one of the plurality of predicted samples for the target pixel of the block of video data is based on an interpolation of two adjacent reconstructed samples of a respective one of the plurality of reference arrays.
15. An apparatus, comprising:
a memory, and
a processor, configured to:
obtain a plurality of reference arrays based on a plurality of decoded samples neighboring a block of video data, wherein the plurality of reference arrays include a first reference array located one pixel position from the block of video data and one or more second reference arrays respectively located at pixel positions greater than the one pixel position from the block of video data;
obtain a intra prediction for a target pixel of the block of video, the intra prediction being based on a function of a plurality of predicted samples respectively from the plurality of reference arrays, wherein the function comprises a weighted combination of the plurality of predicted samples, and wherein a plurality of weights of the weighted combination decrease as distances between the target pixel and the respective reference arrays increase; and
decode the block of video using the intra prediction.
16. The apparatus of claim 15 , wherein each of the plurality of reference arrays respectively comprises a row of pixels above, and a column of pixels to the left of, said block of video data.
17. The apparatus of claim 15 , wherein the distances between the target pixel and the respective reference arrays are associated with a prediction direction of the intra prediction.
18. The apparatus of claim 15 , wherein at least one of the plurality of predicted samples for the target pixel of the block of video data is based one an interpolation of two adjacent reconstructed samples of a respective one of the plurality of reference arrays.
19. A non-transitory computer readable medium comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 1 .
20. A non-transitory computer readable medium comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 6 .