Advanced residual prediction in scalable and multi-view video coding

1. A method of coding multi-layer video data, the method comprising:

determining, for a coding unit of video data at a first temporal location, whether one or more reference picture lists for coding the coding unit contain at least one reference picture at a second, different temporal location;

based on determining that the one or more reference picture lists for coding the coding unit do not contain at least one reference picture at the second, different temporal location, disabling an inter-view residual prediction process when the one or more reference picture lists do not include at least one reference picture at the second temporal location, wherein disabling the inter-view residual prediction process comprises skipping coding of a weighting factor for the inter-view residual prediction process for the coding unit and each other coding unit of a picture containing the coding unit; and

coding the coding unit of video data relative to at least one reference block of video data of a reference picture in the one or more reference picture lists.

2. The method of claim 1 , wherein coding the coding unit comprises decoding the coding unit, and further comprising automatically determining that the weighting factor is zero when skipping coding of the weighting factor.

3. The method of claim 1 , wherein determining whether the one or more reference picture lists include at least one reference picture of the second temporal location comprises determining whether a picture containing the coding unit is a random access picture, and wherein the one or more reference picture lists do not include at least one reference picture of the second temporal location when the picture containing the coding unit is a random access picture.

4. The method of claim 1 , further comprising:

based on determining that the one or more reference picture lists for coding the coding unit contain at least one reference picture at the second temporal location, not disabling the inter-view residual prediction process; and

wherein coding the coding unit relative to the at least one reference block comprises coding the coding unit with the inter-view residual prediction process, wherein coding the coding unit with the inter-view residual prediction process comprises:

determining a temporal reference block indicated by a temporal motion vector of the coding unit;

determining a disparity reference block indicated by a disparity vector of the coding unit;

determining a temporal-disparity reference block indicated by a combination of the temporal motion vector and the disparity vector; and

coding the coding unit relative to the temporal reference block, the disparity reference block, and the temporal-disparity reference block.

5. The method of claim 1 , wherein the one or more reference picture lists comprise a first reference picture list and a second reference picture list, wherein determining whether the one or more reference picture lists contain the at least one reference picture at the second temporal location comprises determining whether either of the first reference picture list and the second reference picture list contain the at least one reference picture at the second temporal location.

6. An apparatus for coding multi-layer video data, the apparatus comprising:

a memory storing video data; and

one or more processors configured to:

determine, for a coding unit of video data at a first temporal location, whether one or more reference picture lists for coding the coding unit contain at least one reference picture at a second, different temporal location;

based on determining that the one or more reference picture lists for coding the coding unit do not contain at least one reference picture at the second, different temporal location, disable an inter-view residual prediction process when the one or more reference picture lists do not include at least one reference picture at the second temporal location, wherein to disable the inter-view residual prediction process, the one or more processors are configured to skip coding of a weighting factor for the inter-view residual prediction process for the coding unit and each other coding unit of a picture containing the coding unit; and

code the coding unit of video data relative to at least one reference block of video data of a reference picture in the one or more reference picture lists.

7. The apparatus of claim 6 , wherein to code the coding unit, the one or more processors are configured to decode the coding unit, and wherein the one or more processors are further configured to automatically determine that the weighting factor is zero when skipping coding of the weighting factor.

8. The apparatus of claim 6 , wherein to determine whether the one or more reference picture lists include at least one reference picture of the second temporal location, the one or more processors are configured to determine whether a picture containing the coding unit is a random access picture, and wherein the one or more reference picture lists do not include at least one reference picture of the second temporal location when the picture containing the coding unit is a random access picture.

9. The apparatus of claim 6 , wherein the one or more reference picture lists comprise a first reference picture list and a second reference picture list, and wherein to determine whether the one or more reference picture lists contain the at least one reference picture at the second temporal location, the one or more processors are configured to determine whether either of the first reference picture list and the second reference picture list contain the at least one reference picture at the second temporal location.

10. The apparatus of claim 6 , wherein the one or more processors are configured to:

based on determining that the one or more reference picture lists for coding the coding unit contain at least one reference picture at the second temporal location, not disable the inter-view residual prediction process; and

wherein to code the coding unit relative to the at least one reference block, the one more processors are configured to code the coding unit with the inter-view residual prediction process, wherein to code the coding unit with the inter-view residual prediction process, the one more processors are configured to:

determine a temporal reference block indicated by a temporal motion vector of the coding unit;

determine a disparity reference block indicated by a disparity vector of the coding unit;

determine a temporal-disparity reference block indicated by a combination of the temporal motion vector and the disparity vector; and

code the coding unit relative to the temporal reference block, the disparity reference block, and the temporal-disparity reference block.

11. The apparatus of claim 10 , wherein to code the coding unit, the one more processors are configured to decode the coding unit, and wherein to decode the coding unit, the one more processors are configured to:

obtain, from an encoded bitstream, data indicative of a final residual for the coding unit;

determine residual predictor based on a difference between the disparity reference block and the temporal-disparity reference block;

reconstruct the coding unit based on a combination of the final residual, the residual predictor, and the temporal reference block.

12. The apparatus of claim 10 , wherein to code the coding unit, the one more processors are configured to encode the coding unit, and wherein to encode the coding unit, the one more processors are configured to:

determine a first residual comprising a difference between the coding unit and a temporal reference block;

determine a residual predictor comprising a difference between the disparity reference block and the temporal-disparity reference block;

determine a final residual based on a difference between the first residual and the residual predictor;

encode data indicating the final residual in a bitstream.

13. An apparatus for coding multi-layer video data, the apparatus comprising:

means for determining, for a coding unit of video data at a first temporal location, whether one or more reference picture lists for coding the coding unit contain at least one reference picture at a second, different temporal location;

means for disabling, based on determining that the one or more reference picture lists for coding the coding unit do not contain at least one reference picture at the second, different temporal location, an inter-view residual prediction process when the one or more reference picture lists do not include at least one reference picture at the second temporal location, wherein the means for disabling the inter-view residual prediction process comprises means for skipping coding of a weighting factor for the inter-view residual prediction process for the coding unit and each other coding unit of a picture containing the coding unit; and

means for coding the coding unit of video data relative to at least one reference block of video data of a reference picture in the one or more reference picture lists.

14. The apparatus of claim 13 , wherein the means for determining whether the one or more reference picture lists include at least one reference picture of the second temporal location comprises means for determining whether a picture containing the coding unit is a random access picture, and wherein the one or more reference picture lists do not include at least one reference picture of the second temporal location when the picture containing the coding unit is a random access picture.

15. The apparatus of claim 13 , wherein the one or more reference picture lists comprise a first reference picture list and a second reference picture list, and wherein the means for determining whether the one or more reference picture lists contain the at least one reference picture at the second temporal location comprises means for determining whether either of the first reference picture list and the second reference picture list contain the at least one reference picture at the second temporal location.

16. The apparatus of claim 13 , further comprising:

means for not disabling, based on determining that the one or more reference picture lists for coding the coding unit contain at least one reference picture at the second temporal location, the inter-view residual prediction process; and

wherein the means for coding the coding unit relative to the at least one reference block comprises means for coding the coding unit with the inter-view residual prediction process comprising:

means for determining a temporal reference block indicated by a temporal motion vector of the coding unit;

means for determining a disparity reference block indicated by a disparity vector of the coding unit;

means for determining a temporal-disparity reference block indicated by a combination of the temporal motion vector and the disparity vector; and

means for coding the coding unit relative to the temporal reference block, the disparity reference block, and the temporal-disparity reference block.

17. A non-transitory computer-readable medium having instructions stored thereon that, when executed, cause one or more processors to:

determine, for a coding unit of video data at a first temporal location, whether one or more reference picture lists for coding the coding unit contain at least one reference picture at a second, different temporal location;

based on determining that the one or more reference picture lists for coding the coding unit do not contain at least one reference picture at the second, different temporal location, disable an inter-view residual prediction process when the one or more reference picture lists do not include at least one reference picture at the second temporal location, wherein to disable the inter-view residual prediction process, the instructions cause the one or more processors to skip coding of a weighting factor for the inter-view residual prediction process for the coding unit and each other coding unit of a picture containing the coding unit and

code the coding unit of video data relative to at least one reference block of video data of a reference picture in the one or more reference picture lists.

18. The non-transitory computer-readable medium of claim 17 , wherein to determine whether the one or more reference picture lists include at least one reference picture of the second temporal location, the instructions cause the one or more processors to determine whether a picture containing the coding unit is a random access picture, and wherein the one or more reference picture lists do not include at least one reference picture of the second temporal location when the picture containing the coding unit is a random access picture.

19. The non-transitory computer-readable medium of claim 17 , wherein the one or more reference picture lists comprise a first reference picture list and a second reference picture list, wherein to determine whether the one or more reference picture lists contain the at least one reference picture at the second temporal location, the instructions cause the one or more processors to determine whether either of the first reference picture list and the second reference picture list contain the at least one reference picture at the second temporal location.

20. The non-transitory computer-readable medium of claim 17 , wherein the instructions cause the one or more processors to:

based on determining that the one or more reference picture lists for coding the coding unit contain at least one reference picture at the second temporal location, not disable the inter-view residual prediction process; and

wherein to code the coding unit relative to the at least one reference block, the instructions cause the one more processors to code the coding unit with the inter-view residual prediction process, wherein to code the coding unit with the inter-view residual prediction process, the instructions cause the one more processors to:

determine a temporal reference block indicated by a temporal motion vector of the coding unit;

determine a disparity reference block indicated by a disparity vector of the coding unit;

determine a temporal-disparity reference block indicated by a combination of the temporal motion vector and the disparity vector; and

code the coding unit relative to the temporal reference block, the disparity reference block, and the temporal-disparity reference block.

21. The method of claim 4 , wherein coding the coding unit comprises decoding the coding unit, and wherein decoding the coding unit comprises:

obtaining, from an encoded bitstream, data indicative of a final residual for the first block;

determining residual predictor based on a difference between the disparity reference block and the temporal-disparity reference block; and

reconstructing the first block based on a combination of the final residual, the residual predictor, and the temporal reference block.

22. The method of claim 4 , wherein coding the coding unit comprises encoding the coding unit, and wherein encoding the coding unit comprises:

determining a first residual comprising a difference between the first block and a temporal reference block;

determining a residual predictor comprising a difference between the disparity reference block and the temporal-disparity reference block;

determining a final residual based on a difference between the first residual and the residual predictor; and

encoding data indicating the final residual in a bitstream.

23. The apparatus of claim 6 , wherein the apparatus comprises at least one of:

an integrated circuit;

a microprocessor; or

a wireless communication device.