Advanced residual prediction in scalable and multi-view video coding

1. A method of coding video data, the method comprising:

determining, for a first block of video data in a first layer of video data, a temporal motion vector and associated temporal reference picture for predicting the first block, wherein the temporal reference picture has a picture order count value;

determining a disparity reference block in a disparity reference picture indicated by a disparity vector associated with the first block, wherein the disparity reference picture is included in an access unit that includes a picture containing the first block and is included in a second view, the second view being a different view than the first view;

determining whether a decoded picture buffer contains a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, wherein the temporal-disparity reference picture is located based on a combination of the temporal motion vector and the disparity vector;

based on determining that the decoded picture buffer does not contain a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, modifying an inter-view residual prediction process for predicting residual data of the first block; and

coding the residual for the first block of video data with the modified inter-view residual prediction process.

2. The method of claim 1 , wherein modifying the inter-view residual prediction process comprises disabling the inter-view residual prediction process.

3. The method of claim 1 , wherein modifying the inter-view residual prediction process comprises scaling the temporal motion vector to indicate a temporally nearest picture to the disparity reference picture.

4. The method of claim 1 , further comprising:

determining whether at least one reference picture list for a picture containing the disparity reference block contains a temporal-disparity reference picture having the picture order count value of the temporal reference picture; and

based on the determination that at least one reference picture list for a picture containing the disparity reference block does not contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modifying the inter-view residual prediction process for predicting residual data of the first block.

5. The method of claim 4 , wherein modifying the inter-view residual prediction process comprises disabling the inter-view residual prediction process.

6. The method of claim 1 , wherein the disparity reference block is associated with a first reference picture list and a second reference picture list, the method further comprising:

when neither the first reference picture list nor the second reference picture list contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modifying the inter-view residual prediction process for predicting residual data of the first block.

7. The method of claim 6 , wherein modifying the inter-view residual prediction process comprises disabling the inter-view residual prediction process.

8. An apparatus for coding video data, the apparatus comprising:

memory storing video data; and

one or more processors configured to:

determine, for a first block of the video data in a first layer, a temporal motion vector and associated temporal reference picture for predicting the first block, wherein the temporal reference picture has a picture order count value;

determine a disparity reference block in a disparity reference picture indicated by a disparity vector associated with the first block, wherein the disparity reference picture is included in an access unit that includes a picture containing the first block and is included in a second view, the second view being a different view than the first view;

determine whether a decoded picture buffer contains a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, wherein the temporal-disparity reference picture is located based on a combination of the temporal motion vector and the disparity vector;

based on determining that the decoded picture buffer does not contain a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, modify an inter-view residual prediction process for predicting residual data of the first block; and

code the residual for the first block of the video data with the modified inter-view residual prediction process.

9. The apparatus of claim 8 , wherein to modify the inter-view residual prediction process, the one or more processors are configured to disable the inter-view residual prediction process.

10. The apparatus of claim 8 , wherein to modify the inter-view residual prediction process, the one or more processors are configured to scale the temporal motion vector to indicate a temporally nearest picture to the disparity reference picture.

11. The apparatus of claim 8 , wherein the one or more processors are further configured to:

determine whether at least one reference picture list for a picture containing the disparity reference block contains a temporal-disparity reference picture having the picture order count value of the temporal reference picture; and

based on the determination that at least one reference picture list for a picture containing the disparity reference block does not contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modify the inter-view residual prediction process for predicting residual data of the first block.

12. The apparatus of claim 11 , wherein to modify the inter-view residual prediction process, the one or more processors are configured to disable the inter-view residual prediction process.

13. The apparatus of claim 8 , wherein the disparity reference block is associated with a first reference picture list and a second reference picture list, and wherein the one or more processors are further configured to:

when neither the first reference picture list nor the second reference picture list contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modify the inter-view residual prediction process for predicting residual data of the first block.

14. The apparatus of claim 13 , wherein to modify the inter-view residual prediction process, the one or more processors are configured to disable the inter-view residual prediction process.

15. The apparatus of claim 8 , wherein to code the residual for the first block, the one or more processors are configured to decode the residual with the inter-view residual prediction process, wherein to decode the residual with the inter-view residual prediction process, the one or more processors are configured to:

determine the temporal-disparity reference block based on the combination of the temporal motion vector and the disparity vector;

obtain, from an encoded bitstream, the residual for the first block;

determine a residual predictor based on a difference between the disparity reference block and the temporal-disparity reference block; and

reconstruct the block based on a combination of the residual, the residual predictor, and the temporal reference block.

16. The apparatus of claim 8 , wherein to code the residual for the first block, the one or more processors are configured to encode the residual with the inter-view residual prediction process, wherein to encode the residual with the inter-view residual prediction process, the one or more processors are configured to:

determine the temporal-disparity reference block based on the combination of the temporal motion vector and the disparity vector;

determine a first residual comprising a difference between the first block and the temporal reference block;

determine a residual predictor comprising a difference between the disparity reference block and the temporal-disparity reference block;

determine the residual based on a difference between the first residual and the residual predictor; and

encode data indicating the residual in a bitstream.

17. An apparatus for coding video data, the apparatus comprising:

means for determining, for a first block of video data in a first layer of video data, a temporal motion vector and associated temporal reference picture for predicting the first block, wherein the temporal reference picture has a picture order count value;

means for determining a disparity reference block in a disparity reference picture indicated by a disparity vector associated with the first block, wherein the disparity reference picture is included in an access unit that includes a picture containing the first block and is included in a second view, the second view being a different view than that the first view;

means for determining whether a decoded picture buffer contains a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, wherein the temporal-disparity reference picture is located based on a combination of the temporal motion vector and the disparity vector;

means for, based on determining that the decoded picture buffer does not contain a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, modifying an inter-view residual prediction process for predicting residual data of the first block; and

means for coding the residual for the first block of video data with the modified inter-view residual prediction process.

18. The apparatus of claim 17 , wherein the means for modifying the inter-view residual prediction process comprises means for disabling the inter-view residual prediction process.

19. The apparatus of claim 17 , further comprising:

means for determining whether at least one reference picture list for a picture containing the disparity reference block contains a temporal-disparity reference picture having the picture order count value of the temporal reference picture; and

means for, based on the determination that at least one reference picture list for a picture containing the disparity reference block does not contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modifying the inter-view residual prediction process for predicting residual data of the first block.

20. The apparatus of claim 19 , wherein the means for modifying the inter-view residual prediction process comprises means for disabling the inter-view residual prediction process.

21. The apparatus of claim 17 , wherein the disparity reference block is associated with a first reference picture list and a second reference picture list, the apparatus further comprising:

when neither the first reference picture list nor the second reference picture list contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, means for modifying the inter-view residual prediction process for predicting residual data of the first block.

22. The apparatus of claim 21 , wherein the means for modifying the inter-view residual prediction process comprises means for disabling the inter-view residual prediction process.

23. A non-transitory computer-readable medium having instructions stored thereon that, when executed, cause one or more processors to:

determine, for a first block of video data in a first layer of video data, a temporal motion vector and associated temporal reference picture for predicting the first block, wherein the temporal reference picture has a picture order count value;

determine a disparity reference block in a disparity reference picture indicated by a disparity vector associated with the first block, wherein the disparity reference picture is included in an access unit that includes a picture containing the first block and is included in a second view, the second view being a different view than the first view;

determine whether a decoded picture buffer contains a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, wherein the temporal-disparity reference picture is located based on a combination of the temporal motion vector and the disparity vector;

based on determining that the decoded picture buffer does not contain a temporal-disparity reference picture in the second view and having the picture order count value of the temporal reference picture, modify an inter-view residual prediction process for predicting residual data of the first block; and

code the residual for the first block of video data with the modified inter-view residual prediction process.

24. The non-transitory computer-readable medium of claim 23 , wherein to modify the inter-view residual prediction process, the instructions cause the one or more processors to disable the inter-view residual prediction process.

25. The non-transitory computer-readable medium of claim 23 , wherein the instructions further cause the one or more processors to:

determine whether at least one reference picture list for a picture containing the disparity reference block contains a temporal-disparity reference picture having the picture order count value of the temporal reference picture; and

based on the determination that at least one reference picture list for a picture containing the disparity reference block does not contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modify the inter-view residual prediction process for predicting residual data of the first block.

26. The non-transitory computer-readable medium of claim 25 , wherein to modify the inter-view residual prediction process, the instructions cause the one or more processors to disable the inter-view residual prediction process.

27. The non-transitory computer-readable medium of claim 23 , wherein the disparity reference block is associated with a first reference picture list and a second reference picture list, and wherein the instructions further cause the one or more processors to:

when neither the first reference picture list nor the second reference picture list contain a temporal-disparity reference picture having the picture order count value of the temporal reference picture, modify the inter-view residual prediction process for predicting residual data of the first block.

28. The non-transitory computer-readable medium of claim 27 , wherein to modify the inter-view residual prediction process, the instructions cause the one or more processors to disable the inter-view residual prediction process.