Generalized residual prediction in high-level syntax only SHVC and signaling and management thereof

1. An apparatus for decoding video information, the apparatus comprising:

a memory unit configured to store at least one reference picture list of an enhancement layer, the at least one reference picture list comprising residual prediction reference picture information; and

a processor operationally coupled to the memory unit and configured to:

decode signaled information about residual prediction reference picture generation;

generate a residual prediction reference picture based on an enhancement layer reference picture and the decoded signaled information such that the generated residual prediction reference picture has the same motion field and the same picture order count (POC) as the enhancement layer reference picture from which it is generated; and

store the generated residual prediction reference picture in the at least one reference picture list of the enhancement layer.

2. The apparatus of claim 1 , wherein a plurality of slices of a picture have the same generated residual prediction reference picture.

3. The apparatus of claim 1 , wherein the signaled information comprises a flag indicating whether residual prediction reference pictures are used, and wherein the processor is further configured to generate the residual prediction reference picture when the flag indicates that residual prediction reference pictures are used.

4. The apparatus of claim 1 , wherein the processor is further configured to store the generated residual prediction reference picture in a reference parameter set (RPS) subset including only residual prediction reference pictures.

5. The apparatus of claim 1 , wherein the signaled information comprises a number of residual prediction reference pictures to be generated.

6. The apparatus of claim 1 , wherein the residual prediction reference picture is associated with a type selected from a plurality of types of residual prediction references.

7. The apparatus of claim 6 , wherein the signaled information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture, and wherein only one of the plurality of types of residual prediction references is available for the residual prediction reference picture to be generated.

8. The apparatus of claim 6 , wherein at least two types of the plurality of types of residual prediction reference pictures are available, and the signaled information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture and indicating one of the at least two types for the residual prediction reference picture.

9. The apparatus of claim 1 , wherein the processor is further configured to:

generate a reconstructed picture of the enhancement layer based on the residual prediction reference picture.

10. The apparatus of claim 9 , wherein the processor is further configured to:

generate an upsampled collocated reference picture of a reference layer of the enhancement layer; and

generate the reconstructed picture of the enhancement layer based on the residual prediction reference picture and the upsampled collocated reference picture of the reference layer.

11. The apparatus of claim 9 , wherein the residual prediction reference picture is not placed in a decoded picture buffer (DPB).

12. The apparatus of claim 1 , wherein the signaled information is specified at a slice level or above.

13. The apparatus of claim 9 , wherein the processor is further configured to generate the reconstructed picture of the enhancement layer without applying a weighting factor to a residue of a corresponding picture in a reference layer associated with the enhancement layer.

14. The apparatus of claim 1 , wherein the signaled information is specified at a level selected from: a picture parameter set (PPS), a video parameter set (VPS), a sequence parameter set (SPS), a reference parameter set (RPS), or a slice header.

15. The apparatus of claim 1 , wherein the apparatus is selected from a group consisting of one or more of: a desktop computer, a notebook computer, a laptop computer, a tablet computer, a set-top box, a telephone handset, a smart phone, a smart pad, a television, a camera, a display device, a digital media player, a video gaming console, and a video streaming device.

16. A method of decoding video information, the method comprising:

decoding, using a processor operationally coupled to a memory unit, signaled information about residual prediction reference picture generation;

generating a residual prediction reference picture based on an enhancement layer reference picture of an enhancement layer and the decoded signaled information such that the generated residual prediction reference picture has the same motion field and the same picture order count (POC) as the enhancement layer reference picture from which it is generated; and

storing the generated residual prediction reference picture in at least one reference picture list of the enhancement layer in the memory unit.

17. The method of claim 16 , wherein the residual prediction reference picture is associated with a type selected from a plurality of types of residual prediction references.

18. The method of claim 17 , wherein the signaled information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture, and wherein only one of the plurality of types of residual prediction references is available for the residual prediction reference picture to be generated.

19. The method of claim 17 , wherein at least two types of the plurality of types of residual prediction reference pictures are available, and the signaled information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture and indicating one of the at least two types for the residual prediction reference picture.

20. An apparatus for encoding video information, the apparatus comprising:

a memory unit configured to store at least one reference picture list associated with one or more layers of video information in scalable video coding; and

a processor operationally coupled to the memory unit and configured to:

encode information about generating a residual prediction reference picture based at least in part on a corresponding enhancement layer reference picture associated with an enhancement layer, the residual prediction reference picture configured to have the same motion field and the same picture order count (POC) as the enhancement layer reference picture from which it is to be generated; and

signal the encoded information in a bitstream.

21. The apparatus of claim 20 , wherein the processor is further configured to apply a constraint that a plurality of slices of a picture have the same generated residual prediction reference picture.

22. The apparatus of claim 20 , wherein the encoded information comprises a number of residual prediction reference pictures to be generated.

23. The apparatus of claim 20 , wherein the residual prediction reference picture is associated with a type selected from a plurality of types of residual prediction references.

24. The apparatus of claim 23 , wherein the plurality of types includes a first type representing a weighting factor of 0.5 and a second type representing a weighting factor of 1.

25. The apparatus of claim 23 , wherein the encoded information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture, and wherein only one of the plurality of types of residual prediction references is available for the residual prediction reference picture to be generated.

26. The apparatus of claim 23 , wherein at least two types of the plurality of types of residual prediction reference pictures are available, and the encoded information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture and indicating one of the at least two types for the residual prediction reference picture.

27. The apparatus of claim 20 , wherein the encoded information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture based on a first short-term reference picture in a reference picture list associated with the enhancement layer.

28. The apparatus of claim 20 , wherein the encoded information is specified at a level selected from: a picture parameter set (PPS), a video parameter set (VPS), a sequence parameter set (SPS), a reference parameter set (RPS), or a slice header.

29. A method of encoding video information, the method comprising:

encoding, using a processor operationally coupled to a memory unit, information about generating a residual prediction reference picture based at least in part on a corresponding enhancement layer reference picture associated with an enhancement layer,

wherein the residual prediction reference picture configured to have the same motion field and the same picture order count (POC) as the enhancement layer reference picture from which it is to be generated, and

wherein the memory unit is configured to store at least one reference picture list associated with one or more layers of video information in scalable video coding; and

signaling the encoded information in a bitstream.

30. The method of claim 29 , wherein the residual prediction reference picture is associated with a type selected from a plurality of types of residual prediction references, and wherein at least two types of the plurality of types of residual prediction reference pictures are available, and the encoded information comprises one or more syntax elements indicating whether to generate the residual prediction reference picture and indicating one of the at least two types for the residual prediction reference picture.