Reference picture marking in scalable video encoding and decoding
A device, an encoding method, and a decoding method enable a separate marking of base representations and enhanced representations of key access units to save memory or to allow a better scalable video coding optimization. The encoding method of a sequence of original pictures to a sequence of access units includes, after encoding of one of the access units, storing a first decoded picture of the first encoded picture and a second decoded picture of the second encoded picture for inter prediction for encoding of others of the access units; and identifying the first decoded picture and the second decoded picture to be no longer used for inter prediction. The decoding method includes decoding the first access unit, where a first decoded picture is decoded from the first picture and a second decoded picture is decoded from the second picture; marking the first and second decoded pictures as used for inter prediction; decoding the second access unit; and marking one of the first and second decoded pictures as no longer used for inter prediction.
1. A method of decoding an encoded video signal, the method comprising:
decoding, by a processor, a key access unit, the key access unit including at least one slice in a base layer and at least one slice in a scalable layer, wherein a base representation picture is decoded from at least one slice in the base layer and an enhanced representation picture is decoded from at least one slice in the scalable layer;
marking, by the processor, the base representation and enhanced representation pictures as used for inter prediction;
decoding, by the processor, a non-key access unit; and
marking, by the processor, one of the base representation and enhanced representation pictures as no longer used for inter prediction.
2. The method of claim 1 , wherein:
the scalable layer corresponds to a fine granularity scalability representation.
3. The method of claim 1 , further comprising:
retrieving a reference picture management information for the key access unit during decoding of the non-key access unit.
4. The method of claim 3 , wherein:
the reference picture management information comprises information for the base representation picture of the key access unit.
5. The method of claim 3 , wherein:
the reference picture management information comprises information for the enhanced representation picture of the key access unit.
6. The method of claim 1 , further comprising:
defining different priority levels to the base representation picture and the enhanced representation picture; and
marking at least one of the base representation picture and the enhanced representation picture as unused for reference based on the priority levels.
7. A method of encoding a video signal, the method comprising:
encoding, by a processor, a key access unit, the key access unit including at least one slice in a base layer and at least one slice in a scalable layer;
decoding, by the processor, a base representation picture from at least one slice in the base layer and an enhanced representation picture from at least one slice in the scalable layer;
storing, by the processor, the base representation picture and the enhanced representation picture for inter prediction in encoding of other access units; and
encoding, by the processor, a non-key access unit, marking one of the base representation and enhanced representation pictures as no longer used for inter prediction.
8. The method of claim 7 , wherein:
the scalable layer corresponds to a fine granularity scalability representation.
9. The method of claim 7 , further comprising:
providing a reference picture management information for the key access unit during encoding of the non-key access unit.
10. The method of claim 9 , wherein:
the reference picture management information comprises information for the base representation picture of the key access unit.
11. The method of claim 9 , wherein:
the reference picture management information comprises information for the enhanced representation picture of the key access unit.
12. The method of claim 7 , further comprising:
defining different priority levels to the base representation picture and the enhanced representation picture; and
marking at least one of the base representation picture and the enhanced representation picture as “unused for reference” based on the priority levels.
13. A device for decoding an encoded video signal, the device comprising:
a processor;
a memory effectively coupled to the processor; and
programmed instructions to:
decode a key access unit, the key access unit including at least one slice in a base layer and at least one slice in a scalable layer, wherein a base representation picture is decoded from at least one slice in the base layer and an enhanced representation picture is decoded from at least one slice in the scalable layer;
mark the base representation and enhanced representation pictures stored in the memory as used for inter prediction;
decode a non-key access unit; and
mark one of the base representation and enhanced representation pictures as no longer used for inter prediction.
14. The device of claim 13 , wherein:
the scalable layer corresponds to a fine granularity scalability representation.
15. The device of claim 13 , wherein the programmed instructions are further configured to:
retrieve a reference picture management information for the key access unit during decoding of the non-key access unit.
16. The device of claim 15 , wherein:
the reference picture management information comprises information for the base representation picture of the key access unit.
17. The device of claim 15 , wherein:
the reference picture management information comprises information for the enhanced representation picture of the key access unit.
18. The device of claim 13 , wherein the programmed instructions are further configured to:
define different priority levels to the base representation picture and the enhanced representation picture; and
mark at least one of the base representation picture and the enhanced representation picture as unused for reference based on the priority levels.
19. A device for encoding a video signal, the device comprising:
a processor;
a memory effectively coupled to the processor; and
programmed instructions to:
encode a key access unit, the key access unit including at least one slice in a base layer and at least one slice in a scalable layer;
decode a base representation picture from at least one slice in the base layer and an enhanced representation picture from at least one slice in the scalable layer;
store the base representation picture and the enhanced representation picture in the memory for inter prediction in encoding of other access units;
encode a non-key access unit; and
mark one of the base representation and enhanced representation pictures as no longer used for inter prediction.
20. The device of claim 19 , wherein:
the base representation picture and the enhanced representation picture are marked used for short-term reference.
21. The device of claim 19 , wherein:
the scalable layer corresponds to a fine granularity scalability representation.
22. The device of claim 19 , wherein the programmed instructions are further configured to:
define different priority levels to the base representation picture and the enhanced representation picture; and
mark at least one of the base representation picture and the enhanced representation picture as unused for reference based on the priority levels.
23. The device of claim 19 , wherein the programmed instructions are further configured to:
provide a reference picture management information for the key access unit during encoding of the non-key access unit.
24. The device of claim 23 , wherein:
the reference picture management information comprises information for the base representation picture of the key access unit.
25. The device of claim 23 , wherein:
the reference picture management information comprises information for the enhanced representation picture of the key access unit.
26. The device of claim 19 , wherein:
the base representation picture and the enhanced representation picture are independently identified, the programmed instructions further configured to:
mark the base representation picture and the enhanced representation picture as unused for reference.