System and method for efficient scalable stream adaptation
A system and method for signaling low-to-high layer switching points in a file format level to enable efficient scalable stream switching in streaming servers and local file playback. The present invention also provides for a system and method for signaling low-to-high layer switching points in video bit stream, e.g., to enable intelligent forwarding of scalability layers in media-aware network elements or computationally scalable decoding in stream recipients.
1. A method of encoding a sequence of pictures into a sequence of access units, the method comprising:
encoding a first picture of the sequence of pictures into a first access unit of said sequence of access units, the first access unit comprising a non-instantaneous decoding refresh (IDR) picture in a base layer and an IDR picture in an enhancement layer, the IDR picture being decodable without inter prediction from any picture prior to the IDR picture in decoding order in the enhancement layer,
encoding at least one access unit preceding the first access unit in decoding order, the at least one access unit including at least one reference picture in the enhancement layer, and
including an indication into the sequence of access units to cause the IDR picture to mark the at least one reference picture as unused for reference.
2. A method of claim 1 , further comprising:
signaling a coded layer structure for said pictures, wherein the IDR picture enhances spatial resolution or quality of the first coded picture according to the coded layer structure.
3. A method of claim 1 , further comprising:
including an indication into the sequence of access units to cause the IDR picture to mark all decoded reference pictures preceding the first access unit in decoding order as unused for reference.
4. A method of claim 1 , further comprising:
generating a Network Abstraction Layer (NAL) unit header for at least one NAL unit for the IDR picture to comprise said indication.
5. A method of decoding a sequence of access units into a sequence of decoded pictures, the sequence of access units including a first access unit, the first access unit comprising a non-instantaneous decoding refresh (IDR) picture in a base layer and an IDR picture in an enhancement layer, the IDR picture being decodable without inter prediction from any picture prior to the IDR picture in decoding order in the enhancement layer, the method comprising:
decoding at least one access unit preceding the first access unit in decoding order into at least one decoded reference picture in the enhancement layer,
decoding the first access unit, including the IDR picture, into a first decoded reference picture,
decoding an indication associated with the IDR picture, and
marking, as a response to decoding the indication, the at least one decoded reference picture as unused for reference.
6. An electronic device for encoding a sequence of pictures into a sequence of access units, comprising:
a processor; and
a memory unit operatively connected to the processor and including a computer program product comprising:
computer code for encoding a first picture of the sequence of pictures into a first access unit of said sequence of access units, the first access unit comprising a non-instantaneous decoding refresh (IDR) picture in a base layer and an IDR picture in an enhancement layer, the IDR picture being decodable without inter prediction from any picture prior to the IDR picture in decoding order in the enhancement layer,
computer code for encoding at least one access unit preceding the first access unit in decoding order, the at least one access unit including at least one reference picture in the enhancement layer, and
computer code for including an indication into the sequence of access units to cause the IDR picture to mark the at least one reference picture as unused for reference.
7. An electronic device of claim 6 , further comprising:
computer code for signaling a coded layer structure for said pictures, wherein the IDR picture enhances spatial resolution or quality of the first coded picture according to the coded layer structure.
8. An electronic device of claim 6 , further comprising:
computer code for including an indication into the sequence of access units to cause the IDR picture to mark all decoded reference pictures preceding the first access unit in decoding order as unused for reference.
9. An electronic device of claim 6 , further comprising:
computer code for generating a Network Abstraction Layer (NAL) unit header for at least one NAL unit for the IDR picture to comprise said indication.
10. An electronic device for decoding a sequence of access units into a sequence of decoded pictures, the sequence of access units including a first access unit, the first access unit comprising a non-instantaneous decoding refresh (IDR) picture in a base layer and an IDR picture in an enhancement layer, the IDR picture being decodable without inter prediction from any picture prior to the IDR picture in decoding order in the enhancement layer, the electronic device comprising:
a processor; and
a memory unit operatively connected to the processor and including a computer program product comprising:
computer code for decoding at least one access unit preceding the first access unit in decoding order into at least one decoded reference picture in the enhancement layer,
computer code for decoding the first access unit, including the IDR picture, into a first decoded reference picture,
computer code for decoding an indication associated with the IDR picture, and
computer code for marking, as a response to decoding the indication, the at least one decoded reference picture as unused for reference.