Reference picture set (RPS) signaling for scalable high efficiency video coding (HEVC)
Embodiments contemplate coding video data by generating a video encoded bitstream that may include reference picture set (RPS) extensions for inter-layer reference pictures, and the extensions may include inter-layer delta Picture Order Counts (POCs). Embodiments may also include signaling that lower layer reference pictures may be available in a lower layer decoder picture buffer (DPB), and/or an aggregate DPB, that may be added to the RPS set of a higher layer. The bitstream may include a signal indicating whether the higher layer RPS may be specified by a lower layer RPS, and the lower layer RPS may be temporal, inter-layer prediction (ILP), or both.
1. A decoding device for video data coding, comprising:
a memory comprising at least one decoded picture buffer (DPB) comprising a plurality of decoded pictures;
a receiver, the receiver configured at least in part to:
receive video data that comprises a current enhancement layer and a plurality of reference layers of the current enhancement layer, and receive an inter-layer reference picture number indicator associated with a current enhancement layer picture; and
a processor, the processor configured at least in part to:
construct, based on a picture order count (POC) number of the current enhancement layer picture, an inter-layer reference picture set (RPS) for the current enhancement layer picture that comprise a plurality of decoded pictures at a same time instance as the current enhancement layer picture from the plurality of reference layers of the current enhancement layer;
determine, based on the inter-layer reference picture number indicator associated with the current enhancement layer picture that indicates a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture;
identify, based on the determining, at least one inter-layer reference picture from the inter-layer RPS to be used for predicting of the current enhancement layer picture;
combine the at least one identified inter-layer reference picture from the inter-layer RPS with one or more temporal enhancement layer reference pictures to form a reference picture list for the current enhancement layer picture; and
reconstruct the current enhancement layer picture for display based on the reference picture list.
2. The device of claim 1 , wherein the processor is further configured:
identify a decoded picture having a same POC number from a reference layer of the current enhancement layer; and
add the identified decoded picture to the inter-layer RPS.
3. The device of claim 1 , wherein the plurality of inter-layer reference pictures are from reference layers lower than a layer of the current enhancement layer picture.
4. A method for video data decoding, the method comprising:
receiving a video data that comprises a current enhancement layer and a plurality of reference layers of the current enhancement layer;
receiving an inter-layer reference picture number indicator associated with a current enhancement layer picture;
constructing, based on a picture order count (POC) number of the current enhancement layer picture, an inter-layer reference picture set (RPS) for the current enhancement layer picture that comprise a plurality of decoded pictures at a same time instance as the current enhancement layer picture from the plurality of reference layers of the current enhancement layer;
determining, based on the inter-layer reference picture number indicator associated with the current enhancement layer picture that indicates a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture;
identifying, based on the determining, at least one inter-layer reference picture from the inter-layer RPS to be used for predicting of the current enhancement layer picture;
combining the at least one identified inter-layer reference pictures from the inter-layer RPS with one or more temporal enhancement layer reference pictures to form a reference picture list for the current enhancement layer picture; and
reconstructing the current enhancement layer picture for display based on the reference picture list.
5. The method of claim 4 , further comprising:
identifying a decoded picture having a same POC number from a reference layer of the current enhancement layer; and
adding the identified decoded picture to the inter-layer RPS.
6. The method of claim 4 , wherein the plurality of inter-layer reference pictures are from reference layers lower than a layer of the current enhancement layer.
7. The device of claim 1 , wherein the inter-layer reference picture number indicator is received in a slice header associated with the current enhancement layer picture.
8. The device of claim 1 , wherein the receiver is further configured to receive inter-layer dependency information associated with the current enhancement layer, and the inter-layer RPS is constructed based on the inter-layer dependency information associated with the current enhancement layer.
9. The device of claim 1 , wherein the processor is further configured to:
construct a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not at a same time as the current enhancement layer picture, wherein one or more temporal enhancement layer reference pictures from the temporal RPS is combined with the identified at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture.
10. The device of claim 1 , wherein the inter-layer reference picture number indicator indicates a first value of one less than the number of inter-layer reference pictures from the inter-layer RPS to be used for decoding the current enhancement layer picture, and the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture is determined by adding one to the first value.
11. The method of claim 4 , wherein the inter-layer reference picture number indicator is received in a slice header associated with the current enhancement layer picture.
12. The method of claim 4 , further comprising receiving inter-layer dependency information associated with the current enhancement layer, wherein the inter-layer RPS is constructed based on the inter-layer dependency information associated with the current enhancement layer.
13. The method of claim 4 , further comprising:
constructing a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not at a same time as the current enhancement layer picture, wherein one or more temporal enhancement layer reference pictures from the temporal RPS is combined with the identified at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture.
14. The method of claim 4 , wherein the inter-layer reference picture number indicator indicates a first value of one less than the number of inter-layer reference pictures from the inter-layer RPS to be used for decoding the current enhancement layer picture, and the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture is determined by adding one to the first value.