REFERENCE PICTURE SET (RPS) SIGNALING FOR SCALABLE HIGH EFFICIENCY VIDEO CODING (HEVC)
Embodiments contemplate coding video data by generating a video encoded bitstream that may include reference picture set (RPS) extensions for inter-layer reference pictures, and the extensions may include inter-layer delta Picture Order Counts (POCs). Embodiments may also include signaling that lower layer reference pictures may be available in a lower layer decoder picture buffer (DPB), and/or an aggregate DPB, that may be added to the RPS set of a higher layer. The bitstream may include a signal indicating whether the higher layer RPS may be specified by a lower layer RPS, and the lower layer RPS may be temporal, inter-layer prediction (ILP), or both.
1 - 23 . (canceled)
24 . A video decoding device, comprising:
a processor configured to:
obtain video data that comprises an enhancement layer and at least one reference layer of the enhancement layer;
construct, for a current enhancement layer picture, an inter-layer reference picture set (RPS) that comprises at least one decoded picture associated with a same time instance as the current enhancement layer picture from the at least one reference layer of the enhancement layer;
generate a reference picture list for the current enhancement layer picture based on the inter-layer RPS; and
decode the current enhancement layer picture based on the reference picture list.
25 . The device of claim 24 , wherein the processor is further configured to:
identify, from the at least one reference layer of the current enhancement layer, the at least one decoded picture having a same picture order count (POC) number as the current enhancement layer picture; and
add the identified at least one decoded picture to the inter-layer RPS.
26 . The device of claim 24 , wherein the processor is further configured to:
construct a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not associated with a same time as the current enhancement layer picture, wherein at least one temporal enhancement layer reference picture from the temporal RPS is combined with the at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture.
27 . The device of claim 24 , wherein the processor is further configured to:
obtain inter-layer dependency information associated with the enhancement layer, wherein the inter-layer RPS is constructed based on the inter-layer dependency information associated with the enhancement layer.
28 . The device of claim 24 , wherein the processor is further configured to:
obtain an inter-layer reference picture number indicator associated with the current enhancement layer picture, the current enhancement layer picture indicating a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, wherein the inter-layer RPS is constructed based on the inter-layer reference picture number indicator.
29 . The device of claim 24 , further comprising a memory.
30 . A video encoding device, comprising:
a processor configured to:
obtain video data that comprises an enhancement layer and at least one reference layer of the enhancement layer;
construct, for a current enhancement layer picture, an inter-layer reference picture set (RPS) that comprises at least one decoded picture associated with a same time instance as the current enhancement layer picture from the at least one reference layer of the enhancement layer;
generate a reference picture list for the current enhancement layer picture based on the inter-layer RPS; and
encode the current enhancement layer picture based on the reference picture list.
31 . The device of claim 30 , wherein the processor is further configured to:
identify, from the at least one reference layer of the current enhancement layer, the at least one decoded picture having a same picture order count (POC) number as the current enhancement layer picture; and
add the identified at least one decoded picture to the inter-layer RPS.
32 . The device of claim 30 , wherein the processor is further configured to:
construct a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not associated with a same time as the current enhancement layer picture, wherein at least one temporal enhancement layer reference picture from the temporal RPS is combined with the at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture.
33 . The device of claim 30 , wherein the processor is further configured to:
obtain inter-layer dependency information associated with the enhancement layer, wherein the inter-layer RPS is constructed based on the inter-layer dependency information associated with the enhancement layer.
34 . The device of claim 30 , wherein the processor is further configured to:
determine a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, the inter-layer RPS is constructed based on the determined number of inter-layer reference pictures.
35 . The device of claim 30 , further comprising a memory.
36 . A method of video decoding, the method comprising:
obtaining video data that comprises an enhancement layer and at least one reference layer of the enhancement layer;
constructing, for a current enhancement layer picture, an inter-layer reference picture set (RPS) that comprises at least one decoded picture associated with a same time instance as the current enhancement layer picture from the at least one reference layer of the enhancement layer;
generating a reference picture list for the current enhancement layer picture based on the inter-layer RPS; and
decoding the current enhancement layer picture based on the reference picture list.
37 . The method of claim 36 , further comprising:
identifying, from the at least one reference layer of the current enhancement layer, the at least one decoded picture having a same picture order count (POC) number as the current enhancement layer picture; and
adding the identified at least one decoded picture to the inter-layer RPS.
38 . The method of claim 36 , further comprising:
constructing a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not associated with a same time as the current enhancement layer picture, wherein at least one temporal enhancement layer reference picture from the temporal RPS is combined with the at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture.
39 . The device of claim 36 , further comprising:
obtaining inter-layer dependency information associated with the enhancement layer, wherein the inter-layer RPS is constructed based on the inter-layer dependency information associated with the enhancement layer.
40 . The device of claim 36 , further comprising:
obtaining an inter-layer reference picture number indicator associated with the current enhancement layer picture, the current enhancement layer picture indicating a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, wherein the inter-layer RPS is constructed based on the inter-layer reference picture number indicator.
41 . A computer-readable medium including instructions for causing one or more processors to:
obtain video data that comprises an enhancement layer and at least one reference layer of the enhancement layer;
construct, for a current enhancement layer picture, an inter-layer reference picture set (RPS) that comprises at least one decoded picture associated with a same time instance as the current enhancement layer picture from the at least one reference layer of the enhancement layer;
generate a reference picture list for the current enhancement layer picture based on the inter-layer RPS; and
decode the current enhancement layer picture based on the reference picture list.
42 . The computer-readable medium of claim 41 , further including instructions for causing one or more processors to:
identify, from the at least one reference layer of the current enhancement layer, the at least one decoded picture having a same picture order count (POC) number as the current enhancement layer picture; and
add the identified at least one decoded picture to the inter-layer RPS.
43 . The computer-readable medium of claim 41 , further including instructions for causing one or more processors to:
construct a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not associated with a same time as the current enhancement layer picture, wherein at least one temporal enhancement layer reference picture from the temporal RPS is combined with the at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture.