Decoded picture buffer management
Techniques are described related to output and removal of decoded pictures from a decoded picture buffer (DPB). The example techniques may remove a decoded picture from the DPB prior to coding a current picture. For instance, the example techniques may remove the decoded picture if that decoded picture is not identified in the reference picture set of the current picture.
1. A method for encoding video data, the method comprising:
encoding information indicative of reference pictures that are part of a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order;
a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order; and
a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order;
determining if a number of entries in a first reference picture list is less than a maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, adding a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first reference picture list;
determining if the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, repeatedly adding one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the first reference picture list until the number of entries in the first reference picture list is not less than the maximum number of allowable entries in the first reference picture list;
determining if a number of entries in a second reference picture list is less than a maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, adding a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the second reference picture list;
determining if a number of entries in a second reference picture list is less than a maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, repeatedly adding one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the second reference picture list until the number of entries in the second reference picture list is not less than the maximum number of allowable entries in the second reference picture list;
and
encoding the current picture based on the first reference picture list and the second reference picture list.
2. The method of claim 1 , wherein repeatedly adding the one or more reference pictures into the first reference picture list comprises identifying at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.
3. The method of claim 1 , wherein repeatedly adding the one or more reference pictures into the first reference picture list comprises adding reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.
4. A device for encoding video data, the device comprising a video encoder configured to:
encode information indicative of reference pictures that are part of a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order;
a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order; and
a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order;
determine if a number of entries in a first reference picture list is less than a maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, add a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first reference picture list;
determine if the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, repeatedly add one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the first reference picture list until the number of entries in the first reference picture list is not less than the maximum number of allowable entries in the first reference picture list;
determine if a number of entries in a second reference picture list is less than a maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, add a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the second reference picture list;
determine if the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, repeatedly add one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the second reference picture list until the number of entries in the second reference picture list is not less than the maximum number of allowable entries in the second reference picture list;
and
encode the current picture based on the first reference picture list and the second reference picture list.
5. The device of claim 4 , wherein to repeatedly add the one or more reference pictures in the first reference picture list, the video encoder is configured to identify at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.
6. The device of claim 4 , wherein to repeatedly add the one or more reference pictures in the first reference picture list, the video encoder is configured to add reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.
7. The device of claim 4 , wherein the device comprises one of:
a wireless communication device;
a microprocessor; and
an integrated circuit.
8. A method for decoding video data, the method comprising:
decoding information indicative of reference pictures that are part of a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order;
a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order; and
a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order;
determining if a number of entries in a first reference picture list is less than a maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, adding a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first reference picture list;
determining if the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, repeatedly adding one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the first reference picture list until the number of entries in the first reference picture list is not less than the maximum number of allowable entries in the first reference picture list;
determining if a number of entries in a second reference picture list is less than a maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, adding a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the second reference picture list;
determining if a number of entries in a second reference picture list is less than a maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, repeatedly adding one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the second reference picture list until the number of entries in the second reference picture list is not less than the maximum number of allowable entries in the second reference picture list;
and
decoding the current picture based on the first reference picture list and the second reference picture list.
9. The method of claim 8 , wherein repeatedly adding the one or more reference pictures into the first reference picture list comprises identifying at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.
10. The method of claim 8 , wherein repeatedly adding the one or more reference pictures into the first reference picture list comprises adding reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.
11. A device for decoding video data, the device comprising a video decoder configured to:
decode information indicative of reference pictures that are part of a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order;
a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order; and
a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order;
determine if a number of entries in a first reference picture list is less than a maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, add a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first reference picture list;
determine if the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list;
in response to determining that the number of entries in the first reference picture list is less than the maximum number of allowable entries in the first reference picture list, repeatedly add one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the first reference picture list until the number of entries in the first reference picture list is not less than the maximum number of allowable entries in the first reference picture list;
determine if a number of entries in a second reference picture list is less than a maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, add a reference picture from one of: the first reference picture subset, the second reference picture subset, and the third reference picture subset into the second reference picture list; determine if the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list;
in response to determining that the number of entries in the second reference picture list is less than the maximum number of allowable entries in the second reference picture list, repeatedly add one or more reference pictures from at least one of the first reference picture subset, second reference picture subset, and third reference picture subset into the second reference picture list until the number of entries in the second reference picture list is not less than the maximum number of allowable entries in the second reference picture list;
and
decode the current picture based on the first reference picture list and the second reference picture list.
12. The device of claim 11 , wherein to repeatedly add the one or more reference pictures in the first reference picture list, the video decoder is configured to identify at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.
13. The device of claim 11 , wherein to repeatedly add the one or more reference pictures in the first reference picture list, the video decoder is configured to add reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.
14. The device of claim 11 , wherein the device comprises one of:
a wireless communication device;
a microprocessor; and
an integrated circuit.