IP Library › Granted Patent US 10,856,007

Granted Patent B2

US 10,856,007 · App. 16/702,045 · Granted Dec 1, 2020

Decoded picture buffer management

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,856,007
App. No.: 16/702,045
Granted: Dec 1, 2020
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Techniques are described related to output and removal of decoded pictures from a decoded picture buffer (DPB). The example techniques may remove a decoded picture from the DPB prior to coding a current picture. For instance, the example techniques may remove the decoded picture if that decoded picture is not identified in the reference picture set of the current picture.

Claims (73)

1. A method for coding video data, the method comprising:

coding information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order; and

a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;

determining that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;

in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, repeatedly re-adding one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;

adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a second reference picture list;

determining that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;

in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, repeatedly re-adding one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list; and

coding the current picture based on the first reference picture list and the second reference picture list.

2. The method of claim 1 , wherein repeatedly re-adding the one or more reference pictures in the first reference picture list comprises identifying at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.

3. The method of claim 1 , wherein repeatedly re-adding the one or more reference pictures in the first reference picture list comprises adding reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.

4. The method of claim 1 , wherein coding information comprises decoding the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and wherein coding comprises decoding the current picture based on the first reference picture list and the second reference picture list.

5. The method of claim 1 , wherein coding information comprises encoding the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and wherein coding comprises encoding the current picture based on the first reference picture list and the second reference picture list.

6. A device for coding video data, the device comprising a video coder configured to:

code information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;

determine that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;

in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;

add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a second reference picture list;

determine that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;

in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list; and

code the current picture based on the first reference picture list and the second reference picture list.

7. The device of claim 6 , wherein to repeatedly re-add the one or more reference pictures in the first reference picture list, the video coder is configured to identify at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.

8. The device of claim 6 , wherein to repeatedly re-add the one or more reference pictures in the first reference picture list, the video coder is configured to add reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.

9. The device of claim 6 , wherein the video coder comprises a video decoder, wherein the video decoder is configured to:

decode the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and

decode the current picture based on the first reference picture list and the second reference picture list.

10. The video coding device of claim 6 , wherein the video coder comprises a video encoder, and wherein the video encoder is configured to:

encode the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and

encode the current picture based on the first reference picture list and the second reference picture list.

11. The device of claim 6 , wherein the device comprises one of:

a wireless communication device;

a microprocessor; and

an integrated circuit.

12. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a device for coding video data to:

in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;

in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list; and

code the current picture based on the first reference picture list and the second reference picture list.

13. The non-transitory computer-readable storage medium of claim 12 ,

wherein the instructions that cause the processor to repeatedly re-add the one or more reference pictures in the first reference picture list comprise instructions that cause the processor to identify at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions that cause the processor to repeatedly re-add the one or more reference pictures in the first reference picture list comprise instructions that cause the processor to add reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.

15. A device for coding video data, the device comprising

means for coding information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

means for constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

means for adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;

means for determining that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;

means for repeatedly re-adding, in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;

means for determining that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;

means for repeatedly re-adding, in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list; and

means for coding the current picture based on the first reference picture list and the second reference picture list.

16. The device of claim 15 , wherein the means for repeatedly re-adding the one or more reference pictures in the first reference picture list comprises means for identifying at least one reference picture of the first reference picture subset in more than one entry in the first reference picture list.

17. The device of claim 15 , wherein the means for repeatedly re-adding the one or more reference pictures in the first reference picture list comprises means for adding reference pictures in entries of the first reference picture list such that each entry of the first reference picture list identifies one of the reference pictures, and such that at least two entries of the first reference picture list identify a same reference picture of the reference pictures.

Assignments (5)

RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022

From: CORTLAND CAPITAL MARKET SERVICES LLC

To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC

Reel/Frame 060923/0407 →

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021

From: VELOS MEDIA, LLC

To: QUALCOMM INCORPORATED

Reel/Frame 057575/0431 →

RELEASE OF SECURITY INTEREST Recorded Sep 21, 2021

From: CORTLAND CAPITAL MARKET SERVICES LLC

To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC