IP Library Granted Patent US 9,131,245
Granted Patent B2
US 9,131,245 · App. 13/622,944 · Granted Sep 8, 2015

Reference picture list construction for video coding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,131,245
App. No.
13/622,944
Granted
Sep 8, 2015
Kind
B2
Abstract

Techniques are described related to constructing reference picture lists. The reference picture lists may be constructed from reference picture subsets of a reference picture set. In some examples, the techniques may repeatedly list reference pictures identified in the reference picture subsets until the number of entries in the reference picture list is equal to the maximum number of allowable entries in the reference picture list.

Claims (68)

1. A method for coding video data, the method comprising:

coding information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order; and

a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a reference picture list;

determining that a number of entries in the reference picture list is not equal to a maximum number of allowable entries in the reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the reference picture list;

in response to determining that the number of entries in the reference picture list is not equal to the maximum number of allowable entries in the reference picture list, repeatedly re-adding one or more reference pictures from at least one of the reference picture subsets into entries in the reference picture list that are subsequent to the first set of entries until the number of entries in the reference picture list is equal to the maximum number of allowable entries in the reference picture list; and

coding the current picture based on the reference picture list.

2. The method of claim 1 ,

wherein repeatedly re-adding the one or more reference pictures comprises identifying at least one reference picture of the first reference picture subset in more than one entry in the reference picture list.

3. The method of claim 1 , wherein repeatedly re-adding the one or more reference pictures comprises adding reference pictures in entries of the reference picture list such that each entry of the reference picture list identifies one of the reference pictures, and such that at least two entries of the reference picture list identify a same reference picture of the reference pictures.

4. The method of claim 1 ,

wherein coding information comprises decoding the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and

wherein coding comprises decoding the current picture based on the reference picture list.

5. The method of claim 1 ,

wherein coding information comprises encoding the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and

wherein coding comprises encoding the current picture based on the reference picture list.

6. A device for coding video data, the device comprising a video coder configured to:

code information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order; and

a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a reference picture list;

determine that a number of entries in the reference picture list is not equal to a maximum number of allowable entries in the reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the reference picture list;

in response to determining that the number of entries in the reference picture list is not equal to the maximum number of allowable entries in the reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the reference picture list that are subsequent to the first set of entries until the number of entries in the reference picture list is equal to the maximum number of allowable entries in the reference picture list; and

code the current picture based on the reference picture list.

7. The device of claim 6 ,

wherein to repeatedly re-add the one or more reference pictures, the video coder is configured to identify at least one reference picture of the first reference picture subset in more than one entry in the reference picture list.

8. The device of claim 6 , wherein to repeatedly re-add the one or more reference pictures, the video coder is configured to add reference pictures in entries of the reference picture list such that each entry of the reference picture list identifies one of the reference pictures, and such that at least two entries of the reference picture list identify a same reference picture of the reference pictures.

9. The device of claim 6 , wherein the video coder comprises a video decoder, wherein the video decoder is configured to:

decode the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and

decode the current picture based on the reference picture list.

10. The video coding device of claim 6 , wherein the video coder comprises a video encoder, and wherein the video encoder is configured to:

encode the information indicative of reference pictures that belong to the reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order; and

encode the current picture based on the reference picture list.

11. The device of claim 6 , wherein the device comprises one of:

a wireless communication device;

a microprocessor; and

an integrated circuit.

12. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a device for coding video data to:

code information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order; and

a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a reference picture list;

determine that a number of entries in the reference picture list is not equal to a maximum number of allowable entries in the reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the reference picture list;

in response to determining that the number of entries in the reference picture list is not equal to the maximum number of allowable entries in the reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the reference picture list that are subsequent to the first set of entries until the number of entries in the reference picture list is equal to the maximum number of allowable entries in the reference picture list; and

code the current picture based on the reference picture list.

13. The non-transitory computer-readable storage medium of claim 12 ,

wherein the instructions that cause the processor to repeatedly re-add the one or more reference pictures comprise instructions that cause the processor to identify at least one reference picture of the first reference picture subset in more than one entry in the reference picture list.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions that cause the processor to repeatedly re-add the one or more reference pictures comprise instructions that cause the processor to add reference pictures in entries of the reference picture list such that each entry of the reference picture list identifies one of the reference pictures, and such that at least two entries of the reference picture list identify a same reference picture of the reference pictures.

15. A device for coding video data, the device comprising

means for coding information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

means for constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:

a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order; and

a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;

means for adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a reference picture list;

means for determining that a number of entries in the reference picture list is not equal to a maximum number of allowable entries in the reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the reference picture list;

means for repeatedly re-adding, in response to determining that the number of entries in the reference picture list is not equal to the maximum number of allowable entries in the reference picture list, one or more reference pictures from at least one of the reference picture subsets into entries in the reference picture list that are subsequent to the first set of entries until the number of entries in the reference picture list is equal to the maximum number of allowable entries in the reference picture list; and

means for coding the current picture based on the reference picture list.

16. The device of claim 15 ,

wherein the means for repeatedly re-adding the one or more reference pictures comprises means for identifying at least one reference picture of the first reference picture subset in more than one entry in the reference picture list.

17. The device of claim 15 , wherein the means for repeatedly re-adding the one or more reference pictures comprises means for adding reference pictures in entries of the reference picture list such that each entry of the reference picture list identifies one of the reference pictures, and such that at least two entries of the reference picture list identify a same reference picture of the reference pictures.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 060923/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: VELOS MEDIA, LLC
To: QUALCOMM INCORPORATED
Reel/Frame 057575/0431 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 057554/0540 →
SECOND AMENDED AND RESTATED MEMBER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 2, 2018
From: VELOS MEDIA MANAGEMENT, LLC; VELOS MEDIA, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
Reel/Frame 045806/0030 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2017
From: QUALCOMM INCORPORATED
To: VELOS MEDIA, LLC
Reel/Frame 042758/0171 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2012
From: WANG, YE-KUI; CHEN, YING
To: QUALCOMM INCORPORATED
Reel/Frame 028991/0214 →