IP Library Granted Patent US 9,420,307
Granted Patent B2
US 9,420,307 · App. 13/622,928 · Granted Aug 16, 2016

Coding reference pictures for a reference picture set

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,420,307
App. No.
13/622,928
Granted
Aug 16, 2016
Kind
B2
Abstract

Techniques are described related to coding of long-term reference pictures for a reference picture set. In some examples, a video coder may code candidate long-term reference pictures in a parameter set. The video coder also code syntax elements that indicate which long-term reference pictures from the candidate long-term reference pictures belong in the reference picture set.

Claims (90)

1. A method for coding video data, the method comprising:

coding syntax elements of a parameter set that identify candidate long-term reference pictures of the video data, wherein one or more of the candidate long-term reference pictures belong in a reference picture set of a current picture of the video data, and one or more of the candidate long-term reference pictures do not belong in the reference picture set of the current picture, and wherein the reference picture set identifies reference pictures of the video data that can potentially be used for inter-predicting the current picture of the video data and can potentially be used for inter-predicting one or more pictures of the video data following the current picture in decoding order;

coding syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture;

constructing at least one of a plurality of reference picture subsets based on the indication of which candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the plurality of reference picture subsets form the reference picture set, wherein a first plurality of reference picture subsets identifies reference pictures that can potentially be used for inter-predicting the current picture and pictures following the current picture in decoding order and a second plurality of reference picture subsets identifies reference pictures that cannot be used for inter-predicting the current picture and can potentially be used for inter-predicting pictures following the current picture in decoding order;

constructing one or both of a first reference picture list and a second reference picture list based on one or more reference pictures of the first plurality of reference picture subsets; and

inter-predicting the current picture of the video data based on at least one reference picture identified in the first reference picture list or the second reference picture list.

2. The method of claim 1 , wherein coding the syntax elements that identify the candidate long-term reference pictures comprises coding the syntax elements in a sequence parameter set.

3. The method of claim 1 , wherein coding the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture comprises coding the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture in a slice header of the current picture.

4. The method of claim 1 , further comprising:

coding syntax elements that indicate long-term reference pictures that belong in the reference picture set, wherein the syntax elements that indicate the long-term reference pictures indicate the long-term reference pictures that are not included in the candidate long-term reference pictures,

wherein constructing the at least one of the plurality reference picture subsets comprises constructing the at least one of the plurality of reference picture subsets based on the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set and the syntax elements that indicate the long-term reference pictures that belong in the reference picture set.

5. The method of claim 4 , wherein coding the syntax elements that indicate which long-term reference pictures belong in the reference picture set comprises coding the syntax elements that indicate which long-term reference pictures belong in the reference picture set in a slice header of the current picture.

6. The method of claim 1 , wherein coding syntax elements that identify the candidate long-term reference pictures comprises:

coding a list of picture order count (POC) values for the candidate long-term reference pictures, the method further comprising:

coding an index value to the list.

7. The method of claim 6 , wherein coding the list of POC values comprises coding the list of POC values in the parameter set, and wherein coding the index value to the list comprises coding the index value to the list in a slice header of the current picture.

8. The method of claim 1 , wherein coding the syntax elements of the parameter set that identify the candidate long-term reference pictures comprises coding the syntax elements in a picture parameter set.

9. The method of claim 1 ,

wherein coding syntax elements of the parameter set comprises decoding, with a video decoder, the syntax elements from the parameter set that identify the candidate long-term reference pictures, wherein one or more of the candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the reference picture set identifies reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order,

wherein coding syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture comprises decoding, with the video decoder, the syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture, and

wherein inter-predicting comprises inter-predicting, with the video decoder, the current picture based on the at least one reference picture.

10. The method of claim 1 ,

wherein coding syntax elements of the parameter set comprises encoding, with a video encoder, the syntax elements in the parameter set that identify the candidate long-term reference pictures, wherein one or more of the candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the reference picture set identifies reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order,

wherein coding syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture comprises encoding, with the video encoder, the syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture, and

wherein inter-predicting comprises inter-predicting, with the video encoder, the current picture based on the at least one reference picture.

11. A device for coding video data, the device comprising a video coder configured to:

code syntax elements of a parameter set that identify candidate long-term reference pictures of the video data, wherein one or more of the candidate long-term reference pictures belong in a reference picture set of a current picture of the video data, and one or more of the candidate long-term reference pictures do not belong in the reference picture set of the current picture, and wherein the reference picture set identifies reference pictures of the video data that can potentially be used for inter-predicting the current picture of the video data and can potentially be used for inter-predicting one or more pictures of the video data following the current picture in decoding order;

code syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture;

construct at least one of a plurality of reference picture subsets based on the indication of which candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the plurality of reference picture subsets form the reference picture set, wherein a first plurality of reference picture subsets identifies reference pictures that can potentially be used for inter-predicting the current picture and pictures following the current picture in decoding order and a second plurality of reference picture subsets identifies reference pictures that cannot be used for inter-predicting the current picture and can potentially be used for inter-predicting pictures following the current picture in decoding order;

construct one or both of a first reference picture list and a second reference picture list based on one or more reference pictures of the first plurality of reference picture subsets; and

inter-predict the current picture of the video data based on at least one reference picture identified in the first reference picture list or the second reference picture list.

12. The device of claim 11 , wherein to code the syntax elements that identify the candidate long-term reference pictures, the video coder is configured to code the syntax elements in a sequence parameter set.

13. The device of claim 11 , wherein to code the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture, the video coder is configured to code the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture in a slice header of the current picture.

14. The device of claim 11 , wherein the video coder is configured to:

code syntax elements that indicate long-term reference pictures that belong in the reference picture set, wherein the syntax elements that indicate the long-term reference pictures indicate the long-term reference pictures that are not included in the candidate long-term reference pictures,

wherein to construct the at least one of the plurality reference picture subsets, the video coder is configured to construct the at least one of the plurality of reference picture subsets based on the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set and the syntax elements that indicate the long-term reference pictures that belong in the reference picture set.

15. The device of claim 14 , wherein to code the syntax elements that indicate which long-term reference pictures belong in the reference picture set, the video coder is configured to code the syntax elements that indicate which long-term reference pictures belong in the reference picture set in a slice header of the current picture.

16. The device of claim 11 , wherein to code syntax elements that identify the candidate long-term reference pictures, the video coder is configured to:

code a list of picture order count (POC) values for the candidate long-term reference pictures; and

code an index value to the list.

17. The device of claim 16 , wherein to code the list of POC values, the video coder is configured to code the list of POC values in the parameter set, and wherein to code the index value to the list, the video coder is configured to code the index value to the list in a slice header of the current picture.

18. The device of claim 11 , wherein to code the syntax elements of the parameter set that identify the candidate long-term reference pictures, the video coder is configured to code the syntax elements in a picture parameter set.

19. The device of claim 11 , wherein the video coder comprises a video decoder, and wherein the video decoder is configured to:

decode the syntax elements from the parameter set that identify the candidate long-term reference pictures, wherein one or more of the candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the reference picture set identifies reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

decode the syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture; and

inter-predict the current picture based on the at least one reference picture.

20. The device of claim 11 , wherein the video coder comprises a video encoder, and video encoder is configured to:

encode the syntax elements in the parameter set that identify the candidate long-term reference pictures, wherein one or more of the candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the reference picture set identifies reference pictures that can potentially be used for inter-predicting the current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;

encode the syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture; and

inter-predict the current picture based on the at least one reference picture.

21. The device of claim 11 , wherein the device comprises one of:

a wireless communication device;

a microprocessor; or

an integrated circuit.

22. The device of claim 19 , further comprising a display configured to display the current picture and the one or more pictures of the plurality of reference picture subsets.

23. The device of claim 20 , further comprising a camera configured to capture the current picture and the one or more pictures of the plurality of reference picture subsets.

24. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a device for coding video data to:

code syntax elements of a parameter set that identify candidate long-term reference pictures of the video data, wherein one or more of the candidate long-term reference pictures belong in a reference picture set of a current picture of the video data, and one or more of the candidate long-term reference pictures do not belong in the reference picture set of the current picture, and wherein the reference picture set identifies reference pictures of the video data that can potentially be used for inter-predicting the current picture of the video data and can potentially be used for inter-predicting one or more pictures of the video data following the current picture in decoding order;

code syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture;

construct at least one of a plurality of reference picture subsets based on the indication of which candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the plurality of reference picture subsets form the reference picture set, wherein a first plurality of reference picture subsets identifies reference pictures that can potentially be used for inter-predicting the current picture and pictures following the current picture in decoding order and a second plurality of reference picture subsets identifies reference pictures that cannot be used for inter-predicting the current picture and can potentially be used for inter-predicting pictures following the current picture in decoding order;

construct one or both of a first reference picture list and a second reference picture list based on one or more reference pictures of the first plurality of reference picture subsets; and

inter-predict the current picture of the video data based on at least one reference picture identified in the first reference picture list or the second reference picture list.

25. The non-transitory computer-readable storage medium of claim 24 , wherein the instructions that cause the processor to code the syntax elements that identify the candidate long-term reference pictures comprise instructions that cause the processor to code the syntax elements in a sequence parameter set.

26. The non-transitory computer-readable storage medium of claim 24 , wherein the instructions that cause the processor to code the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture comprise instructions that cause the processor to code the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture in a slice header of the current picture.

27. The non-transitory computer-readable storage medium of claim 24 , further comprising instructions that cause the processor to:

code syntax elements that indicate long-term reference pictures that belong in the reference picture set, wherein the syntax elements that indicate the long-term reference pictures indicate the long-term reference pictures that are not included in the candidate long-term reference pictures,

wherein the instructions that cause the processor to construct the at least one of the plurality reference picture subsets comprise instructions that cause the at least one processor to construct the at least one of the plurality of reference picture subsets based on the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set and the syntax elements that indicate the long-term reference pictures that belong in the reference picture set.

28. The non-transitory computer-readable storage medium of claim 27 , wherein the instructions that cause the processor to code the syntax elements that indicate which long-term reference pictures belong in the reference picture set comprise instructions that cause the processor to code the syntax elements that indicate which long-term reference pictures belong in the reference picture set in a slice header of the current picture.

29. The non-transitory computer-readable storage medium of claim 24 , wherein the instructions that cause the processor to code syntax elements that identify the candidate long-term reference pictures comprise instructions that cause the processor to:

code a list of picture order count (POC) values for the candidate long-term reference pictures, the computer-readable storage medium further comprising instructions that cause the processor to:

code an index value to the list.

30. The non-transitory computer-readable storage medium of claim 29 , wherein the instructions that cause the processor to code the list of POC values comprise instructions that cause the processor to code the list of POC values in the parameter set, and wherein the instructions that cause the processor to code the index value to the list comprise instructions that cause the processor to code the index value to the list in a slice header of the current picture.

31. The non-transitory computer-readable storage medium of claim 24 , wherein the instructions that cause the processor to code the syntax elements of the parameter set that identify the candidate long-term reference pictures comprise instructions that cause the processor to code the syntax elements in a picture parameter set.

32. A device for coding video data, the device comprising:

means for coding syntax elements of a parameter set that identify candidate long-term reference pictures of the video data, wherein one or more of the candidate long-term reference pictures belong in a reference picture set of a current picture of the video data, and one or more of the candidate long-term reference pictures do not belong in the reference picture set of the current picture, and wherein the reference picture set identifies reference pictures of the video data that can potentially be used for inter-predicting the current picture of the video data and can potentially be used for inter-predicting one or more pictures of the video data following the current picture in decoding order;

means for coding syntax elements that indicate which candidate long-term reference pictures, identified in the parameter set, belong in the reference picture set of the current picture;

means for constructing at least one of a plurality of reference picture subsets based on the indication of which candidate long-term reference pictures belong in the reference picture set of the current picture, wherein the plurality of reference picture subsets form the reference picture set, wherein a first plurality of reference picture subsets identifies reference pictures that can potentially be used for inter-predicting the current picture and pictures following the current picture in decoding order and a second plurality of reference picture subsets identifies reference pictures that cannot be used for inter-predicting the current picture and can potentially be used for inter-predicting pictures following the current picture in decoding order;

means for constructing one or both of a first reference picture list and a second reference picture list based on one or more reference pictures of the first plurality of reference picture subsets; and

means for inter-predicting the current picture of the video data based on at least one reference picture identified in the first reference picture list or the second reference picture list.

33. The device of claim 32 , wherein the means for coding the syntax elements that identify the candidate long-term reference pictures comprises means for coding the syntax elements in a sequence parameter set.

34. The device of claim 32 , wherein the means for coding the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture comprises means for coding the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set of the current picture in a slice header of the current picture.

35. The device of claim 32 , further comprising:

means for coding syntax elements that indicate long-term reference pictures that belong in the reference picture set, wherein the syntax elements that indicate the long-term reference pictures indicate the long-term reference pictures that are not included in the candidate long-term reference pictures,

wherein the means for constructing the at least one of the plurality reference picture subsets comprises means for constructing the at least one of the plurality of reference picture subsets based on the syntax elements that indicate which candidate long-term reference pictures belong in the reference picture set and the syntax elements that indicate the long-term reference pictures that belong in the reference picture set.

36. The device of claim 35 , wherein the means for coding the syntax elements that indicate which long-term reference pictures belong in the reference picture set comprises means for coding the syntax elements that indicate which long-term reference pictures belong in the reference picture set in a slice header of the current picture.

37. The device of claim 32 , wherein the means for coding syntax elements that identify the candidate long-term reference pictures comprises:

means for coding a list of picture order count (POC) values for the candidate long-term reference pictures, the device further comprising:

means for coding an index value to the list.

38. The device of claim 37 , wherein the means for coding the list of POC values comprises means for coding the list of POC values in the parameter set, and wherein the means for coding the index value to the list comprises means for coding the index value to the list in a slice header of the current picture.

39. The device of claim 32 , wherein the means for coding the syntax elements of the parameter set that identify the candidate long-term reference pictures comprises means for coding the syntax elements in a picture parameter set.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 060923/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: VELOS MEDIA, LLC
To: QUALCOMM INCORPORATED
Reel/Frame 057575/0431 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 057554/0540 →
SECOND AMENDED AND RESTATED MEMBER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 2, 2018
From: VELOS MEDIA MANAGEMENT, LLC; VELOS MEDIA, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
Reel/Frame 045806/0030 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2017
From: QUALCOMM INCORPORATED
To: VELOS MEDIA, LLC
Reel/Frame 042758/0171 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2012
From: WANG, YE-KUI; CHEN, YING
To: QUALCOMM INCORPORATED
Reel/Frame 028991/0185 →