IP Library Granted Patent US 9,451,284
Granted Patent B2
US 9,451,284 · App. 13/647,257 · Granted Sep 20, 2016

Efficient signaling of reference picture sets

Inventors: Ye-Kui Wang (San Diego, CA); Ying Chen (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/573H04N19/423H04N19/46H04N19/70H04N19/33H04N19/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,451,284
App. No.
13/647,257
Granted
Sep 20, 2016
Kind
B2
Abstract

A video coder can select which reference pictures should be signaled in a parameter set such as a picture parameter set (PPS) and which reference pictures should be signaled in a slice header such that when a video decoder constructs a reference picture set, the video decoder does not need to reorder the reference picture set to construct an initial reference picture list for a slice of video data.

Claims (97)

1. A method for coding video data, the method comprising:

determining that a reference picture set for a current picture is to be constructed from a first subset of two subsets of reference pictures identified in a parameter set that is signaled either in a same channel as or a different channel from a channel that carries one or more video coding layer (VCL) network abstraction layer (NAL) units associated with the current picture and from a second subset of reference pictures of the two subsets identified in a slice header that is signaled in the same channel as the channel that carries the one or more VCL NAL units associated with the current picture;

determining that the first subset of the two subsets and the second subset of the two subsets are signaled separately based on distances between the current picture and the respective pictures in each of the first subset and the second subset;

determining that a respective distance, in terms of output order, between the current picture and each reference picture of the first subset of reference pictures identified in the slice header is less than or equal to a value, wherein the distance between the current picture and each reference picture in the first subset is determined based on a delta picture order count (POC) value of the current picture and respective delta POC values of each respective reference picture included in the first subset;

determining that a respective distance, in terms of the output order, between the current picture and each reference picture of the second subset of reference pictures identified in the parameter set is greater than the value, wherein the distance between the current picture and each reference picture in the second subset is determined based on the delta POC value of the current picture and respective delta POC values of each respective reference picture included in the second subset; and

constructing the reference picture set according to an order based on the first subset of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

2. The method of claim 1 , further comprising:

constructing an initial reference picture list from the constructed reference picture set.

3. The method of claim 2 , wherein constructing the initial reference picture list comprises constructing the initial reference picture list without reordering the order of the constructed reference picture set.

4. The method of claim 1 , wherein the parameter set comprises a picture parameter set (PPS).

5. The method of claim 1 , further comprising:

coding a syntax element indicating the reference picture set for the current picture is to be constructed from the first subset of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

6. The method of claim 1 , wherein coding comprises decoding, the method further comprising:

receiving the parameter set; and

receiving the slice header.

7. The method of claim 1 , wherein coding comprises encoding, the method further comprising:

generating the parameter set; and

generating the slice header.

8. A device for coding video data, the device comprising:

a memory configured to store at least a portion of the video data; and

a video coder comprising one or more processors configured to:

determine that a reference picture set for a current picture is to be constructed from a first subset of two subsets of reference pictures identified in a parameter set that is signaled either in a same channel as or a different channel from a channel that carries one or more video coding layer (VCL) network abstraction layer (NAL) units associated with the current picture and from a second subset of reference pictures of the two subsets identified in a slice header that is signaled in the same channel as the channel that carries the one or more VCL NAL units associated with the current picture,

determine that the first subset of the two subsets and the second subset of the two subsets are signaled separately based on distances between the current picture and the respective pictures in each of the first subset and the second subset,

determine that a respective distance, in terms of output order, between the current picture and each reference picture of the first subset of reference pictures identified in the slice header is less than or equal to a value, wherein the distance between the current picture and each reference picture in the first subset is determined based on a delta picture order count (POC) value of the current picture and respective delta POC values of each respective reference picture included in the first subset,

determine that a respective distance, in terms of the output order, between the current picture and each reference picture of the second subset of reference pictures identified in the parameter set is greater than the value, wherein the distance between the current picture and each reference picture in the second subset is determined based on the delta POC value of the current picture and respective delta POC values of each respective reference picture included in the second subset, and

construct the reference picture set according to an order based on the first subset of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

9. The device of claim 8 , wherein the one or more processors of the video coder are further configured to construct an initial reference picture list from the constructed reference picture set.

10. The device of claim 9 , wherein, to construct the initial reference picture list, the one or more processors of the video coder are configured to construct the initial reference picture list without reordering the order of the constructed reference picture set.

11. The device of claim 8 , wherein the parameter set comprises a picture parameter set (PPS).

12. The device of claim 8 , wherein the one or more processors of the video coder are further configured to code a syntax element indicating the reference picture set for the current picture is to be constructed from the first subset of reference pictures identified in the parameter set and the second set of reference pictures identified in the slice header.

13. The device of claim 8 , wherein the video coder comprises a video decoder, and wherein the one or more processors of the video decoder are configured to receive the parameter set and receive the slice header.

14. The device of claim 8 , wherein the video coder comprises a video encoder, and wherein the one or more processors of the video encoder are configured to generate the parameter set and generate the slice header.

15. The device of claim 8 , wherein the device comprises at least one of:

an integrated circuit;

a microprocessor;

one or more digital signal processors (DSPs);

one or more field programmable gate arrays (FPGAs);

a desktop computer;

a laptop computer;

a tablet computer;

a phone;

a television;

a camera;

a display device;

a digital media player;

a video game console;

a video game device;

a video streaming device; or

a wireless communication device that includes the video coder.

16. A device for video coding, the device comprising:

means for determining that a reference picture set for a current picture is to be constructed from a first subset of two subsets of reference pictures identified in a parameter set that is signaled either in a same channel as or a different channel from a channel that carries one or more video coding layer (VCL) network abstraction layer (NAL) units associated with the current picture and from a second subset of reference pictures of the two subsets identified in a slice header that is signaled in the same channel as the channel that carries the one or more VCL NAL units associated with the current picture;

means for determining that the first subset of the two subsets and the second subset of the two subsets are signaled separately based on distances between the current picture and the respective pictures in each of the first subset and the second subset;

means for determining that a respective distance, in terms of output order, between the current picture and each reference picture of the first subset of reference pictures identified in the slice header is less than or equal to a value, wherein the distance between the current picture and each reference picture in the first subset is determined based on a delta picture order count (POC) value of the current picture and respective delta POC values of each respective reference picture included in the first subset;

means for determining that a respective distance, in terms of the output order, between the current picture and each reference picture of the reference pictures identified in the parameter set is greater than the value, wherein the distance between the current picture and each reference picture in the second subset is determined based on the delta POC value of the current picture and respective delta POC values of each respective reference picture included in the second subset; and

means for constructing the reference picture set according to an order based on the first subset of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

17. The device of claim 16 , further comprising:

means for constructing an initial reference picture list from the constructed reference picture set.

18. The device of claim 17 , wherein the means for constructing the initial reference picture list comprises means for constructing the initial reference picture list without reordering the order of the constructed reference picture set.

19. The device of claim 16 , wherein the parameter set comprises a picture parameter set (PPS).

20. The device of claim 16 , further comprising:

means for coding a syntax element indicating the reference picture set for the current picture is to be constructed from the first subset of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

21. The device of claim 16 , further comprising:

means for decoding encoded video data; and

means for receiving the parameter set and means for receiving the slice header.

22. The device of claim 16 , further comprising:

means for encoding video data; and

means for generating the parameter set and means for generating the slice header.

23. A non-transitory computer readable storage medium storing instruction, that when executed by one or more processors, cause the one or more processors to:

determine that a reference picture set for a current picture is to be constructed from a first subset of two subsets of reference pictures identified in a parameter set that is signaled either in a same channel as or a different channel from a channel that carries one or more video coding layer (VCL) network abstraction layer (NAL) units associated with the current picture and from a second subset of reference pictures of the two subsets identified in a slice header that is signaled in the same channel as the channel that carries the one or more VCL NAL units associated with the current picture;

determine that the first subset of the two subsets and the second subset of the two subsets are signaled separately based on distances between the current picture and the respective pictures in each of the first subset and the second subset;

determine that a respective distance, in terms of output order, between the current picture and each reference picture of the first subset of reference pictures identified in the slice header is less than or equal to a value, wherein the distance between the current picture and each reference picture in the first subset is determined based on a delta picture order count (POC) value of the current picture and respective delta POC values of each respective reference picture included in the first subset;

determine that a respective distance, in terms of the output order, between the current picture and each reference picture of the second subset of reference pictures identified in the parameter set is greater than the value, wherein the distance between the current picture and each reference picture in the second subset is determined based on the delta POC value of the current picture and respective delta POC values of each respective reference picture included in the second subset; and

construct the reference picture set according to an order based on the first subset of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

24. The non-transitory computer readable storage medium of claim 23 , further storing instructions, that when executed by the one or more processors, cause the one or more processors to:

construct an initial reference picture list from the constructed reference picture set.

25. The non-transitory computer readable storage medium of claim 24 further storing instructions, that when executed by the one or more processors, cause the one or more processors to construct the initial reference picture list by constructing the initial reference picture list without reordering the order of the constructed reference picture set.

26. The non-transitory computer readable storage medium of claim 24 , wherein the parameter set comprises a picture parameter set (PPS).

27. The non-transitory computer readable storage medium of claim 24 , storing further instructions, that when executed by the one or more processors, cause the one or more processors to code a syntax element indicating the reference picture set for the current picture is to be constructed from the first set of reference pictures identified in the parameter set and the second subset of reference pictures identified in the slice header.

28. The non-transitory computer readable storage medium of claim 24 , wherein the one or more processors comprise a video decoder and wherein the non-transitory computer readable storage medium store further instructions that, when executed by the one or more processors, cause the one or more processors to receive the parameter set and receive the slice header.

29. The non-transitory computer readable storage medium of claim 24 , wherein the one or more processors comprise a video decoder and wherein the non-transitory computer readable storage medium store further instructions that, when executed by the one or more processors, cause the one or more processors to generate the parameter set and generate the slice header.

30. The device of claim 8 ,

wherein the video coder comprises a video decoder,

wherein the device is a wireless communication device, and

wherein the device further comprises a receiver configured to:

receive the parameter set;

receive the slice header; and

receive the one or more VCL NAL units associated with the current picture.

31. The device of claim 30 ,

wherein the wireless communication device is a cellular telephone, and

wherein the receiver is further configured to demodulate a signal comprising the video data that includes the parameter set, the slice header, and the one or more NAL units according to a wireless communication standard.

32. The device of claim 16 , wherein the device is a wireless communication device, the device further comprising:

means for decoding video data;

means for receiving the parameter set;

means for receiving the slice header; and

means for receive the one or more VCL NAL units associated with the current picture.

33. The device of claim 32 , wherein the wireless communication device is a cellular telephone, and wherein the device further comprises:

means for demodulating a signal comprising the video data that includes the parameter set, the slice header, and the one or more NAL units according to a wireless communication standard.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME PREVIOUSLY RECORDED AT REEL: 029679 FRAME: 0212. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 5, 2016
From: WANG, YE-KUI; CHEN, YING
To: QUALCOMM INCORPORATED
Reel/Frame 039591/0331 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2013
From: WANG, YE-KUI; CHEN, YING
To: QUALOCMM INCORPORATED
Reel/Frame 029679/0212 →
Continuity (3)
Provisional Application 61545525 · Oct 10, 2011
Provisional Application 61550276 · Oct 21, 2011
Related Publication 20130089134A1 · Apr 11, 2013