IP Library › Granted Patent US 9,648,335

Granted Patent B2

US 9,648,335 · App. 14/328,317 · Granted May 9, 2017

Bitstream restrictions on picture partitions across layers

Inventors: Krishnakanth Rapaka (San Diego, CA); Ye-Kui Wang (San Diego, CA); Adarsh Krishnan Ramasubramonian (San Diego, CA); Jianle Chen (San Diego, CA)

Assignee: QUALCOMM Incorporated

H04N19/30 H04N19/597 H04N19/70 H04N19/436

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 9,648,335
App. No.: 14/328,317
Granted: May 9, 2017
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Bitstream restrictions or constraints on the partitioning of pictures across layers of video data are described. In some examples, the number of tiles per picture for each layer of a plurality of layers is constrained based on a maximum number of tiles per picture for the layer. In some examples, the number of tiles per picture for each layer of the plurality of layers is no greater than the maximum number of tiles per picture for the layer. In some examples, a sum of the numbers of tiles per picture for the plurality of layers is no greater than a sum of the maximum numbers of tiles per picture for the plurality of layers. In some examples, a second largest coding unit (LCU) or coding tree block (CTB) size for a second layer is constrained based on, e.g., to be equal to, a first LCU size for a first layer.

Claims (89)

1. A method of decoding video data comprising a plurality of layers, the method comprising:

decoding respective syntax information for each layer of the plurality of layers of the video data, the respective syntax information for each layer of the plurality of layers defining partitioning of a picture in the layer into a number of tiles per picture for the layer, wherein the syntax information is constrained such that the number of tiles per picture for each layer of the plurality of layers is determined based on a maximum number of tiles per picture for the layer, wherein the maximum number of tiles per picture for the layer is determined based on at least one of a spatial resolution, tier information, or level information for the picture in the layer; and

reconstructing the picture in the at least one layer based on the partitioning of the picture into the number of tiles per picture for the layer defined by the decoded syntax information.

2. The method of claim 1 , wherein the respective syntax information for each layer of the plurality of layers comprises respective values of a first syntax element defining a number of tile columns per picture and a second syntax element defining a number of tile rows per picture, and wherein the maximum number of tiles per picture for each layer of the plurality of layers is defined by a maximum number of tile columns per picture and a maximum number of tile rows per picture for each layer of the plurality of layers.

3. The method of claim 1 , wherein the maximum number of tiles per picture for the layer is determined to be a maximum number of tiles per picture for a lowest bitstream level that allows the spatial resolution for the layer.

4. The method of claim 1 , wherein the syntax information is constrained such that the number of tiles per picture for each layer of the plurality of layers is no greater than the maximum number of tiles per picture for the layer.

5. The method of claim 1 , wherein the syntax information is constrained such that a sum of the numbers of tiles per picture for the plurality of layers is no greater than a sum of the maximum numbers of tiles per picture for the plurality of layers.

6. The method of claim 5 , wherein the syntax information is constrained such that the number of tiles per picture for a first layer of the plurality of layers is greater than a maximum number of tiles per picture for the first layer, and the number of tiles per picture for a second layer of the plurality of layers is less than a maximum number of tiles per picture for the second layer.

7. The method of claim 5 , wherein an access unit comprises the respective picture within each of the plurality of layers.

8. The method of claim 5 , wherein the plurality of layers comprise a plurality of layers of a sub-bitstream.

9. The method of claim 5 ,

wherein the respective syntax information for each layer of the plurality of layers comprises respective values of a first syntax element defining a number of tile columns per picture and a second syntax element defining a number of tile rows per picture,

wherein the maximum number of tiles per picture for each layer of the plurality of layers is defined by a maximum number of tile columns per picture and a maximum number of tile rows per picture for each layer of the plurality of layers,

wherein syntax information is constrained such that the number of tile columns per picture for one layer of the plurality of layers is no greater than a sum of the maximum number of tile columns per picture for the layer and a number of remaining tile columns per picture for the layer, and the number of tile rows per picture for the layer is no greater than a sum of the maximum number of tile rows per picture for the layer and a number of remaining of tile rows per picture for the layer, and

wherein the number of remaining tile columns per picture for the layer comprises a sum of differences between the maximum number of tiles columns per picture and the number of tile columns per picture for one or more other layers of the plurality of layers, and the number of remaining tile rows per picture for the layer comprises a sum of differences between the maximum number of tile rows per picture and the number of tile rows per picture for the one or more other layers of the plurality of layers.

10. The method of claim 9 , wherein the one layer of the plurality of layers is a non-base layer.

11. The method of claim 1 , wherein the video data comprises scalable video coding data, and the plurality of layers comprise scalable video coding layers.

12. The method of claim 1 , wherein the video data comprises multi-view video data, and the plurality of layers correspond to a plurality of views of the multi-view video data.

13. The method of claim 1 , wherein decoding the syntax information comprises determining an active parameter set that includes the syntax information.

14. The method of claim 13 , wherein the active parameter set comprises an active picture parameter set.

15. A method of encoding video data comprising a plurality of layers, the method comprising:

partitioning a picture in each layer of the plurality of layers of the video data into a number of tiles per picture for the layer, wherein partitioning the picture into the number of tiles per picture for each of the layers comprises:

determining a maximum number of tiles per picture for the layer based on at least one of a spatial resolution, tier information, or level information for the picture in the layer; and

constraining the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer;

encoding the picture in each layer of the plurality of layers based on the partitioning of the picture into the number of tiles per picture for the layer; and

encoding respective syntax information for each layer of the plurality of layers of the video data, the respective syntax information for each layer of the plurality of layers defining the partitioning of the picture in the layer into the number of tiles per picture for the layer.

16. The method of claim 15 , wherein the respective syntax information for each layer of the plurality of layers comprises respective values of a first syntax element defining a number of tile columns per picture and a second syntax element defining a number of tile rows per picture, and wherein the maximum number of tiles per picture for each layer of the plurality of layers is defined by a maximum number of tile columns per picture and a maximum number of tile rows per picture for each layer of the plurality of layers.

17. The method of claim 15 , wherein determining the maximum number of tiles per picture for the layer comprises determining a maximum number of tiles for a lowest bitstream level that allows the spatial resolution for the layer.

18. The method of claim 15 , wherein constraining the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer comprises constraining the number of tiles per picture for each layer of the plurality of layers to be no greater than the maximum number of tiles per picture for the layer.

19. The method of claim 15 , wherein constraining the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer comprises constraining the number of tiles per picture for each layer of the plurality of layers such that a sum of the numbers of tiles per picture for the plurality of layers is no greater than a sum of the maximum numbers of tiles per picture for the plurality of layers.

20. The method of claim 19 , wherein constraining the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer comprises constraining the number of tiles for each layer of the plurality of layers such that the number of tiles per picture for a first layer of the plurality of layers is greater than a maximum number of tiles per picture for the first layer, and the number of tiles per picture for a second layer of the plurality of layers is less than a maximum number of tiles per picture for the second layer.

21. The method of claim 19 , wherein an access unit comprises the respective picture within each of the plurality of layers.

22. The method of claim 19 , wherein the plurality of layers comprise a plurality of layers of a sub-bitstream.

23. The method of claim 19 ,

wherein constraining the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer comprises constraining the number of tiles per picture for each layer of the plurality of layers such that the number of tile columns per picture for one layer of the plurality of layers is no greater than a sum of the maximum number of tile columns per picture for the layer and a number of remaining tile columns per picture for the layer, and the number of tile rows for the layer is no greater than a sum of the maximum number of tile rows per picture for the layer and a number of remaining of tile rows per picture for the layer, the method further comprising:

determining a sum of differences between the maximum number of tile columns per picture and the number of tile columns per picture for one or more other layers of the plurality of layers as the number of remaining tile columns per picture for the layer; and

determining a sum of differences between the maximum number of tile rows per picture and the number of tile rows per picture for the one or more other layers of the plurality of layers as the number of remaining tile rows per picture for the layer.

24. The method of claim 23 , wherein the one layer of the plurality of layers is a non-base layer.

25. The method of claim 15 , wherein the video data comprises scalable video coding data, and the plurality of layers comprise scalable video coding layers.

26. The method of claim 15 , wherein the video data comprises multi-view video data, and the plurality of layers correspond to a plurality of views of the multi-view video data.

27. The method of claim 15 , wherein encoding the syntax information comprises encoding information that identifies an active parameter set that includes the syntax information.

28. The method of claim 27 , wherein the active parameter set comprises an active picture parameter set.

29. An apparatus comprising a video decoder configured decode video data comprising a plurality of layers, the video decoder comprising:

a memory configured to store an encoded video bitstream that encodes the video data; and

one or more processors configured to:

decode respective syntax information for each layer of the plurality of layers of the video data, the respective syntax information for each layer of the plurality of layers defining partitioning of a picture in the layer into a number of tiles per picture for the layer, wherein the syntax information is constrained such that the number of tiles per picture for each layer of the plurality of layers is determined based on a maximum number of tiles per picture for the layer, wherein the maximum number of tiles per picture for the layer is determined based on at least one of a spatial resolution, tier information, or level information for the picture in the layer; and

reconstruct the picture in the at least one layer based on the partitioning of the picture into the number of tiles per picture for the layer defined by the decoded syntax information.

30. The apparatus of claim 29 , wherein the maximum number of tiles per picture for the layer is determined to be a maximum number of tiles per picture for a lowest bitstream level that allows the spatial resolution for the layer.

31. The apparatus of claim 29 , wherein the syntax information is constrained such that the number of tiles per picture for each layer of the plurality of layers is no greater than the maximum number of tiles per picture for the layer.

32. The apparatus of claim 29 , wherein syntax information is constrained such that a sum of the numbers of tiles per picture for the plurality of layers is no greater than a sum of the maximum numbers of tiles per picture for the plurality of layers.

33. The apparatus of claim 32 ,

34. The apparatus of claim 29 , wherein the apparatus comprises one of:

a microprocessor;

an integrated circuit (IC); and

a wireless communication device comprising at least one of the video decoder.

35. An apparatus comprising a video encoder configured encode video data comprising a plurality of layers, the video encoder comprising:

a memory configured to store an encoded video bitstream that encodes the video data; and

one or more processors configured to:

partition a picture in each layer of the plurality of layers of the video data into a number of tiles per picture for the layer, wherein, to partition the picture into the number of tiles, the one or more processors are configured to:

determine a maximum number of tiles per picture for the layer based on at least one of a spatial resolution, tier information, or level information for the picture in the layer; and

constrain the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer;

encode, into the encoded video bitstream, the picture in each layer of the plurality of layers based on the partitioning of the picture into the number of tiles per picture for the layer; and

encode, into the encoded video bitstream, respective syntax information for each layer of the plurality of layers of the video data, the respective syntax information for each layer of the plurality of layers defining the partitioning of the picture in the layer into the number of tiles per picture for the layer.

36. The apparatus of claim 35 , wherein, to determine the maximum number of tiles per picture for the layer, the one or more processors are configured to determine a maximum number of tiles per picture for a lowest bitstream level that allows the spatial resolution for the layer.

37. The apparatus of claim 35 , wherein the one or more processors are configured to constrain the number of tiles per picture for each layer of the plurality of layers to be no greater than the maximum number of tiles per picture for the layer.

38. The apparatus of claim 35 , wherein the one or more processors are configured to constrain the number of tiles per picture for each layer of the plurality of layers such that a sum of the numbers of tiles per picture for the plurality of layers is no greater than a sum of the maximum numbers of tiles per picture for the plurality of layers.

39. The apparatus of claim 38 ,

wherein constraining the number of tiles per picture for the layer based on the maximum number of tiles per picture for the layer comprises constraining the number of tiles per picture for each layer of the plurality of layers such that the number of tile columns per picture for one layer of the plurality of layers is no greater than a sum of the maximum number of tile columns per picture for the layer and a number of remaining tile columns per picture for the layer, and the number of tile rows per picture for the layer is no greater than a sum of the maximum number of tile rows per picture for the layer and a number of remaining of tile rows per picture for the layer, and

wherein the one or more processors are configured to:

determine a sum of differences between the maximum number of tile columns per picture and the number of tile columns per picture for one or more other layers of the plurality of layers as the number of remaining tile columns per picture for the layer; and

determine a sum of differences between the maximum number of tile rows per picture and the number of tile rows per picture for the one or more other layers of the plurality of layers as the number of remaining tile rows per picture for the layer.

40. The apparatus of claim 35 , wherein the apparatus comprises one of:

a microprocessor;

an integrated circuit (IC); and

a wireless communication device comprising at least one of the video encoder.

41. An apparatus configured to code video data comprising a plurality of layers, the apparatus comprising:

means for coding respective syntax information for each layer of the plurality of layers of the video data, the respective syntax information for each layer of the plurality of layers defining partitioning of a picture in the layer into a number of tiles per picture for the layer, wherein the syntax information is constrained such that the number of tiles per picture for each layer of the plurality of layers is determined based on a maximum number of tiles per picture for the layer, wherein the maximum number of tiles per picture for the layer is determined based on at least one of a spatial resolution, tier information, or level information for the picture in the layer; and

means for processing the picture in the at least one layer based on the partitioning of the picture into the number of tiles per picture for the layer defined by the coded syntax information.

42. A non-transitory computer-readable storage medium having instructions stored thereon that when executed cause one or more processors of a video coder to:

code respective syntax information for each layer of the plurality of layers of the video data, the respective syntax information for each layer of the plurality of layers defining partitioning of a picture in the layer into a number of tiles per picture for the layer, wherein the syntax information is constrained such that the number of tiles per picture for each layer of the plurality of layers is determined based on a maximum number of tiles per picture for the layer, wherein the maximum number of tiles per picture for the layer is determined based on at least one of a spatial resolution, tier information, or level information for the picture in the layer; and

process the picture in the at least one layer based on the partitioning of the picture into the number of tiles per picture for the layer defined by the coded syntax information.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2014

From: RAPAKA, KRISHNAKANTH; WANG, YE-KUI; RAMASUBRAMONIAN, ADARSH KRISHNAN; CHEN, JIANLE

To: QUALCOMM INCORPORATED

Reel/Frame 033556/0850 →

Continuity (2)

Provisional Application 61845928 · Jul 12, 2013

Related Publication 20150016543A1 · Jan 15, 2015