IP Library › Granted Patent US 9,628,792
Granted Patent B2
US 9,628,792 · App. 14/330,985 · Granted Apr 18, 2017

Cross-layer parallel processing and offset delay parameters for video coding

Inventors: Krishnakanth Rapaka (San Diego, CA); Ye-Kui Wang (San Diego, CA); Adarsh Krishnan Ramasubramonian (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/00569H04N19/105H04N19/136H04N19/176H04N19/187H04N19/33H04N19/436H04N19/70H04N19/167H04N19/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,628,792
App. No.
14/330,985
Granted
Apr 18, 2017
Kind
B2
Abstract

In an example, a method of coding video data includes coding data of a video parameter set (VPS) of a multi-layer bitstream, including at least one of data that indicates whether any layers of the multi-layer bitstream have an inter-layer prediction restriction or data that indicates whether tile boundaries are aligned between at least two of the layers of the multi-layer bitstream, and coding the multi-layer bitstream in accordance with the data of the VPS.

Claims (52)

1. A method of decoding video data, the method comprising:

decoding, from a video parameter set (VPS) of a multi-layer bitstream, at least one of:

an ilp_restricted_ref_layers_flag syntax element that indicates whether at least one restriction on inter-layer prediction applies for at least one direct reference layer of one or more layers of the multi-layer bitstream, the at least one restriction on inter-layer prediction comprising at least one of:

a min_spatial_segment_offset_plus1[i][j] syntax element that indicates a spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding a picture with a layer index i, by the min_spatial_segment_offset_plus1[i][j] syntax element itself or together with a min_horizontal_ctu_offset_plus1[i][j] syntax, or

the min_horizontal_ctu_offset_plus1[i][j] syntax element that indicates the spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding of the picture with the layer index i, together with the min_spatial_segment_offset_plus1[i][j] syntax element; or

a tile_boundaries_aligned_flag syntax element that indicates that when any two samples of a picture of a layer belong to one tile, then collocated samples, if present, in another picture belong to one tile, or that when any two samples of a picture of a layer belong to different tiles, then collocated samples, if present, in another picture belong to different tiles; and

decoding the multi-layer bitstream in accordance with at least one of the min_spatial_segment_offset_plus1[i][j] syntax element decoded from the VPS or the tile_boundaries_aligned_flag syntax element decoded from the VPS.

2. The method of claim 1 , further comprising, when at least one layer has at least one inter-layer restriction, recursively determining whether each layer of the multi-layer bitstream has an associated inter-layer restriction.

3. A method of encoding video data, the method comprising:

encoding, in a video parameter set (VPS) of a multi-layer bitstream, at least one of:

an ilp_restricted_ref_layers_flag syntax element that indicates whether at least one restriction on inter-layer prediction applies for at least one direct reference layer of one or more layers of the multi-layer bitstream, the at least one restriction on inter-layer prediction comprising at least one of:

a min_spatial_segment_offset_plus1[i][j] syntax element that indicates a spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding a picture with a layer index i, by the min_spatial_segment_offset_plus1[i][j] syntax element itself or together with a min_horizontal_ctu_offset_plus1[i][j] syntax, or

the min_horizontal_ctu_offset_plus1[i][j] syntax element that indicates the spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding of the picture with the layer index i, together with the min_spatial_segment_offset_plus1[i][j] syntax element; or

a tile_boundaries_aligned_flag_syntax element that indicates that when any two samples of a picture of a layer belong to one tile, then collocated samples, if present, in another picture belong to one tile, or that when any two samples of a picture of a layer belong to different tiles, then collocated samples, if present, in another picture belong to different tiles; and

encoding the multi-layer bitstream in accordance with at least one of the min_spatial_segment_offset_plus1[i][j] syntax element decoded from the VPS or the tile_boundaries_aligned_flag syntax element encoded in the VPS.

4. The method of claim 3 , further comprising, when at least one layer has at least one inter-layer restriction, determining whether each layer of the multi-layer bitstream has an associated inter-layer restriction.

5. An apparatus that performs video coding, the apparatus comprising:

a memory storing video data; and

a video coder configured to:

code data of a video parameter set (VPS) of a multi-layer bitstream, including coding at least one of:

an ilp_restricted_ref_layers_flag syntax element that indicates whether at least one restriction on inter-layer prediction applies for at least one direct reference layer of one or more layers of the multi-layer bitstream, the at least one restriction on inter-layer prediction comprising at least one of:

a min_spatial_segment_offset_plus1[i][j] syntax element that indicates a spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding a picture with a layer index i, by the min_spatial_segment_offset_plus1[i][j] syntax element itself or together with a min_horizontal_ctu_offset_plus1[i][j] syntax, or

the min_horizontal_ctu_offset_plus1[i][j] syntax element that indicates the spatial area, in each picture of the i-th direct reference layer, that is not used for inter-layer prediction for decoding of the picture with the layer index i, together with the min_spatial_segment_offset_plus1[i][j] syntax element; or

a tile_boundaries_aligned_flag syntax element that indicates that when any two samples of a picture of a layer belong to one tile, then collocated samples, if present, in another picture belong to one tile, or that when any two samples of a picture of a layer belong to different tiles, then collocated samples, if present, in another picture belong to different tiles; and

code the multi-layer bitstream in accordance with at least one of the min_spatial_segment_offset_plus1[i][j] syntax element decoded from the VPS or the tile_boundaries_aligned_flag syntax element of the VPS.

6. The apparatus of claim 5 , wherein the video coder is further configured to, when at least one layer has at least one inter-layer restriction, determine whether each layer of the multi-layer bitstream has an associated inter-layer restriction.

7. The apparatus of claim 5 , wherein to code the video data, the video coder is configured to encode the video data, comprising:

determine residual video data for at least one layer of the multi-layer bitstream;

transform the residual data; and

encode data representing the transformed residual data in the multi-layer bitstream.

8. The apparatus of claim 5 , wherein to code the video data, the video coder is configured to decode the video data, comprising:

parse, from the multi-layer bitstream, data representing residual video data for at least one layer of the multi-layer bitstream;

inverse transform the residual data; and

reconstruct the at least one layer of video data based on the inverse transformed residual data.

9. The apparatus of claim 5 , further comprising a display device configured to present the video data.

10. The apparatus of claim 5 , further comprising a wireless modem configured to receive the video data.

11. An apparatus that performs video coding, the apparatus comprising:

means for coding data of a video parameter set (VPS) of a multi-layer bitstream, including at least one of:

an ilp_restricted_ref_layers_flag syntax element that indicates whether at least one restriction on inter-layer prediction applies for at least one direct reference layer of one or more layers of the multi-layer bitstream, the at least one restriction on inter-layer prediction comprising at least one of:

a min_spatial_segment_offset_plus1[i][j] syntax element that indicates a spatial area, in each picture of the i-th direct reference layer, that is not used for inter-layer prediction for decoding a picture with a layer index i, by the min_spatial_segment_offset_plus1[i][j] syntax element itself or together with a min_horizontal_ctu_offset_plus1[i][j] syntax, or

the min_horizontal_ctu_offset_plus1[i][j] syntax element that indicates the spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding of the picture with the layer index i, together with the min_spatial_segment_offset_plus1[i][j] syntax element; or

a tile_boundaries_aligned_flag syntax element that indicates that when any two samples of a picture of a layer belong to one tile, then collocated samples, if present, in another picture belong to one tile, or that when any two samples of a picture of a layer belong to different tiles, then collocated samples, if present, in another picture belong to different tiles; and

means for coding the multi-layer bitstream in accordance with at least one of the min_spatial_segment_offset_plus1[i][j] syntax element decoded from the VPS or the tile_boundaries_aligned_flag syntax element of the VPS.

12. The apparatus of claim 11 , further comprising, when at least one layer has at least one inter-layer restriction, means for determining whether each layer of the multi-layer bitstream has an associated inter-layer restriction.

13. A non-transitory computer-readable medium storing instructions thereon that, when executed, cause a video coder to:

code data of a video parameter set (VPS) of a multi-layer bitstream, including coding at least one of:

an ilp_restricted_ref_layers_flag syntax element that indicates whether at least one restriction on inter-layer prediction applies for at least one direct reference layer of one or more layers of the multi-layer bitstream, the at least one restriction on inter-layer prediction comprising at least one of:

a min_spatial_segment_offset_plus1[i][j] syntax element that indicates a spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding a picture with a layer index i, by the min_spatial_segment_offset_plus1[i][j] syntax element itself or together with a min_horizontal_ctu_offset_plus1[i][j] syntax, or

the min_horizontal_ctu_offset_plus1[i][j] syntax element that indicates the spatial area, in each picture of the j-th direct reference layer, that is not used for inter-layer prediction for decoding of the picture with the layer index i, together with the min_spatial_segment_offset_plus1[i][j] syntax element, or

data a tile_boundaries_aligned_flag syntax element that indicates that when any two samples of a picture of a layer belong to one tile, then collocated samples, if present, in another picture belong to one tile, or that when any two samples of a picture of a layer belong to different tiles, then collocated samples, if present, in another picture belong to different tiles; and

code the multi-layer bitstream in accordance with at least one of the min_spatial_segment_offset_plus1[i][j] syntax element decoded from the VPS or the tile_boundaries_aligned_flag syntax element data of the VPS.

14. The non-transitory computer-readable medium of claim 13 , wherein the instructions cause the video coder to, when at least one layer has at least one inter-layer restriction, determine whether each layer of the multi-layer bitstream has an associated inter-layer restriction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2014
From: RAPAKA, KRISHNAKANTH; WANG, YE-KUI; RAMASUBRAMONIAN, ADARSH KRISHNAN
To: QUALCOMM INCORPORATED
Reel/Frame 033556/0944 →
Continuity (2)
Provisional Application 61846570 · Jul 15, 2013
Related Publication 20150016520A1 · Jan 15, 2015