Tile partitions with sub-tiles in video coding
An encoder, a decoder, and methods for partitioning a picture from a sequence of video pictures into a layout having a plurality of flexible tiles or segments is disclosed. Each tile or segment comprises a single rectangular or square region. The encoder generates a partition structure and encodes the tiles according to the partition structure. The encoder also generates a bitstream comprising a plurality of coded segments and information indicating the partition structure used to partition the picture into the plurality of flexible tiles or segments, and sends the bitstream to the decoder. Upon receipt, the decoder uses the coded segments and information in the bitstream to decode the plurality of coded segments.
1 . A method of decoding a picture, the picture being partitioned into a plurality of picture segments according to a spatial partition structure of the picture, the method comprising:
receiving a bitstream comprising a plurality of coded segments, and parameter set information associated with the plurality of coded segments;
deriving, using the parameter set information:
the spatial partition structure of the picture, wherein:
each of the plurality of picture segments of the spatial partition structure corresponds to one of the plurality of coded segments and comprises one or more subsegments; and
each subsegment comprises a plurality of units with each unit corresponding to a region of the picture;
a subsegment size of a subsegment of the spatial partition structure based upon an integer multiple of a height, width, or area of one of the plurality of units; and
a segment size of a picture segment of the spatial partition structure based upon an integer multiple of a height, width, or area of the respective one or more subsegments; and
decoding the plurality of coded segments received in the bitstream in accordance with the spatial partition structure.
2 . The method of claim 1 , wherein the decoding comprises deriving a quantization parameter value for a second unit of a given one of the plurality of picture segments based on a quantization parameter value for a first unit of the given one of the plurality of picture segments, and independently of any quantization parameter value for units of other ones of the plurality of picture segments.
3 . The method of claim 1 , wherein deriving the spatial partition structure comprises deriving the spatial partition structure responsive to receiving an indication that an encoder sending the bitstream is using flexible partitioning to divide the picture into the plurality of picture segments.
4 . The method of claim 1 , wherein deriving the spatial partition structure comprises deriving the spatial partition structure responsive to receiving an indication that an encoder sending the bitstream is using subsegments.
5 . The method of claim 1 , wherein decoding the plurality of coded segments received in the bitstream comprises decoding each of the plurality of picture segments according to a predefined decoding order, wherein the predefined decoding order is a raster scan order.
6 . The method of claim 1 , wherein deriving a subsegment size comprises deriving a first subsegment size for a first subsegment and a second subsegment size for a second subsegment, wherein the first subsegment size and the second subsegment size are different sizes.
7 . The method of claim 1 , further comprising deriving a spatial size of a segment based on a subsegment size.
8 . The method of claim 1 , wherein an edge of a first of the plurality of picture segments borders edges of two or more adjacent ones of the plurality of picture segments.
9 . The method of claim 1 , wherein the parameter set information indicates a first subsegment size for a first subsegment of the spatial partition structure and a second subsegment size for a second subsegment of the spatial partition structure, and wherein the first subsegment size and the second subsegment size are different sizes.
10 . The method of claim 1 , wherein the parameter set information indicates one of a height, a width, and an area of a subsegment of the spatial partition structure as an integer multiple of a respective one of a height, a width, and an area of a unit of the spatial partition structure.
11 . The method of claim 1 , wherein the parameter set information indicates a single subsegment size for all the subsegments of the spatial partition structure.
12 . The method of claim 1 , wherein each subsegment of the spatial partition structure corresponds to one of a rectangular region of the picture and a square region of the picture.
13 . The method of claim 1 , wherein the spatial partition structure divides the picture into picture segments by arranging corners of each of the plurality of picture segments on a grid that defines, for each of the plurality of picture segments, corresponding values for a start corner and an end corner.
14 . A method of encoding a picture, the method comprising:
defining a spatial partition structure that divides the picture into a plurality of picture segments, wherein:
each of the plurality of picture segments comprises one or more subsegments; and
each subsegment comprises a plurality of units with each unit corresponding to a region of the picture;
encoding the plurality of picture segments in accordance with the spatial partition structure to generate a plurality of coded segments, wherein each of the plurality of coded segments corresponds to one of the plurality of picture segments of the spatial partition structure;
generating a bitstream comprising the plurality of coded segments, and parameter set information associated with the plurality of coded segments, the parameter set information indicating the spatial partition structure that divides the picture into the plurality of picture segments, and a subsegment size of a subsegment of the spatial partition structure based upon an integer multiple of a height, width, or area of one of the plurality of units; and
outputting the bitstream.
15 . The method of claim 14 , wherein generating the bitstream further comprises generating the bitstream to comprise an indication that the spatial partition structure comprises subsegments.
16 . The method of claim 14 , wherein an edge of a first of the plurality of picture segments borders edges of two or more adjacent ones of the plurality of picture segments.
17 . The method of claim 14 , wherein the parameter set information indicates a first subsegment size for a first subsegment of the spatial partition structure and a second subsegment size for a second subsegment of the spatial partition structure, and wherein the first subsegment size and the second subsegment size are different sizes.
18 . The method of claim 14 , wherein the parameter set information indicates one of a height, a width, and an area of a subsegment of the spatial partition structure as an integer multiple of a respective one of a height, a width, and an area of one of the plurality of units of the spatial partition structure.
19 . The method of claim 14 , wherein the parameter set information indicates a single subsegment size for all the subsegments of the spatial partition structure.
20 . The method of claim 14 , wherein each subsegment of the spatial partition structure corresponds to one of a rectangular region of the picture and a square region of the picture.
21 . The method of claim 14 , wherein the spatial partition structure divides the picture by arranging corners of each of the plurality of picture segments on a grid that defines, for each of the plurality of picture segments, corresponding values for a start corner and end corner.
22 . The method of claim 21 , wherein the grid is defined with respect to subsegments of the spatial partition structure.
23 . A decoder for decoding a picture, the picture being partitioned into a plurality of picture segments according to a spatial partition structure of the picture, the decoder comprising:
an input for receiving a bitstream comprising a plurality of coded segments, and parameter set information associated with the plurality of coded segments;
a memory configured to store instructions; and
processing circuitry operatively connected to the memory and the input and configured to execute the instructions stored in the memory, whereby the decoder is configured to:
derive, using the parameter set information:
the spatial partition structure of the picture, wherein:
each of the plurality of picture segments of the spatial partition structure corresponds to one of the plurality of coded segments and comprises one or more subsegments; and
each subsegment comprises a plurality of units with each unit corresponding to a region of the picture;
a subsegment size of a subsegment of the spatial partition structure based upon an integer multiple of a height, width, or area of one of the plurality of units; and
a segment size of a picture segment of the spatial partition structure based upon an integer multiple of a height, width or area of the respective one or more subsegments; and
decode the plurality of coded segments received in the bitstream in accordance with the spatial partition structure.
24 . A non-transitory computer readable medium comprising executable instructions stored thereon that, when executed by a processing circuit in a decoder of a picture, causes the decoder to decode a picture partitioned into a plurality of picture segments according to a spatial partition structure, by:
receiving a bitstream comprising a plurality of coded segments, and parameter set information associated with the plurality of coded segments;
deriving, using the parameter set information:
the spatial partition structure, wherein:
each of the plurality of picture segments corresponds to one of the plurality of coded segments and comprises one or more subsegments; and
each subsegment comprises a plurality of units with each unit corresponding to a region of the picture;
a subsegment size of a subsegment of the spatial partition structure based upon an integer multiple of a height, width, or area of one of the plurality of units; and
a segment size of a picture segment of the spatial partition structure based upon an integer multiple of a height, width, or area of the respective one or more subsegments; and
decoding the plurality of coded segments received in the bitstream in accordance with the spatial partition structure.
25 . An encoder of a picture, the encoder comprising:
a memory configured to store instructions; and
processing circuitry operatively connected to the memory and configured to execute the instructions stored in the memory, whereby the encoder is configured to:
define a spatial partition structure that divides the picture into a plurality of picture segments, wherein each of the plurality of picture segments comprises one or more subsegments, and wherein each subsegment of the spatial partition structure comprises a plurality of units, with each unit corresponding to a region of the picture;
encode the plurality of picture segments in accordance with the spatial partition structure to generate a plurality of coded segments, wherein each of the plurality of coded segments corresponds to one of the plurality of picture segments of the spatial partition structure;
generate a bitstream comprising the plurality of coded segments, and parameter set information associated with the plurality of coded segments, the parameter set information indicating the spatial partition structure used to divide the picture into the plurality of picture segments, and a size of a subsegment of the spatial partition structure based upon an integer multiple of a height, width, or area of one of the plurality of units; and
output the bitstream.
26 . A non-transitory computer readable medium comprising executable instructions stored thereon that, when executed by a processing circuit in an encoder of a picture, causes the encoder to:
define a spatial partition structure that divides the picture into a plurality of picture segments, wherein each of the plurality of picture segments comprises one or more subsegments, and wherein each subsegment of the spatial partition structure comprises a plurality of units, with each unit corresponding to a region of the picture;
encode the plurality of picture segments in accordance with the spatial partition structure to generate a plurality of coded segments, wherein each of the plurality of coded segments corresponds to one of the plurality of picture segments of the spatial partition structure;
generate a bitstream comprising the plurality of coded segments, and parameter set information associated with the plurality of coded segments, the parameter set information indicating the spatial partition structure that divides the picture into the plurality of picture segments, and a size of a subsegment of the spatial partition structure based upon an integer multiple of a height, width, or area of one of the plurality of units; and
output the bitstream.