Representing motion vectors in an encoded bitstream
A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.
1. One or more non-transitory computer-readable media having stored thereon computer-executable instructions for causing one or more processing units, when programmed thereby, to perform operations comprising:
receiving encoded data, as part of a bitstream, for at least part of a video sequence, the encoded data including:
an indicator, encoded in a header at a first level of bitstream syntax, the indicator indicating (a) whether or not motion vector (“MV”) precision is controlled at a second level of bitstream syntax lower than the first level of bitstream syntax, and (b) if the MV precision is not controlled at the second level of bitstream syntax, whether the MV precision, being controlled at the first level of bitstream syntax, is an integer-sample precision or a fractional-sample precision for the video sequence, wherein the first level of bitstream syntax is sequence level, and wherein the second level of bitstream syntax is frame level or slice level, the indicator having one of three possible values, the three possible values including:
a first possible value indicating that the MV precision is not controlled at the second level of bitstream syntax and that the MV precision, being controlled at the first level of bitstream syntax, is the fractional-sample precision;
a second possible value indicating that the MV precision is not controlled at the second level of bitstream syntax and that the MV precision, being controlled at the first level of bitstream syntax, is the integer-sample precision; and
a third possible value indicating that the MV precision is controlled at the second level of bitstream syntax; and
if the MV precision is controlled at the second level of bitstream syntax, for each of multiple frames or regions of the video sequence, a flag for the frame or region in a header at the second level of bitstream syntax for the frame or region, the flag indicating for the frame or region whether the MV precision is the integer-sample precision or the fractional-sample precision; and
decoding the encoded data, wherein the decoding includes:
determining the indicator using the header at the first level of bitstream syntax, wherein the determining the indicator uses two bits from the header at the first level of bitstream syntax;
based on the indicator, determining whether or not the MV precision is controlled at the second level of bitstream syntax;
if the MV precision is not controlled at the second level of bitstream syntax, for the multiple frames or regions, respectively, determining, based on the indicator, whether the MV precision for the multiple frames or regions, respectively, is the integer-sample precision or the fractional-sample precision; and
if the MV precision is controlled at the second level of bitstream syntax, for each of the multiple frames or regions, determining, based on the flag for the frame or region in the header at the second level of bitstream syntax for the frame or region, whether the MV precision for the frame or region is the integer-sample precision or the fractional-sample precision.
2. The one or more computer-readable media of claim 1 , wherein the second level of bitstream syntax is frame level.
3. The one or more computer-readable media of claim 1 , wherein the header at the first level of bitstream syntax is a sequence header, and wherein the header at the second level of bitstream syntax is a frame header.
4. The one or more computer-readable media of claim 1 , wherein the second level of bitstream syntax is slice level.
5. The one or more computer-readable media of claim 1 , wherein the header at the first level of bitstream syntax is a sequence parameter set, and wherein the header at the second level of bitstream syntax is a slice header.
6. The one or more computer-readable media of claim 1 , wherein the fractional-sample precision is a quarter-sample precision.
7. The one or more computer-readable media of claim 1 , wherein the MV precision indicated by the indicator or the flag is for horizontal components of MV values or vertical components of the MV values, the operations further comprising, during the decoding, resizing at least one of the frames horizontally or vertically.
8. The one or more computer-readable media of claim 7 , wherein the horizontal components of the MV values and the vertical components of the MV values have different MV precisions.
9. The one or more computer-readable media of claim 1 , wherein the decoding further includes, for MV values of a given frame or region among the multiple frames or regions:
if the MV precision for the given frame or region is the integer-sample precision, interpreting the MV values in units of integer samples; and
if the MV precision for the given frame or region is the fractional-sample precision, interpreting the MV values in units of fractional samples.
10. The one or more computer-readable media of claim 1 , wherein, for a given frame or region among the multiple frames or regions, if the flag for the given frame or region is not present in the bitstream, the flag for the given frame or region is inferred to have a value equal to the indicator.
11. The one or more computer-readable media of claim 1 , wherein the determining the indicator includes entropy decoding an entropy-coded two-bit value from the header at the first level of bitstream syntax.
12. One or more non-transitory computer-readable media having stored thereon computer-executable instructions for causing a computer system, when programmed thereby, to perform encoding operations to produce encoded data, as part of a bitstream, for at least part of a video sequence, the encoded data including:
an indicator, encoded in a header at a first level of bitstream syntax, the indicator indicating (a) whether or not motion vector (“MV”) precision is controlled at a second level of bitstream syntax lower than the first level of bitstream syntax, and (b) if the MV precision is not controlled at the second level of bitstream syntax, whether the MV precision, being controlled at the first level of bitstream syntax, is an integer-sample precision or a fractional-sample precision for the video sequence, wherein the first level of bitstream syntax is sequence level, and wherein the second level of bitstream syntax is frame level or slice level, the indicator having one of three possible values, the three possible values including:
a first possible value indicating that the MV precision is not controlled at the second level of bitstream syntax and that the MV precision, being controlled at the first level of bitstream syntax, is the fractional-sample precision;
a second possible value indicating that the MV precision is not controlled at the second level of bitstream syntax and that the MV precision, being controlled at the first level of bitstream syntax, is the integer-sample precision; and
a third possible value indicating that the MV precision is controlled at the second level of bitstream syntax; and
if the MV precision is controlled at the second level of bitstream syntax, for each of multiple frames or regions of the video sequence, a flag for the frame or region in a header at the second level of bitstream syntax for the frame or region, the flag indicating for the frame or region whether the MV precision is the integer-sample precision or the fractional-sample precision;
wherein the encoded data is produced by encoding of the at least part of the video sequence according to the encoding operations, and wherein the encoding operations include:
encoding the indicator in the header at the first level of bitstream syntax, wherein the encoding the indicator uses two bits in the header at the first level of bitstream syntax; and
if the MV precision is controlled at the second level of bitstream syntax, for each the multiple frames or regions of the video sequence:
determining whether the MV precision for the frame or region is the integer-sample precision or the fractional-sample precision; and
setting the flag for the frame or region in the header at the second level of bitstream syntax for the frame or region.
13. The one or more computer-readable media of claim 12 , wherein the header at the first level of bitstream syntax is a sequence header, and wherein the header at the second level of bitstream syntax is a frame header.
14. The one or more computer-readable media of claim 12 , wherein the header at the first level of bitstream syntax is a sequence parameter set, and wherein the header at the second level of bitstream syntax is a slice header.
15. In a computer system that implements a video encoder, a method comprising:
encoding at least part of a video sequence, thereby producing encoded data, as part of a bitstream, for the at least part of the video sequence, the bitstream having a first level of bitstream syntax and a second level of bitstream syntax lower than the first level of bitstream syntax, wherein the encoding the at least part of the video sequence includes:
encoding an indicator in a header at the first level of bitstream syntax, wherein the encoding the indicator uses two bits in the header at the first level of bitstream syntax, the indicator indicating (a) whether or not motion vector (“MV”) precision is controlled at the second level of bitstream syntax, and (b) if the MV precision is not controlled at the second level of bitstream syntax, whether the MV precision, being controlled at the first level of bitstream syntax, is an integer-sample precision or a fractional-sample precision for the video sequence, wherein the first level of bitstream syntax is sequence level, and wherein the second level of bitstream syntax is frame level or slice level, the indicator having one of three possible values, the three possible values including:
a first possible value indicating that the MV precision is not controlled at the second level of bitstream syntax and that the MV precision, being controlled at the first level of bitstream syntax, is the fractional-sample precision;
a second possible value indicating that the MV precision is not controlled at the second level of bitstream syntax and that the MV precision, being controlled at the first level of bitstream syntax, is the integer-sample precision; and
a third possible value indicating that the MV precision is controlled at the second level of bitstream syntax; and
if the MV precision is controlled at the second level of bitstream syntax, for each multiple frames or regions of the video sequence:
determining whether the MV precision for the frame or region is the integer-sample precision or the fractional-sample precision; and
setting a flag for the frame or region in a header at the second level of bitstream syntax for the frame or region, the flag indicating whether the MV precision for the frame or region is the integer-sample precision or the fractional-sample precision; and
outputting the encoded data, as part of the bitstream, the encoded data including:
the indicator, encoded in the header at the first level of bitstream syntax; and
if the MV precision is controlled at the second level of bitstream syntax, for each of the multiple frames or regions, the flag for the frame or region in the header at the second level of bitstream syntax for the frame or region.
16. The method of claim 15 , wherein the encoding the indicator includes entropy coding a two-bit value for the header at the first level of bitstream syntax.
17. The method of claim 15 , wherein the frames have a content type, wherein the MV precision is the integer-sample precision if the content type is a screen capture content type, and wherein the MV precision is the fractional-sample precision if the content type is a camera video content type.