Flexible quantization
A digital media encoder/decoder uses a flexible quantization technique that provides the ability to vary quantization along various dimensions of the encoded digital media data, including spatial, frequency sub bands and color channels. The codec utilizes a signaling scheme to signal various permutations of flexible quantization combinations efficiently for primary usage scenarios. When a choice of quantizer is available, the codec efficiently encodes the current quantizer by defining a subset of quantizers and indexes the current quantizer from the set.
1. One or more non-transitory computer-readable media having stored thereon computer-executable instructions for causing one or more processing units, when programmed thereby, to perform operations comprising:
receiving encoded data in a bitstream, wherein the encoded data includes:
one or more syntax elements that control variation of quantization parameters along a spatial dimension within a frame of pixel values, the pixel values of the frame being organized spatially into multiple areas within the frame, the multiple areas being further organized spatially into groups, the one or more syntax elements that control variation of the quantization parameters along the spatial dimension including at least one syntax element that indicates whether variation of the quantization parameters is possible between the multiple areas within the respective groups;
one or more syntax elements that control variation of the quantization parameters along a color channel dimension, the pixel values of the frame also being organized by a luminance channel and two chrominance channels, the one or more syntax elements that control variation of the quantization parameters along the color channel dimension including a syntax element that indicates whether, for a given group of the groups, the encoded data includes syntax elements that indicate how to vary the quantization parameters for the two chrominance channels, respectively, for the given group; and
one or more syntax elements that control variation of the quantization parameters along a frequency dimension, including a syntax element that indicates whether the quantization parameters vary or do not vary along the frequency dimension; and
decoding the encoded data to reconstruct the frame, wherein the decoding includes:
determining the quantization parameters using the one or more syntax elements that control variation of the quantization parameters along the spatial dimension, the one or more syntax elements that control variation of the quantization parameters along the color channel dimension, and the one or more syntax elements that control variation of the quantization parameters along the frequency dimension;
for blocks of at least some of the multiple areas of the frame, inverse quantizing transform coefficients using the determined quantization parameters; and
for the blocks of at least some of the multiple areas of the frame, performing inverse frequency transform operations on the inverse-quantized transform coefficients.
2. The one or more computer-readable media of claim 1 , wherein the multiple areas are macroblocks, each of the macroblocks having one or more blocks for the luminance channel, one or more blocks for a first chrominance channel of the two chrominance channels, and one or more blocks for a second chrominance channel of the two chrominance channels.
3. The one or more computer-readable media of claim 2 , wherein each of the macroblocks represents a 16×16 unit of the frame for the luminance channel.
4. The one or more computer-readable media of claim 1 , wherein the one or more syntax elements that control variation of the quantization parameters along the frequency dimension further include at least one syntax element that indicates how the quantization parameters vary between bands of frequency coefficients.
5. The one or more computer-readable media of claim 1 , wherein the encoded data further includes the syntax elements that indicate how to vary the quantization parameters for the two chrominance channels, respectively, for the given group.
6. The one or more computer-readable media of claim 1 , wherein the determined quantization parameters include different sets of quantization parameters for at least some different groups among the groups of multiple areas of the frame.
7. The one or more computer-readable media of claim 1 , wherein the determined quantization parameters include different sets of quantization parameters for at least some different areas among the multiple areas of the frame.
8. One or more non-transitory computer-readable media having stored thereon computer-executable instructions for causing one or more processing units, when programmed thereby, to perform operations comprising:
encoding a frame of pixel values, the pixel values of the frame being organized spatially into multiple areas within the frame, the multiple areas being further organized spatially into groups, the pixel values of the frame also being organized by a luminance channel and two chrominance channels, wherein the encoding includes:
for blocks of at least some of the multiple areas of the frame, performing frequency transform operations, thereby producing transform coefficients;
for the blocks of at least some of the multiple areas of the frame, quantizing the transform coefficients; and
setting one or more syntax elements that control variation of quantization parameters along a spatial dimension within the frame, one or more syntax elements that control variation of the quantization parameters along a color channel dimension between the luminance channel and the two chrominance channels, and one or more syntax elements that control variation of the quantization parameters along a frequency dimension; and
outputting encoded data as part of a bitstream, wherein the encoded data includes:
the one or more syntax elements that control variation of the quantization parameters along the spatial dimension, including at least one syntax element that indicates whether variation of the quantization parameters is possible between the multiple areas within the respective groups;
the one or more syntax elements that control variation of the quantization parameters along the color channel dimension, including a syntax element that indicates whether, for a given group of the groups, the encoded data includes syntax elements that indicate how to vary the quantization parameters for the two chrominance channels, respectively, for the given group; and
the one or more syntax elements that control variation of the quantization parameters along the frequency dimension, including a syntax element that indicates whether the quantization parameters vary or do not vary along the frequency dimension.
9. The one or more computer-readable media of claim 8 , wherein the multiple areas are macroblocks, each of the macroblocks having one or more blocks for the luminance channel, one or more blocks for a first chrominance channel of the two chrominance channels, and one or more blocks for a second chrominance channel of the two chrominance channels.
10. The one or more computer-readable media of claim 8 , wherein the one or more syntax elements that control variation of the quantization parameters along the frequency dimension further include at least one syntax element that indicates how the quantization parameters vary between bands of frequency coefficients.
11. The one or more computer-readable media of claim 8 , wherein the encoded data further includes the syntax elements that indicate how to vary the quantization parameters for the two chrominance channels, respectively, for the given group.
12. The one or more computer-readable media of claim 8 , wherein the determined quantization parameters include different sets of quantization parameters for at least some different groups among the groups of multiple areas of the frame.
13. The one or more computer-readable media of claim 8 , wherein the determined quantization parameters include different sets of quantization parameters for at least some different areas among the multiple areas of the frame.