Adjusting quantization/scaling and inverse quantization/scaling when switching color spaces
Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency when switching between color spaces during encoding and decoding. For example, some of the innovations relate to adjustment of quantization or scaling when an encoder switches color spaces between units within a video sequence during encoding. Other innovations relate to adjustment of inverse quantization or scaling when a decoder switches color spaces between units within a video sequence during decoding.
1. A computing device comprising:
one or more buffers configured to store an image or video; and
an image encoder or video encoder configured to perform operations comprising:
encoding units of the image or video to produce encoded data, including, when switching from a first color space to a second color space between two of the units, adjusting final quantization parameter (“QP”) values or intermediate QP values for color components of the second color space according to per component color space adjustment factors, wherein the first color space is RGB and the second color space is YCoCg, and wherein the per component color space adjustment factors adjust the final QP values or intermediate QP values for the color components of the second color space by offsets of −5, −3 and −5 for Y, Co and Cg components, respectively; and
outputting the encoded data as part of a bitstream.
2. The computing device of claim 1 wherein the units are coding units or blocks.
3. The computing device of claim 1 wherein the bitstream includes one or more syntax elements that indicate the per component color space adjustment factors.
4. The computing device of claim 3 wherein the one or more syntax elements are signaled at picture level or slice level, and wherein the one or more syntax elements include a syntax element that indicates (a) an initial quantization parameter value for a first color component of the second color space or (b) an offset for the first color component of the second color space relative to an initial quantization parameter value for the first color space.
5. The computing device of claim 4 wherein the one or more syntax elements further include syntax elements that indicate offsets for second and third color components of the second color space relative to quantization parameter values for second and third color components of the first color space.
6. The computing device of claim 1 wherein the per component color space adjustment factors are derived by rule depending on the second color space without signaling of syntax elements that indicate the per component color space adjustment factors for the color components of the second color space.
7. The computing device of claim 1 wherein the per component color space adjustment factors depend on energy amplification for the respective color components of the second color space in inverse color space conversion operations.
8. The computing device of claim 1 wherein the per component color space adjustment factors compensate for amplification of energy of quantization error when converting from the second color space back to the first color space.
9. The computing device of claim 1 wherein the adjusting includes setting per component quantization parameter values on a unit-by-unit basis.
10. In a computing device with an image decoder or video decoder, a method comprising:
receiving encoded data as part of a bitstream; and
decoding the encoded data to reconstruct units of an image or video, including, when switching to a first color space from a second color space between two of the units, adjusting final quantization parameter (“QP”) values or intermediate QP values for color components of the second color space according to per component color space adjustment factors, wherein the first color space is RGB and the second color space is YCoCg, and wherein the per component color space adjustment factors adjust the final QP values or intermediate QP values for the color components of the second color space by offsets of −5, −3 and −5 for Y, Co and Cg components, respectively.
11. The method of claim 10 wherein the units are coding units or blocks.
12. The method of claim 10 wherein the bitstream includes one or more syntax elements that indicate the per component color space adjustment factors.
13. The method of claim 12 wherein the one or more syntax elements are signaled at picture level or slice level, and wherein the one or more syntax elements include a syntax element that indicates (a) an initial quantization parameter value for a first color component of the second color space or (b) an offset for the first color component of the second color space relative to an initial quantization parameter value for the first color space.
14. The method of claim 13 wherein the one or more syntax elements further include syntax elements that indicate offsets for second and third color components of the second color space relative to quantization parameter values for second and third color components of the first color space.
15. The method of claim 10 wherein the per component color space adjustment factors are derived by rule depending on the second color space without signaling of syntax elements that indicate the per component color space adjustment factors for the color components of the second color space.
16. One or more computer-readable media storing computer-executable instructions for causing a computing device, when programmed thereby, to perform operations comprising:
receiving encoded data as part of a bitstream; and
decoding the encoded data to reconstruct units of an image or video, including, when switching to a first color space from a second color space between two of the units, adjusting final quantization parameter (“QP”) values or intermediate QP values for color components of the second color space according to per component color space adjustment factors, wherein the first color space is RGB and the second color space is YCoCg, and wherein the per component color space adjustment factors adjust the final QP values or intermediate QP values for the color components of the second color space by offsets of −5, −3 and −5 for Y, Co and Cg components, respectively.
17. The one or more computer-readable media of claim 16 wherein the bitstream includes one or more syntax elements that indicate the per component color space adjustment factors.
18. The one or more computer-readable media of claim 17 wherein the one or more syntax elements are signaled at picture level or slice level, and wherein the one or more syntax elements include a syntax element that indicates (a) an initial quantization parameter value for a first color component of the second color space or (b) an offset for the first color component of the second color space relative to an initial quantization parameter value for the first color space.
19. The one or more computer-readable media of claim 18 wherein the one or more syntax elements further include syntax elements that indicate offsets for second and third color components of the second color space relative to quantization parameter values for second and third color components of the first color space.
20. The one or more computer-readable media of claim 16 wherein the per component color space adjustment factors are derived by rule depending on the second color space without signaling of syntax elements that indicate the per component color space adjustment factors for the color components of the second color space.