IP Library Granted Patent US 11,184,637
Granted Patent B2
US 11,184,637 · App. 16/850,847 · Granted Nov 23, 2021

Encoding/decoding with flags to indicate switching of color spaces, color sampling rates and/or bit depths

Inventors: Bin Li (Beijing, CN); Jizheng Xu (Beijing, CN); Feng Wu (Beijing, CN)
Assignee: Microsoft Technology Licensing, LLC
H04N19/59H04N19/117H04N19/13H04N19/132H04N19/157H04N19/176H04N19/186H04N19/587H04N19/82H04N19/88H04N19/172H04N19/61H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,184,637
App. No.
16/850,847
Granted
Nov 23, 2021
Kind
B2
Abstract

Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding/decoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding/decoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding/decoding that includes adaptive switching of bit depths between units within a video sequence.

Claims (43)

1. A computer system comprising one or more processors and memory, wherein the computer system implements a video encoder configured to perform operations comprising:

encoding video in a sequence, including:

switching color spaces, color sampling rates and/or bit depths spatially and/or temporally between at least some units of the video within the sequence during the encoding, the color spaces including an RGB-type color space and a YCoCg color space;

for a given unit of the units of the video, determining a prediction mode of the given unit;

determining whether or not a condition is satisfied, the condition depending on one or more of the prediction mode of the given unit and whether the given unit has residual values;

based at least in part on the condition being satisfied, setting a flag value for the given unit, the flag value indicating a selection between the RGB-type color space and the YCoCg color space for the given unit;

entropy coding the flag value using context-adaptive binary arithmetic coding; and

selectively performing deblock filtering of previously reconstructed content according to one or more rules, including adjusting strength of the deblock filtering depending on whether primary components of two adjacent blocks have non-zero residual values; and

outputting encoded data in a bitstream, the encoded data including one or more signals indicating how the color spaces, the color sampling rates and/or the bit depths switch between the at least some units of the video within the sequence, wherein the one or more signals include the flag value for the given unit as part of a syntax structure for the given unit when the prediction mode of the given unit is intra or when the prediction mode of the given unit is inter and the given unit has residual values.

2. The computer system of claim 1 , wherein the encoding further includes selecting between:

for lossy coding, using color space conversion operations to switch between the RGB-type color space and the YCoCg color space; and

for lossless coding, using invertible color space conversion operations to switch between the RGB-type color space and the YCoCg color space.

3. The computer system of claim 1 , wherein the units of the video are coding units of a given picture of the sequence.

4. The computer system of claim 1 , wherein different color components of the given unit have different bit depths.

5. The computer system of claim 1 , wherein the switching includes performing color space conversion operations between the RGB-type color space and the YCoCg color space for the given unit.

6. The computer system of claim 5 , wherein the switching further includes performing right shift operations on at least some results of the color space conversion operations.

7. The computer system of claim 5 , wherein the encoding further includes:

performing prediction operations for the given unit.

8. The computer system of claim 1 , wherein the one or more signals also include the flag value as part of the syntax structure for the given unit when the prediction mode of the given unit is intra block copy prediction and the given unit has residual values.

9. A computer system comprising one or more processors and memory, wherein the computer system implements a video decoder system comprising:

a buffer configured to receive encoded data in a bitstream, the encoded data including one or more signals indicating how color spaces, color sampling rates and/or bit depths switch between at least some units of video within a sequence, the color spaces including an RGB-type color space and a YCoCg color space, wherein the one or more signals include a flag value for a given unit of the units of the video as part of a syntax structure for the given unit when a prediction mode of the given unit is intra or when the prediction mode of the given unit is inter and the given unit has residual values, the flag value having been entropy coded using context-adaptive binary arithmetic coding, and wherein the flag value indicates a selection between the RGB-type color space and the YCoCg color space for the given unit; and

a video decoder configured to decode the encoded data by performing operations that include:

for the given unit, determining the prediction mode of the given unit;

determining whether or not a condition is satisfied, the condition depending on one or more of the prediction mode of the given unit and whether the given unit has residual values;

based at least in part on the condition being satisfied, parsing and entropy decoding the flag value;

switching the color spaces, the color sampling rates and/or the bit depths spatially and/or temporally between the at least some units of the video within the sequence during the decoding; and

selectively performing deblock filtering of previously reconstructed content according to one or more rules, including adjusting strength of the deblock filtering depending on whether primary components of two adjacent blocks have non-zero residual values.

10. The computer system of claim 9 , wherein the units of the video are coding units of a given picture of the sequence.

11. The computer system of claim 9 , wherein different color components of the given unit have different bit depths.

12. The computer system of claim 9 , wherein the switching includes performing color space conversion operations between the YCoCg color space and the RGB-type color space for the given unit.

13. The computer system of claim 12 , wherein the switching further includes performing left shift operations on at least some results of the color space conversion operations.

14. The computer system of claim 9 , wherein the one or more signals also include the flag value as part of the syntax structure for the given unit when the prediction mode of the given unit is intra block copy prediction and the given unit has residual values.

15. One or more non-transitory computer-readable media having stored thereon encoded data in a bitstream, the encoded data including one or more signals indicating how color spaces, color sampling rates and/or bit depths switch between at least some units of video within a sequence, the color spaces including an RGB-type color space and a YCoCg color space, wherein the one or more signals include a flag value for a given unit of the units of the video as part of a syntax structure for the given unit when a prediction mode of the given unit is intra or when the prediction mode of the given unit is inter and the given unit has residual values, the flag value having been entropy coded using context-adaptive binary arithmetic coding, and wherein the flag value indicates a selection between the RGB-type color space and the YCoCg color space for the given unit, the encoded data being organized to facilitate decoding by operations that include:

for the given unit, determining the prediction mode of the given unit;

determining whether or not a condition is satisfied, the condition depending on one or more of the prediction mode of the given unit and whether the given unit has residual values;

based at least in part on the condition being satisfied, parsing and entropy decoding the flag value;

switching the color spaces, the color sampling rates and/or the bit depths spatially and/or temporally between the at least some units of the video within the sequence during the decoding; and

selectively performing deblock filtering of previously reconstructed content according to one or more rules, including adjusting strength of the deblock filtering depending on whether primary components of two adjacent blocks have non-zero residual values.

16. The one or more computer-readable media of claim 15 , wherein the units of the video are coding units of a given picture of the sequence.

17. The one or more computer-readable media of claim 15 , wherein different color components of the given unit have different bit depths.

18. The one or more computer-readable media of claim 15 , wherein the switching includes performing color space conversion operations between the YCoCg color space and the RGB-type color space for the given unit.

19. The one or more computer-readable media of claim 18 , wherein the switching further includes performing left shift operations on at least some results of the color space conversion operations.

20. The one or more computer-readable media of claim 15 , wherein the one or more signals also include the flag value as part of the syntax structure for the given unit when the prediction mode of the given unit is intra block copy prediction and the given unit has residual values.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2020
From: LI, BIN; XU, JIZHENG; WU, FENG
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 053112/0927 →
Continuity (3)
Continuation 16126325 · Sep 10, 2018
Continuation 15029242
Related Publication 20200244991A1 · Jul 30, 2020
Cited By (5)
US 12,238,314 US 12,284,374 US 12,301,793 US 12,389,022 US 12,568,201