IP Library Granted Patent US 11,575,939
Granted Patent B2
US 11,575,939 · App. 17/400,320 · Granted Feb 7, 2023

Signaling of syntax elements for joint coding of chrominance residuals

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/70H04N19/132H04N19/17H04N19/176H04N19/186H04N19/30H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,575,939
App. No.
17/400,320
Granted
Feb 7, 2023
Kind
B2
Abstract

Devices, systems and methods related to digital video coding, and specifically, to management of syntax flags with respect chroma formats are described. In one representative aspect, the disclosed technology may be used to provide a method for video decoding. The method includes determining a chroma format associated with a region of a video and determining, based on the chroma format, whether one or more syntax flags applicable to the region of the video are included in a syntax structure of a coded representation of the video. The one or more syntax flags are indicative of a joint chroma residual coding step for representing the region in the coded representation. The method also includes generating one or more decoded video blocks of the region by parsing the coded representation according to a presence or an absence of the one or more syntax flags in the coded representation.

Claims (38)

1. A method of processing video data, comprising:

determining, based on a rule, whether one or more syntax elements applicable to a region of a video are included in one or more syntax structures of a bitstream of the video, wherein the one or more syntax elements are indicative of at least one quantization parameter offset to luma quantization parameter for deriving one or more quantization parameters of one or more chroma components of the region of the video, wherein the one or more syntax elements include a first syntax element used in a first coding tool in which residual samples of multiple chroma components are coded jointly, and the first syntax element indicates the quantization parameter offset to luma quantization parameter used for deriving one quantization parameter of multiple chroma components of the first coding tool; and

performing a conversion between the region of the video and the bitstream based on the determining;

wherein the rule is based on a chroma format of the region of the video,

wherein the rule indicates that the one or more syntax elements are absent in the bitstream in case the chroma format is 4:0:0, wherein the rule further indicates that a first flag indicating whether to apply the first coding tool is conditionally present, and the first flag is absent in case the chroma format is 4:0:0 and when present, the first flag is included in a sequence parameter set, and

wherein the rule further indicates that a second flag indicating whether a single transform block is used to derive the residual samples for all the multiple chroma components is conditionally present and the second flag is absent in case the chroma format is 4:0:0 and when present, the second flag is included in a transform unit syntax structure.

2. The method of claim 1 , wherein the one or more syntax elements include a second syntax element which is indicative of a quantization parameter offset to luma quantization parameter for deriving a quantization parameter of a single chroma component of the region of the video.

3. The method of claim 2 , wherein a third flag indicating whether syntax elements indicative of quantization parameter offsets to luma quantization parameter for deriving quantization parameters of chroma components are present in an associated slice header is conditionally included in a picture parameter set based on the rule, and the third flag is absent in the picture parameter set in case the chroma format is 4:0:0.

4. The method of claim 1 , wherein the rule indicates that the one or more syntax elements are absent in the bitstream in case the chroma format is monochrome.

5. The method of claim 1 , wherein determining the chroma format includes determining whether chroma components are coded separately.

6. The method of claim 5 , wherein the one or more syntax elements are absent in the bitstream in case the chroma components are coded separately.

7. The method of claim 5 , wherein the one or more syntax elements are present in the bitstream in case the chroma components are not coded separately.

8. The method of claim 1 , wherein the region includes a picture, a slice, a video or a tile group.

9. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

10. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, based on a rule, whether one or more syntax elements applicable to a region of a video are included in one or more syntax structures of a bitstream of the video, wherein the one or more syntax elements are indicative of at least one quantization parameter offset to luma quantization parameter for deriving one or more quantization parameters of one or more chroma components of the region of the video, wherein the one or more syntax elements include a first syntax element used in a first coding tool in which residual samples of multiple chroma components are coded jointly, and the first syntax element indicates the quantization parameter offset to luma quantization parameter used for deriving one quantization parameter of multiple chroma components of the first coding tool; and

perform a conversion between the region of the video and the bitstream based on the determining;

wherein the rule is based on a chroma format of the region of the video,

wherein the rule indicates that the one or more syntax elements are absent in the bitstream in case the chroma format is 4:0:0, wherein the rule further indicates that a first flag indicating whether to apply the first coding tool is conditionally present, and the first flag is absent in case the chroma format is 4:0:0 and when present, the first flag is included in a sequence parameter set, and

wherein the rule further indicates that a second flag indicating whether a single transform block is used to derive the residual samples for all the multiple chroma components is conditionally present and the second flag is absent in case the chroma format is 4:0:0 and when present, the second flag is included in a transform unit syntax structure.

12. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, based on a rule, whether one or more syntax elements applicable to a region of a video are included in one or more syntax structures of a bitstream of the video, wherein the one or more syntax elements are indicative of at least one quantization parameter offset to luma quantization parameter for deriving one or more quantization parameters of one or more chroma components of the region of the video, wherein the one or more syntax elements include a first syntax element used in a first coding tool in which residual samples of multiple chroma components are coded jointly, and the first syntax element indicates the quantization parameter offset to luma quantization parameter used for deriving one quantization parameter of multiple chroma components of the first coding tool; and

perform a conversion between the region of the video and the bitstream based on the determining;

wherein the rule is based on a chroma format of the region of the video,

wherein the rule indicates that the one or more syntax elements are absent in the bitstream in case the chroma format is 4:0:0, wherein the rule further indicates that a first flag indicating whether to apply the first coding tool is conditionally present, and the first flag is absent in case the chroma format is 4:0:0 and when present, the first flag is included in a sequence parameter set, and

wherein the rule further indicates that a second flag indicating whether a single transform block is used to derive the residual samples for all the multiple chroma components is conditionally present and the second flag is absent in case the chroma format is 4:0:0 and when present, the second flag is included in a transform unit syntax structure.

13. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, based on a rule, whether one or more syntax elements applicable to a region of a video are included in one or more syntax structures of a bitstream of the video, wherein the one or more syntax elements are indicative of at least one quantization parameter offset to luma quantization parameter for deriving one or more quantization parameters of one or more chroma components of the region of the video, wherein the one or more syntax elements include a first syntax element used in a first coding tool in which residual samples of multiple chroma components are coded jointly, and the first syntax element indicates the quantization parameter offset to luma quantization parameter used for deriving one quantization parameter of multiple chroma components of the first coding tool; and

generating the bitstream based on the determining,

wherein the rule is based on a chroma format of the region of the video,

wherein the rule indicates that the one or more syntax elements are absent in the bitstream in case the chroma format is 4:0:0, wherein the rule further indicates that a first flag indicating whether to apply the first coding tool is conditionally present, and the first flag is absent in case the chroma format is 4:0:0 and when present, the first flag is included in a sequence parameter set, and

wherein the rule further indicates that a second flag indicating whether a single transform block is used to derive the residual samples for all the multiple chroma components is conditionally present and the second flag is absent in case the chroma format is 4:0:0 and when present, the second flag is included in a transform unit syntax structure.

14. The apparatus of claim 11 , wherein the one or more syntax elements include a second syntax element which is indicative of a quantization parameter offset to luma quantization parameter for deriving a quantization parameter of a single chroma component of the region of the video.

15. The apparatus of claim 14 , wherein a third flag indicating whether syntax elements indicative of quantization parameter offsets to luma quantization parameter for deriving quantization parameters of chroma components are present in an associated slice header is conditionally included in a picture parameter set based on the rule, and the third flag is absent in the picture parameter set in case the chroma format is 4:0:0.

16. The apparatus of claim 11 , wherein the rule indicates that the one or more syntax elements are absent in the bitstream in case the chroma format is monochrome.

17. The non-transitory computer-readable storage medium of claim 12 , wherein the one or more syntax elements include a second syntax element which is indicative of a quantization parameter offset to luma quantization parameter for deriving a quantization parameter of a single chroma component of the region of the video.

18. The non-transitory computer-readable storage medium of claim 17 , wherein a third flag indicating whether syntax elements indicative of quantization parameter offsets to luma quantization parameter for deriving quantization parameters of chroma components are present in an associated slice header is conditionally included in a picture parameter set based on the rule, and the third flag is absent in the picture parameter set in case the chroma format is 4:0:0.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2021
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 057165/0523 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057165/0561 →
Priority Claims (1)
WO PCT/CN2019/083574 · Apr 20, 2019 · international
Continuity (2)
Continuation PCTCN2020085614 · Apr 20, 2020
Related Publication 20210385498A1 · Dec 9, 2021