IP Library › Granted Patent US 11,812,064
Granted Patent B2
US 11,812,064 · App. 17/965,325 · Granted Nov 7, 2023

Entropy coding for palette escape symbol

Inventors: Weijia Zhu (San Diego, CA); Jizheng Xu (San Diego, CA); Li Zhang (San Diego, CA); Hsiao Chiang Chuang (San Diego, CA)
Assignee: BYTEDANCE INC.
H04N19/70H04N19/132H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,812,064
App. No.
17/965,325
Granted
Nov 7, 2023
Kind
B2
Abstract

Methods, systems, and devices for performing entropy coding for a palette escape symbol in palette mode coding and decoding are described. An example method for video processing includes performing a conversion between a video having one or more video regions including a current video block and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule that the current video block is coded using a palette mode coding tool, wherein a binarization of an escape symbol for the current video block uses an exponential-Golomb (EG) code of order K, wherein K is a non-negative integer that is unequal to three, and wherein the palette mode coding tool represents the current video block using a palette of representative color values and wherein the escape symbol is used for a sample of the current video block coded without using the representative color values.

Claims (44)

1. A method for processing video data, comprising:

determining, for a conversion between a current video block of a video and a bitstream of the video, that a prediction mode is applied to the current video block, wherein in the prediction mode, reconstructed samples are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream; and

performing the conversion at least based on the prediction mode,

wherein a first syntax element specifying a quantized value of the escaped sample is included in the bitstream, and wherein a binarization of the first syntax element uses an exponential-Golomb (EG) code of order K, K a non-negative integer that is unequal to three, and

wherein the escaped sample is reconstructed based on a level scale chosen from a list of level scales using an index, wherein the list of level scales is {40, 45, 51, 57, 64, 72}, and the index is determined based on qP % 6, wherein % is a mod sign and qP specifies a quantization parameter.

2. The method of claim 1 , wherein K=5.

3. The method of claim 1 , wherein the escaped sample is reconstructed further based on a Clip function and the quantized value of the escaped sample.

4. The method of claim 3 , wherein the reconstructed escape sample is determined based on Clip3(0, (1<<BitDepth)−1, tmpVal),

wherein tmpVal is determined based on m<<(qP/6)+32)>>6, and

wherein m is determined based on the quantized value of the escaped sample and the level scale.

5. The method of claim 4 , wherein the qP is determined based on Max(QpPrimeTsMin, Qp′Y),

wherein QpPrimeTsMin denotes a minimum allowed quantization parameter for transform skip mode, and

wherein Qp′Y denotes a luma quantization parameter.

6. The method of claim 5 , wherein QpPrimeTsMin is defined as 6*n+4, wherein n is a value of a second syntax element included in the bitstream.

7. The method of claim 6 , wherein the second syntax element is included in a sequence level of the bitstream.

8. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.

9. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current video block of a video and a bitstream of the video, that a prediction mode is applied to the current video block, wherein in the prediction mode, reconstructed samples are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream; and

perform the conversion at least based on the prediction mode,

wherein a first syntax element specifying a quantized value of the escaped sample is included in the bitstream, and wherein a binarization of the first syntax element uses an exponential-Golomb (EG) code of order K, K a non-negative integer that is unequal to three, and

wherein the escaped sample is reconstructed based on a level scale chosen from a list of level scales using an index, wherein the list of level scales is {40, 45, 51, 57, 64, 72}, and the index is determined based on qP % 6, wherein % is a mod sign and qP specifies a quantization parameter.

11. The apparatus of claim 10 , wherein K=5.

12. The apparatus of claim 10 , wherein the escaped sample is reconstructed further based on a Clip function and the quantized value of the escaped sample.

13. The apparatus of claim 12 , wherein a reconstructed escape sample is determined based on Clip3(0, (1<<BitDepth)−1, tmpVal),

wherein tmpVal is determined based on m<<(qP/6)+32)>>6, and

wherein m is determined based on the quantized value of the escaped sample and the level scale.

14. The apparatus of claim 13 , wherein the qP is determined based on Max(QpPrimeTsMin, Qp′Y),

wherein QpPrimeTsMin denotes a minimum allowed quantization parameter for transform skip mode, and

wherein Qp′Y denotes a luma quantization parameter.

15. The apparatus of claim 14 , wherein QpPrimeTsMin is defined as 6*n+4, wherein n is a value of a second syntax element included in the bitstream.

16. The apparatus of claim 15 , wherein the second syntax element is included in a sequence level of the bitstream.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current video block of a video and a bitstream of the video, that a prediction mode is applied to the current video block, wherein in the prediction mode, reconstructed samples are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream; and

perform the conversion at least based on the prediction mode,

wherein a first syntax element specifying a quantized value of the escaped sample is included in the bitstream, and wherein a binarization of the first syntax element uses an exponential-Golomb (EG) code of order K, K a non-negative integer that is unequal to three, and

wherein the escaped sample is reconstructed based on a level scale chosen from a list of level scales using an index, wherein the list of level scales is {40, 45, 51, 57, 64, 72}, and the index is determined based on qP % 6, wherein % is a mod sign and qP specifies a quantization parameter.

18. The non-transitory computer-readable storage medium of claim 17 , wherein K=5.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the escaped sample is reconstructed further based on a Clip function and the quantized value of the escaped sample.

20. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current video block of a video, that a prediction mode is applied to the current video block, wherein in the prediction mode, reconstructed samples are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream; and

generating the bitstream at least based on the prediction mode,

wherein a first syntax element specifying a quantized value of the escaped sample is included in the bitstream, and wherein a binarization of the first syntax element uses an exponential-Golomb (EG) code of order K, K a non-negative integer that is unequal to three, and

wherein the escaped sample is reconstructed based on a level scale chosen from a list of level scales using an index, wherein the list of level scales is {40, 45, 51, 57, 64, 72}, and the index is determined based on qP % 6, wherein % is a mod sign and qP specifies a quantization parameter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2023
From: ZHU, WEIJIA; XU, JIZHENG; ZHANG, LI; CHUANG, HSIAO CHIANG
To: BYTEDANCE INC.
Reel/Frame 062804/0034 →
Priority Claims (7)
WO PCT/CN2019/100850 · Aug 15, 2019 · international
WO PCT/CN2019/106700 · Sep 19, 2019 · international
WO PCT/CN2019/107494 · Sep 24, 2019 · international
WO PCT/CN2019/108736 · Sep 27, 2019 · international
WO PCT/CN2019/109793 · Oct 1, 2019 · international
WO PCT/CN2019/113931 · Oct 29, 2019 · international
WO PCT/CN2020/071221 · Jan 9, 2020 · international
Continuity (3)
Continuation 17671422 · Feb 14, 2022
Continuation PCTUS2020046581 · Aug 15, 2020
Related Publication 20230051883A1 · Feb 16, 2023