IP Library › Granted Patent US 11,917,169
Granted Patent B2
US 11,917,169 · App. 17/882,359 · Granted Feb 27, 2024

Palette mode for local dual tree

Inventors: Jizheng Xu (San Diego, CA); Li Zhang (San Diego, CA); Ye-kui Wang (San Diego, CA); Kai Zhang (San Diego, CA); Weijia Zhu (San Diego, CA); Yue Wang (Beijing, CN); Yang Wang (Beijing, CN); Hongbin Liu (Beijing, CN)
Assignees: BEIJING BYTEDANCE NEWTORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/186H04N19/132H04N19/159H04N19/176H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,917,169
App. No.
17/882,359
Granted
Feb 27, 2024
Kind
B2
Abstract

Video processing methods, systems and apparatus are described. One example method includes performing a conversion between a video block of a video and a bitstream of the video using a palette mode in which samples of the video block are represented using a palette of representative color values. A size of the palette of the video block is determined based on whether a local dual tree is applied for the conversion.

Claims (55)

1. A method of processing video data, comprising:

determining, for a conversion between a first video block of a video and a bitstream of the video, that a first prediction mode is applied to the first video block;

maintaining a predictor palette table;

constructing, in the first prediction mode, a first palette comprising one or more palette predictors for the first video block based on the predictor palette table; and

performing the conversion based on the first prediction mode,

wherein in the first prediction mode, reconstructed samples of the first video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors derived from the first palette, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a maximum number of entries in the first palette is based on a tree type of the first video block,

wherein the first prediction mode is applied to a second video block of the video, and a second palette for the second video block is constructed based on the predictor palette table, and

wherein in a case that a single tree is applied to the first video block and a local dual tree is applied to the second video block, the maximum number of entries in the second palette is half of the maximum number of entries in the first palette.

2. The method of claim 1 , wherein the predictor palette table is updated based on the first palette.

3. The method of claim 1 , wherein the second video block is a luma block, and the second video block has a tree type not equal to single tree and has a slice type not equal to I slice.

4. The method of claim 1 , wherein the second video block is a luma block, and the second video block is obtained by splitting a luma parent block of a coding tree node, wherein a chroma parent block of the coding tree node is disallowed to be split.

5. The method of claim 4 , wherein the first video block is a luma block, and a palette size of a chroma block corresponding to the first video block is greater than a palette size of the chroma parent block.

6. The method of claim 4 , wherein the second palette has a size greater than a palette size of the chroma parent block.

7. The method of claim 1 , wherein the first prediction mode is applied to a second video block of the video, and a second palette for the second video block is constructed based on the predictor palette table; and

wherein in case that a dual tree is applied to the first video block and a local dual tree is applied to the second video block, the maximum number of entries in the predictor palette table is different for the first video block and the second video block.

8. The method of claim 7 , wherein the first video block is a chroma block,

wherein the second video block is a luma block, and the second video block is obtained by splitting a luma parent block of a coding tree node, wherein a chroma parent block of the coding tree node is disallowed to be split, and

wherein a size of the first palette is greater than a palette size of the chroma parent block.

9. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

10. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a first video block of a video and a bitstream of the video, that a first prediction mode is applied to the first video block;

maintain a predictor palette table;

construct, in the first prediction mode, a first palette comprising one or more palette predictors for the first video block based on the predictor palette table; and

perform the conversion based on the first prediction mode,

wherein in the first prediction mode, reconstructed samples of the first video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors derived from the first palette, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a maximum number of entries in the first palette is based on a tree type of the first video block,

wherein the first prediction mode is applied to a second video block of the video, and a second palette for the second video block is constructed based on the predictor palette table, and

wherein in a case that a single tree is applied to the first video block and a local dual tree is applied to the second video block, the maximum number of entries in the second palette is half of the maximum number of entries in the first palette.

12. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a first video block of a video and a bitstream of the video, that a first prediction mode is applied to the first video block;

maintain a predictor palette table;

construct, in the first prediction mode, a first palette comprising one or more palette predictors for the first video block based on the predictor palette table; and

perform the conversion based on the first prediction mode,

wherein in the first prediction mode, reconstructed samples of the first video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors derived from the first palette, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a maximum number of entries in the first palette is based on a tree type of the first video block,

wherein the first prediction mode is applied to a second video block of the video, and a second palette for the second video block is constructed based on the predictor palette table, and

wherein in a case that a single tree is applied to the first video block and a local dual tree is applied to the second video block, the maximum number of entries in the second palette is half of the maximum number of entries in the first palette.

13. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a first video block of a video, that a first prediction mode is applied to the first video block;

maintaining a predictor palette table;

constructing, in the first prediction mode, a first palette comprising one or more palette predictors for the first video block based on the predictor palette table; and

generating a bitstream of the video based on the first prediction mode,

wherein in the first prediction mode, reconstructed samples of the first video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors derived from the first palette, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a maximum number of entries in the first palette is based on a tree type of the first video block,

wherein the first prediction mode is applied to a second video block of the video, and a second palette for the second video block is constructed based on the predictor palette table, and

wherein in a case that a single tree is applied to the first video block and a local dual tree is applied to the second video block, the maximum number of entries in the second palette is half of the maximum number of entries in the first palette.

14. The apparatus of claim 11 , wherein the second video block is a luma block, and the second video block has a tree type not equal to single tree and has a slice type not equal to I slice.

15. The apparatus of claim 11 , wherein the second video block is a luma block, and the second video block is obtained by splitting a luma parent block of a coding tree node, wherein a chroma parent block of the coding tree node is disallowed to be split.

16. The apparatus of claim 15 , wherein the first video block is a luma block, and a palette size of a chroma block corresponding to the first video block is greater than a palette size of the chroma parent block.

17. The apparatus of claim 15 , wherein the second palette has a size greater than a palette size of the chroma parent block.

18. The non-transitory computer-readable storage medium of claim 12 , wherein the predictor palette table is updated based on the first palette.

19. The non-transitory computer-readable storage medium of claim 12 , wherein the second video block is a luma block, and the second video block has a tree type not equal to single tree and has a slice type not equal to I slice.

20. The non-transitory computer-readable recording medium of claim 13 , wherein the predictor palette table is updated based on the first palette.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: LIU, HONGBIN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062606/0681 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062606/0692 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062606/0783 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2023
From: XU, JIZHENG; ZHANG, LI; WANG, YE-KUI; ZHANG, KAI; ZHU, WEIJIA
To: BYTEDANCE INC.
Reel/Frame 062586/0507 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2023
From: WANG, YANG
To: BEIJING OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062586/0578 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2023
From: BEIJING OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062586/0710 →
Priority Claims (2)
WO PCT/CN2020/074316 · Feb 5, 2020 · international
WO PCT/CN2020/091661 · May 21, 2020 · international
Continuity (2)
Continuation PCTCN2021075408 · Feb 5, 2021
Related Publication 20220394282A1 · Dec 8, 2022
Cited By (2)
US 12,206,850 US 12,464,142