IP Library › Granted Patent US 12,671,829
Granted Patent B2
US 12,671,829 · App. 18/820,067 · Granted Jun 30, 2026

Methods and apparatus of video coding using palette mode

Inventors: Hong-Jheng Jhu (San Diego, CA); Xianglin Wang (San Diego, CA); Xiaoyu Xiu (San Diego, CA); Yi-Wen Chen (San Diego, CA); Tsung-Chuan Ma (San Diego, CA); Wei Chen (San Diego, CA); Bing Yu (Beijing, CN)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/44H04N19/186H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,671,829
App. No.
18/820,067
Filed
Aug 29, 2024
Granted
Jun 30, 2026
Kind
B2
Art Unit
2482
USPC
375/240.25
Abstract

An electronic apparatus performs a method of decoding video data. The method includes: receiving, from the bitstream, a plurality of syntax elements associated with a coding unit, the plurality of syntax elements indicating the coding tree type of the coding unit, and whether the local dual tree mode is enabled for the coding unit; and in accordance with the determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit: disabling the palette mode for the coding unit when the coding unit has the size equal to or less than a predefined threshold. The disabling palette mode for the coding unit may include: disabling the palette mode for both the luma component and chroma component of the coding unit, or disabling the palette mode for only the chroma component of the coding unit.

Claims (63)

1 . A method of encoding video data, comprising:

determining a coding tree type of a coding unit, and whether a local dual tree mode is enabled for the coding unit;

signaling a plurality of syntax elements associated with the coding unit, wherein the plurality of syntax elements are used to derive a plurality of variables which indicate a coding tree type of the coding unit, and whether a local dual tree mode is enabled for the coding unit; and

in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

disabling palette mode for the coding unit when the coding unit has a size equal to or less than a first predefined threshold; and

disabling the palette mode for chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold.

2 . The method according to claim 1 , wherein the disabling palette mode for the coding unit comprises:

disabling the palette mode for both luma component and chroma component of the coding unit.

3 . The method according to claim 1 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining whether a video component of the coding unit is the chroma component or a luma component; and

in accordance with a determination that the video component of the coding unit is the chroma component:

disabling the palette mode for the chroma component of the coding unit.

4 . The method according to claim 1 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining whether a video component of the coding unit is the chroma component or a luma component; and

at least in accordance with a determination that the video component of the coding unit is the luma component:

signaling a palette mode enable flag associated with the luma component of the coding unit;

wherein the coding unit is decoded in accordance with the palette mode enable flag.

5 . The method according to claim 1 , wherein the first predefined threshold is 16.

6 . An electronic apparatus comprising:

one or more processing units;

a memory coupled to the one or more processing units; and

a plurality of programs stored in the memory that, when executed by the one or more processing units, cause the electronic apparatus to perform a method of encoding video data comprising:

determining a coding tree type of a coding unit, and whether a local dual tree mode is enabled for the coding unit;

signaling a plurality of syntax elements associated with the coding unit, wherein the plurality of syntax elements are used to derive a plurality of variables which indicate a coding tree type of the coding unit, and whether a local dual tree mode is enabled for the coding unit; and

in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

disabling palette mode for the coding unit when the coding unit has a size equal to or less than a first predefined threshold; and

disabling the palette mode for only chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold; or

when executed by the one or more processing units, cause the electronic apparatus to perform a method of decoding video data comprising:

receiving a bitstream;

determining, from the bitstream, a plurality of variables associated with a coding unit, wherein the plurality of variables indicates a coding tree type of the coding unit, and whether a local dual tree mode is enabled for the coding unit; and

decoding the coding unit based on the coding tree type of the coding unit and whether the local dual tree mode is enabled for the coding unit,

wherein in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

palette mode is disabled for the coding unit when the coding unit has a size equal to or less than a first predefined threshold; and

the palette mode is disabled for chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold.

7 . The method according to claim 1 , wherein a chroma format of the video data is 4:2:2.

8 . The method according to claim 1 , wherein a chroma format of the video data is 4:4:4.

9 . A method of decoding video data, comprising:

receiving a bitstream;

determining, from the bitstream, a plurality of variables associated with a coding unit, wherein the plurality of variables indicate a coding tree type of the coding unit, and whether a local dual tree mode is enabled for the coding unit; and

decoding the coding unit based on the coding tree type of the coding unit and whether the local dual tree mode is enabled for the coding unit,

wherein in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

palette mode is disabled for the coding unit when the coding unit has a size equal to or less than a first predefined threshold; and

the palette mode is disabled for chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold.

10 . The method according to claim 9 , wherein the disabling palette mode for the coding unit comprises:

disabling the palette mode for both luma component and chroma component of the coding unit.

11 . The method according to claim 9 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining from at least one of the plurality of variables whether a video component of the coding unit is the chroma component or a luma component; and

in accordance with a determination that the video component of the coding unit is the chroma component:

disabling the palette mode for the chroma component of the coding unit.

12 . The method according to claim 9 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining from at least one of the plurality of variables whether a video component of the coding unit is the chroma component or a luma component; and

at least in accordance with a determination that the video component of the coding unit is the luma component:

receiving, from the bitstream, a palette mode enable flag associated with luma component of the coding unit; and

decoding the coding unit in accordance with the palette mode enable flag.

13 . The method according to claim 12 , further comprising:

deriving, from the bitstream, a local dual tree flag; and

updating a palette prediction for the luma component of the coding unit in response to the local dual tree flag being 1.

14 . The method according to claim 9 , wherein the first predefined threshold is 16.

15 . The method according to claim 9 , wherein a chroma format of the video data is 4:2:2.

16 . The method according to claim 9 , wherein a chroma format of the video data is 4:4:4.

17 . A non-transitory computer readable storage medium storing a bitstream generated by the method of encoding video data of claim 1 .

18 . The non-transitory computer readable storage medium according to claim 17 , wherein a chroma format of the video data is 4:2:2.

19 . The non-transitory computer readable storage medium according to claim 17 , wherein a chroma format of the video data is 4:4:4.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2024
From: JHU, HONG-JHENG; WANG, XIANGLIN; XIU, XIAOYU; CHEN, YI-WEN; MA, TSUNG-CHUAN; CHEN, WEI; YU, BING
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 068447/0102 →
Continuity (4)
Continuation 17953233 · Sep 26, 2022
Continuation PCTUS2021024673 · Mar 29, 2021
Provisional Application 63001235 · Mar 27, 2020
Related Publication 20240430465A1 · Dec 26, 2024
References Cited (50)
US 11601652B2 · Xu · 2023 [cited by examiner]
US 12108067B2 · Jhu · 2024 [cited by examiner]
US 20160182913A1 · Joshi et al. · 2016 [cited by applicant]
US 20160234494A1 · Seregin et al. · 2016 [cited by applicant]
US 20160345014A1 · Kim et al. · 2016 [cited by applicant]
US 20170195676A1 · Chuang et al. · 2017 [cited by applicant]
US 20190246122A1 · Zhang et al. · 2019 [cited by applicant]
US 20190281311A1 · Ye et al. · 2019 [cited by applicant]
US 20200092546A1 · Ye · 2020 [cited by examiner]
US 20220182655A1 · Zhu · 2022 [cited by examiner]
US 20220201278A1 · Zhao et al. · 2022 [cited by applicant]
US 20220210437A1 · Xu et al. · 2022 [cited by applicant]
CN 106716999A · 2017 [cited by applicant]
CN 107211138A · 2017 [cited by applicant]
CN 107409215A · 2017 [cited by applicant]
CN 109479137A · 2019 [cited by applicant]
CN 110248196A · 2019 [cited by applicant]
EP 3257246B1 · 2019 [cited by applicant]
EP 4094439A1 · 2022 [cited by applicant]
JP 2019071632A · 2019 [cited by applicant]
JP 2022525430A · 2022 [cited by applicant]
JP 2022546235A · 2022 [cited by applicant]
KR 20170016958A · 2017 [cited by applicant]
KR 20170097655A · 2017 [cited by applicant]
KR 20180122361A · 2018 [cited by applicant]
WO 2016115343A2 · 2016 [cited by applicant]
WO 2017206805A1 · 2017 [cited by applicant]
WO 2020043194A1 · 2020 [cited by applicant]
WO 2020055546A1 · 2020 [cited by applicant]
WO 2021030786A1 · 2021 [cited by applicant]
WO 2021030788A1 · 2021 [cited by applicant]
WO 2021150407A1 · 2021 [cited by applicant]
International Search Report and Written Opinion dated Jul. 12, 2021 received in International Application No. PCT/US2021/024673. [cited by applicant]
Zhao, L. et al., “AHG16: Bugfix for local dual tree”, JVET-P0624, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, pp. 1-6, Oct. 5, 2019. [cited by applicant]
Yang, H. et al., “Non-CE8: Palette mode CU size restriction”, JVET-P0375, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Sep. 2019, pp. 1-5. [cited by applicant]
Bross, B. et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020 , pp. 1-509. [cited by applicant]
First Office Action dated Apr. 28, 2023 received in Chinese Patent Application No. CN 202211549494.X. [cited by applicant]
Jhu, H. et al., “AHG11: Disabling chroma CU palette mode under local dual tree”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 18th Meeting: by teleconference, Apr. 2020, pp. 1-4. [cited by applicant]
Lin, Z. et al., “CE3-2.1.1 and CE3-2.1.2: Removing 2×2, 2×4, and 4×2 chroma CBs”, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and 1S0/IEC Jtc 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 2019, pp. 1-5. [cited by applicant]
Liao, R. et al., “CE2-related: Palette mode for non 4:4:4 color format”, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020, pp. 1-5. [cited by applicant]
Bross, B. et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020 , pp. 1-481. [cited by applicant]
Chen, J. et al., “Algorithm description for Versatile Video Coding and Test Model 8 (VTM 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020, pp. … [cited by applicant]
European Search Report dated Aug. 11, 2023 received in European Patent Application No. EP 21774700.5. [cited by applicant]
Jhu, H. et al., “CE2-related: Palette mode excluding small blocks”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020, pp. 1-2. [cited by applicant]
Office Action dated Aug. 23, 2023 received in European Patent Application No. EP 21774700.5. [cited by applicant]
Zhao, Y. et al., “AHG16: Fix on local dual tree”, JVET-P0063-v2, URL: https://jvet-experts.org/doc_end_user/documents/16_Geneva/wg11/JVET-P0063-v2.zip , Oct. 2019, pp. 1-6. [cited by applicant]
Notice of Allowance dated May 30, 2024 received in U.S. Appl. No. 17/953,233. [cited by applicant]
Office Action dated Feb. 15, 2024 received in U.S. Appl. No. 17/953,233. [cited by applicant]
Office Action dated May 20, 2025 received in Japanese Patent Application No. 2024-118444. [cited by applicant]
Office Action dated May 20, 2025 received in Japanese Patent Application No. 2024-13371. [cited by applicant]