IP Library › Granted Patent US 12,684,147
Granted Patent B2
US 12,684,147 · App. 18/820,207 · Granted Jul 14, 2026

Methods and apparatus of video coding using palette mode

Inventors: Hong-Jheng Jhu (San Diego, CA); Xianglin Wang (San Diego, CA); Xiaoyu Xiu (San Diego, CA); Yi-Wen Chen (San Diego, CA); Tsung-Chuan Ma (San Diego, CA); Wei Chen (San Diego, CA); Bing Yu (Beijing, CN)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/44H04N19/186H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,684,147
App. No.
18/820,207
Filed
Aug 29, 2024
Granted
Jul 14, 2026
Kind
B2
Art Unit
2482
USPC
375/240.25
Abstract

An electronic apparatus performs a method of decoding video data. The method includes: receiving, from the bitstream, a plurality of syntax elements associated with a coding unit, the plurality of syntax elements indicating the coding tree type of the coding unit, and whether the local dual tree mode is enabled for the coding unit; and in accordance with the determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit: disabling the palette mode for the coding unit when the coding unit has the size equal to or less than a predefined threshold. The disabling palette mode for the coding unit may include: disabling the palette mode for both the luma component and chroma component of the coding unit, or disabling the palette mode for only the chroma component of the coding unit.

Claims (62)

1 . A method of decoding video data, comprising:

determining, from a bitstream, a plurality of variables associated with a coding unit, wherein the plurality of variables indicate a coding tree type of the coding unit, and whether a local dual tree mode is enabled for the coding unit; and

in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

disabling palette mode for the coding unit when the coding unit has a size equal to or less than a first predefined threshold, wherein the first predefined threshold is a predefined value; and

disabling the palette mode for a chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold, wherein the second predefined threshold is determined based on a chroma format of the coding unit and the first predefined threshold.

2 . The method according to claim 1 , wherein the disabling palette mode for the coding unit comprises:

disabling the palette mode for both luma component and chroma component of the coding unit.

3 . The method according to claim 1 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining from at least one of the plurality of variables whether a video component of the coding unit is the chroma component or a luma component; and

in accordance with a determination that the video component of the coding unit is the chroma component:

disabling the palette mode for the chroma component of the coding unit.

4 . The method according to claim 1 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining from at least one of the plurality of variables whether a video component of the coding unit is the chroma component or a luma component; and

at least in accordance with a determination that the video component of the coding unit is the luma component:

receiving, from the bitstream, a palette mode enable flag associated with luma component of the coding unit; and

decoding the coding unit in accordance with the palette mode enable flag.

5 . The method according to claim 4 , further comprising:

deriving, from the bitstream, a local dual tree flag; and

updating a palette prediction for the luma component of the coding unit in response to the local dual tree flag being 1.

6 . The method according to claim 1 , wherein the first predefined threshold is 16.

7 . An electronic apparatus comprising:

one or more processing units;

a memory coupled to the one or more processing units; and

a plurality of programs stored in the memory that, when executed by the one or more processing units, cause the electronic apparatus to perform a method of decoding video data comprising:

determining, from a bitstream, a plurality of variables associated with a coding unit, wherein the plurality of variables indicate a coding tree type of the coding unit, and whether a local dual tree mode is enabled for the coding unit; and

in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

disabling palette mode for the coding unit when the coding unit has a size equal to or less than a first predefined threshold, wherein the first predefined threshold is a predefined value; and

disabling the palette mode for a chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold, wherein the second predefined threshold is determined based on a chroma format of the coding unit and the first predefined threshold; or

cause the electronic apparatus to perform a method of encoding video data comprising:

determining a coding tree type of a coding unit, and whether a local dual tree mode is enabled for the coding unit;

signaling a plurality of syntax elements associated with the coding unit, wherein the plurality of syntax elements are used to derive a plurality of variables which indicate a coding tree type of the coding unit, and whether the local dual tree mode is enabled for the coding unit; and

in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

disabling palette mode for the coding unit when the coding unit has a size equal to or less than a first predefined threshold, wherein the first predefined threshold is a predefined value; and

disabling the palette mode for a chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold, wherein the second predefined threshold is determined based on a chroma format of the coding unit and the first predefined threshold.

8 . A non-transitory computer readable storage medium storing a bitstream to be decoded by a method of decoding video data of claim 1 .

9 . The method according to claim 1 , wherein a chroma format of the video data is 4:2:2.

10 . The method according to claim 1 , wherein a chroma format of the video data is 4:4:4.

11 . A method of encoding video data, comprising:

determining a coding tree type of a coding unit, and whether a local dual tree mode is enabled for the coding unit;

signaling a plurality of syntax elements associated with the coding unit, wherein the plurality of syntax elements are used to derive a plurality of variables which indicate a coding tree type of the coding unit, and whether the local dual tree mode is enabled for the coding unit; and

in accordance with a determination that the coding tree type of the coding unit is a single tree, and the local dual tree mode is enabled for the coding unit:

disabling palette mode for the coding unit when the coding unit has a size equal to or less than a first predefined threshold, wherein the first predefined threshold is a predefined value; and

disabling the palette mode for a chroma component of the coding unit when the coding unit has a size greater than a second predefined threshold, wherein the second predefined threshold is determined based on a color format of the coding unit and the first predefined threshold.

12 . The method according to claim 11 , wherein the disabling palette mode for the coding unit comprises:

disabling the palette mode for both luma component and chroma component of the coding unit.

13 . The method according to claim 11 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining whether a video component of the coding unit is the chroma component or a luma component; and

in accordance with a determination that the video component of the coding unit is the chroma component:

disabling the palette mode for the chroma component of the coding unit.

14 . The method according to claim 11 , wherein the disabling the palette mode for the chroma component of the coding unit comprises:

determining whether a video component of the coding unit is the chroma component or a luma component; and

at least in accordance with a determination that the video component of the coding unit is the luma component:

signaling a palette mode enable flag associated with the luma component of the coding unit;

wherein the coding unit is decoded in accordance with the palette mode enable flag.

15 . The method according to claim 14 , further comprising:

signaling syntax elements for deriving a local dual tree flag; and

wherein a palette prediction for the luma component of the coding unit is updated in response to the local dual tree flag derived as 1 according to the syntax elements.

16 . The method according to claim 11 , wherein the first predefined threshold is 16.

17 . The method according to claim 11 , wherein a chroma format of the video data is 4:2:2.

18 . The method according to claim 11 , wherein a chroma format of the video data is 4:4:4.

19 . The non-transitory computer readable storage medium according to claim 8 , wherein a chroma format of the video data is 4:2:2.

20 . The non-transitory computer readable storage medium according to claim 8 , wherein a chroma format of the video data is 4:4:4.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2024
From: JHU, HONG-JHENG; WANG, XIANGLIN; XIU, XIAOYU; CHEN, YI-WEN; MA, TSUNG-CHUAN; CHEN, WEI; YU, BING
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 068448/0951 →
Continuity (4)
Continuation 17953233 · Sep 26, 2022
Continuation PCTUS2021024673 · Mar 29, 2021
Provisional Application 63001235 · Mar 27, 2020
Related Publication 20240430466A1 · Dec 26, 2024
References Cited (55)
US 11601652B2 · Xu · 2023 [cited by examiner]
US 12108067B2 · Jhu · 2024 [cited by examiner]
US 12149746B2 · Jhu · 2024 [cited by examiner]
US 12549774B2 · Jhu · 2026 [cited by examiner]
US 20160182913A1 · Joshi et al. · 2016 [cited by applicant]
US 20160234494A1 · Seregin · 2016 [cited by examiner]
US 20160345014A1 · Kim et al. · 2016 [cited by applicant]
US 20170195676A1 · Chuang · 2017 [cited by examiner]
US 20190246122A1 · Zhang et al. · 2019 [cited by applicant]
US 20190281311A1 · Ye et al. · 2019 [cited by applicant]
US 20200092546A1 · Ye et al. · 2020 [cited by applicant]
US 20220030259A1 · Wang · 2022 [cited by examiner]
US 20220182655A1 · Zhu · 2022 [cited by examiner]
US 20220201278A1 · Zhao et al. · 2022 [cited by applicant]
US 20220210437A1 · Xu et al. · 2022 [cited by applicant]
US 20240430465A1 · Jhu · 2024 [cited by examiner]
CN 106716999A · 2017 [cited by applicant]
CN 107211138A · 2017 [cited by applicant]
CN 107409215A · 2017 [cited by applicant]
CN 109479137A · 2019 [cited by applicant]
CN 110248196A · 2019 [cited by applicant]
CN 113853798A · 2021 [cited by examiner]
EP 3257246B1 · 2019 [cited by applicant]
EP 4094439A1 · 2022 [cited by applicant]
JP 2019071632A · 2019 [cited by applicant]
JP 2022525430A · 2022 [cited by applicant]
JP 2022546235A · 2022 [cited by applicant]
KR 20170016958A · 2017 [cited by applicant]
KR 20170097655A · 2017 [cited by applicant]
KR 20180122361A · 2018 [cited by applicant]
WO 2016115343A2 · 2016 [cited by applicant]
WO 2017206805A1 · 2017 [cited by applicant]
WO 2020043194A1 · 2020 [cited by applicant]
WO 2020055546A1 · 2020 [cited by applicant]
WO 2021030786A1 · 2021 [cited by applicant]
WO 2021030788A1 · 2021 [cited by applicant]
WO 2021150407A1 · 2021 [cited by applicant]
Office Action dated May 20, 2025 received in Japanese Patent Application No. 2024-13371. [cited by applicant]
International Search Report and Written Opinion dated Jul. 12, 2021 received in International Application No. PCT/US2021/024673. [cited by applicant]
Zhao, L. et al., “AHG16: Bugfix for local dual tree”, JVET-P0624, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, pp. 1-6, Oct. 5, 2019. [cited by applicant]
Yang, H. et al., “Non-CE8: Palette mode CU size restriction”, JVET-P0375, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Sep. 2019, pp. 1-5. [cited by applicant]
Bross, B. et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020 , pp. 1-509. [cited by applicant]
First Office Action dated Apr. 28, 2023 received in Chinese Patent Application No. CN 202211549494.X. [cited by applicant]
Jhu, H. et al., “AHG11: Disabling chroma CU palette mode under local dual tree”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 18th Meeting: by teleconference, Apr. 2020, pp. 1-4. [cited by applicant]
Lin, Z. et al., “CE3-2.1.1 and CE3-2.1.2: Removing 2x2, 2x4, and 4x2 chroma CBs”, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 2019, pp. 1-5. [cited by applicant]
Liao, R. et al., “CE2-related: Palette mode for non 4:4:4 color format”, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020, pp. 1-5. [cited by applicant]
Bross, B. et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020 , pp. 1-481. [cited by applicant]
Chen, J. et al., “Algorithm description for Versatile Video Coding and Test Model 8 (VTM 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020, pp. … [cited by applicant]
European Search Report dated Aug. 11, 2023 received in European Patent Application No. EP 21774700.5. [cited by applicant]
Jhu, H. et al., “CE2-related: Palette mode excluding small blocks”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 2020, pp. 1-2. [cited by applicant]
Office Action dated Aug. 23, 2023 received in European Patent Application No. EP 21774700.5. [cited by applicant]
Zhao, Y. et al., “AHG16: Fix on local dual tree”, JVET-P0063-v2, URL: https://jvet-experts.org/doc_end_user/documents/16_Geneva/wg11/JVET-P0063-v2.zip , Oct. 2019, pp. 1-6. [cited by applicant]
Notice of Allowance dated May 30, 2024 received in U.S. Appl. No. 17/953,233. [cited by applicant]
Office Action dated Feb. 15, 2024 received in U.S. Appl. No. 17/953,233. [cited by applicant]
Office Action dated May 20, 2025 received in Japanese Patent Application No. 2024-118444. [cited by applicant]