IP Library › Granted Patent US 12,621,496
Granted Patent B2
US 12,621,496 · App. 18/763,495 · Granted May 5, 2026

Methods and apparatus of video coding in 4:4:4 chroma format

Inventors: Xiaoyu Xiu (Beijing, CN); Yi-Wen Chen (Beijing, CN); Tsung-Chuan Ma (Beijing, CN); Hong-Jheng Jhu (Beijing, CN); Xianglin Wang (Beijing, CN); Bing Yu (Beijing, CN)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/70H04N19/12H04N19/132H04N19/136H04N19/174H04N19/186H04N19/30H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,621,496
App. No.
18/763,495
Granted
May 5, 2026
Kind
B2
Abstract

An electronic apparatus performs a method of decoding video data, including receiving, from bitstream, a first syntax element in a slice header of a slice that indicates whether luma mapping with chroma scaling (LMCS) is applied to a coding unit in the slice; receiving a second syntax element for the coding unit that indicates whether the coding unit has been coded using adaptive color-space transform (ACT); if the second syntax element has a non-zero value, decoding the coding unit by applying inverse ACT to convert luma and chroma residuals of the coding unit from a transformed color space to an original color space of the video data; and if the first syntax element has a non-zero value, decoding the coding unit by performing inverse luma mapping to the luma samples and inverse scaling to the chroma residuals of the coding unit after performing the inverse ACT.

Claims (67)

1 . A method of video encoding, comprising:

determining whether a coding unit has been coded using adaptive color-space transform (ACT), wherein the coding unit is coded by intra-prediction mode;

in accordance with a determination that the coding unit has not been coded using ACT:

determining whether chroma components of the coding unit have been coded using block differential pulse coded modulation (BDPCM); and

decoding chroma components of the coding unit based on the determination of whether the chroma components of the coding unit have been coded using BDPCM; and in accordance with a determination that the coding unit has been coded using ACT:

decoding the coding unit by applying inverse ACT.

2 . The method of claim 1 , wherein the method further comprises:

signaling a first syntax element, wherein the first syntax element indicates whether the coding unit has been coded using ACT;

in accordance with a determination that the first syntax element has a zero value:

signaling one or more syntax elements, wherein the one or more syntax elements indicate whether the chroma components of the coding unit have been coded using BDPCM; and

in accordance with a determination that the first syntax element has a non-zero value:

not signaling the one or more syntax elements,

wherein when the one or more syntax elements are not signaled, default values are assigned to the one or more syntax elements.

3 . The method of claim 2 , wherein the method further comprises:

signaling a second syntax element, wherein the second syntax element indicates whether video data has a predefined chroma format,

wherein the signaling the first syntax element comprises:

in response to the second syntax element indicating that the video data has the predefined chroma format, signaling the first syntax element.

4 . The method of claim 3 , wherein the predefined chroma format is 4:4:4 chroma format.

5 . The method of claim 3 , wherein the first syntax element is signaled only when the video data has the predefined chroma format.

6 . The method of claim 1 , wherein the default values indicate that the chroma components of the coding unit are decoded without using inverse BDPCM.

7 . The method of claim 1 , wherein the coding unit is decoded using inverse BDPCM when the coding unit is coded without applying transforms.

8 . An electronic apparatus comprising:

one or more processing units;

a memory coupled to the one or more processing units; and

a plurality of programs stored in the memory that, when executed by the one or more processing units, cause the electronic apparatus to perform operations comprising:

determining whether a coding unit has been coded using adaptive color-space transform (ACT), wherein the coding unit is coded by intra-prediction mode;

in accordance with a determination that the coding unit has not been coded using ACT:

determining whether chroma components of the coding unit have been coded using block differential pulse coded modulation (BDPCM); and

decoding chroma components of the coding unit based on the determination of whether the chroma components of the coding unit have been coded using BDPCM; and

in accordance with a determination that the coding unit has been coded using ACT:

decoding the coding unit by applying inverse ACT.

9 . The electronic apparatus of claim 8 , wherein the operations further comprise:

signaling a first syntax element, wherein the first syntax element indicates whether the coding unit has been coded using ACT;

in accordance with a determination that the first syntax element has a zero value:

signaling one or more syntax elements, wherein the one or more syntax elements indicate whether the chroma components of the coding unit have been coded using BDPCM; and

in accordance with a determination that the first syntax element has a non-zero value:

not signaling the one or more syntax elements,

wherein when the one or more syntax elements are not signaled, default values are assigned to the one or more syntax elements.

10 . The electronic apparatus of claim 9 , wherein the operations further comprise:

signaling a second syntax element, wherein the second syntax element indicates whether video data has a predefined chroma format,

wherein the signaling the first syntax element comprises:

in response to the second syntax element indicating that the video data has the predefined chroma format, signaling the first syntax element.

11 . The electronic apparatus of claim 10 , wherein the predefined chroma format is 4:4:4 chroma format.

12 . The electronic apparatus of claim 10 , wherein the first syntax element is signaled only when the video data has the predefined chroma format.

13 . The electronic apparatus of claim 9 , wherein the default values indicate that the chroma components of the coding unit are decoded without using inverse BDPCM.

14 . The electronic apparatus of claim 8 , wherein the coding unit is decoded using inverse BDPCM when the coding unit is coded without applying transforms.

15 . A non-transitory computer readable storage medium having stored therein a bitstream comprising video information generated by a method of video encoding, the method comprising:

determining whether a coding unit has been coded using adaptive color-space transform (ACT), wherein the coding unit is coded by intra-prediction mode;

in accordance with a determination that the coding unit has not been coded using ACT:

determining whether chroma components of the coding unit have been coded using block differential pulse coded modulation (BDPCM); and

decoding chroma components of the coding unit based on the determination of whether the chroma components of the coding unit have been coded using BDPCM; and

in accordance with a determination that the coding unit has been coded using ACT:

decoding the coding unit by applying inverse ACT.

16 . The non-transitory computer readable storage medium of claim 15 , wherein the method further comprises:

signaling a first syntax element, wherein the first syntax element indicates whether the coding unit has been coded using ACT;

in accordance with a determination that the first syntax element has a zero value:

signaling one or more syntax elements, wherein the one or more syntax elements indicate whether the chroma components of the coding unit have been coded using BDPCM; and

in accordance with a determination that the first syntax element has a non-zero value:

not signaling the one or more syntax elements,

wherein when the one or more syntax elements are not signaled, default values are assigned to the one or more syntax elements.

17 . The non-transitory computer readable storage medium of claim 16 , wherein the method further comprises:

signaling a second syntax element, wherein the second syntax element indicates whether video data has a predefined chroma format,

wherein the signaling the first syntax element comprises:

in response to the second syntax element indicating that the video data has the predefined chroma format, signaling the first syntax element.

18 . The non-transitory computer readable storage medium of claim 17 , wherein the predefined chroma format is 4:4:4 chroma format.

19 . The non-transitory computer readable storage medium of claim 17 , wherein the first syntax element is signaled only when the video data has the predefined chroma format.

20 . The non-transitory computer readable storage medium of claim 16 , wherein the default values indicate that the chroma components of the coding unit are decoded without using inverse BDPCM.

Continuity (5)
Continuation 17716971 · Apr 8, 2022
Continuation PCTUS2020055264 · Oct 12, 2020
Provisional Application 62923390 · Oct 18, 2019
Provisional Application 62914282 · Oct 11, 2019
Related Publication 20240364931A1 · Oct 31, 2024
References Cited (56)
US 20120213434A1 · Fukuhara et al. · 2012 [cited by applicant]
US 20120301041A1 · Kotaka · 2012 [cited by applicant]
US 20140355689A1 · Tourapis · 2014 [cited by examiner]
US 20150264354A1 · Zhang et al. · 2015 [cited by applicant]
US 20150264374A1 · Xiu et al. · 2015 [cited by applicant]
US 20150358645A1 · Thirumalai et al. · 2015 [cited by applicant]
US 20160227224A1 · Hsieh et al. · 2016 [cited by applicant]
US 20170118473A1 · Thirumalai et al. · 2017 [cited by applicant]
US 20170201769A1 · Chon et al. · 2017 [cited by applicant]
US 20170318301A1 · Li et al. · 2017 [cited by applicant]
US 20170347097A1 · Tourapis · 2017 [cited by examiner]
US 20180262763A1 · Seregin et al. · 2018 [cited by applicant]
US 20180278909A1 · Andrivon et al. · 2018 [cited by applicant]
US 20180343471A1 · Jacobson et al. · 2018 [cited by applicant]
US 20190098308A1 · Li et al. · 2019 [cited by applicant]
US 20200344469A1 · Coban · 2020 [cited by examiner]
US 20200389655A1 · Seregin et al. · 2020 [cited by applicant]
US 20210092415A1 · Keating et al. · 2021 [cited by applicant]
CN 101335897A · 2008 [cited by applicant]
CN 106105202A · 2016 [cited by applicant]
CN 106105203A · 2016 [cited by applicant]
KR 20160132990A · 2016 [cited by applicant]
WO 2019075336A1 · 2019 [cited by applicant]
WO 2019101973A1 · 2019 [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., CN202210734580, First Office Action, Jan. 28, 2023, 7 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., CN202210734580, Second Office Action, Apr. 23, 2023, 8 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., EP2087493 I, European Search Report, Feb. 16, 2023, 6 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., EP2087493 I, Office Action, Feb. 28, 2023, 8 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., EP2087493 I, Supplemental European Search Report, Nov. 16, 2022, 13 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., Examination Report, IN202247026145,Sep. 1, 2022,6pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., International Search Report and Written Opinion—PCT/US2020/055228, Jan. 28, 2021, 9 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., Korean Search Report, KR10-2022-7015932, May 11, 2022, 20 pgs. [cited by applicant]
Beijing Dajia Internet Information Technology Co. Ltd., KR20227015932, Request for the Submission of an Opinion, Dec. 29, 2022, 13 pgs. [cited by applicant]
First Office Action, JP2022-521749, Aug. 30, 2022, 28 pgs. [cited by applicant]
Office Action for Japanese Application 2022-196669 with translation, Sep. 14, 2023, 4 pages. [cited by applicant]
Office Action for JP 2022-173829 mailed Jan. 23, 2024 (8 pages, with English translation). [cited by applicant]
Office Action for JP 2022-173829 mailed Sep. 14, 2023, with translation, 8 pages. [cited by applicant]
Proposed spec changes, 7.2.3.2 Sequence parameter set RBSP syntax, JVET-P0517WD, 8 pgs. [cited by applicant]
Alibaba Cloud Computing Ltd., Sun, et al., “CE8: WD of palette mode with neighboring pixel copy (CE8-1.1)”, Document: JVET-PO0060WD, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16t… [cited by applicant]
Bross, Benjamin, “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (NET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: NET-O2001-vE, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 18 pgs. [cited by applicant]
Bross, et al., “Versatile Video Coding (Draft 6)”, Document: JVET-O2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 459 pgs. [cited by applicant]
Bross, Benjamin, et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019. [cited by applicant]
Bross, Benjamin, et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th meeting: Geneva, CH, Oct. 1-11, 2019, 23 pages. [cited by applicant]
Chairs of JVET; Gary Sullivan; J, “Meeting Report of the 16th Meeting of the Joint Video Experts Team (JVET)” Microsoft Corp., 1 Microsoft Way, Redmond, WA 98052 USA and Institute of Communication Engineering, RWTH Aach… [cited by applicant]
Chairs of Jvet; Gary Sullivan; J, “Meeting Report of the 16th Meeting of the Joint Video Experts Team (JVET)”, JVET-P _Notes_d9, Microsoft Corp., 1 Microsoft Way, Redmond, WA 98052 USA and Institute of Communication Eng… [cited by applicant]
Gordon Clare, et al., “CE8-4.1: BDPCM and Transform skip for Chroma”, NETP0059, Joint Video Experts Team (NET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document saved… [cited by applicant]
Kwai Inc., Xiu, et al., “Support of adaptive color transform for 444 video coding in VVC”, Document: JVET-P0517 r1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva… [cited by applicant]
Kwai Inc., Xiu, et al., “Support of adaptive color transform for 444 video coding in VVC”, Document: JVET-P0517, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, C… [cited by applicant]
Li, Ling, et al., “Interaction between ACT and BDPCM chroma”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 6 pages. [cited by applicant]
Orange Labs; Sony Corporation; G , “CE8-4. I: BDPCM and Transform skip for Chroma”, Document: JVET-P0059-vl, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, O… [cited by applicant]
Sullivan, Gary, et al., “Meeting Report of the 15th Meeting of the Joint Video Experts Team (JVET)”, Joint Video Experts Team (NET) of ITU-T SG 16 W3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O-Notes_d1, 15th Meetin… [cited by applicant]
Sullivan, Gary, “Meeting report of the 16th meeting of the Joint Collaborative Team on Video Coding (JCT-VC), San Jose, US, Jan. 9-17, 2014”, Joint Video Experts Team (NET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG… [cited by applicant]
Sullivan, Gary, “Meeting Report of the 16th Meeting of the Joint Video Experts Team (JVET), Geneva, CH, Oct. 1-11, 2019”, Joint Video Experts Team (NET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: NET-P… [cited by applicant]
Xiu, Xiaoyu, et al., “Support of adaptive color transform for 444 video coding in VVC”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 6 pag… [cited by applicant]
Xiu, Xiaoyu, et al., “Support of adaptive color transform for 444 video coding in VVC”, NET-P0517, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting, Geneva, CH, Oct. 1, 201… [cited by applicant]
Zhu, Weijia, et al., “Alignment of BDPCM for ACT”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/ IEC JTC 1/C 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 8 pages. [cited by applicant]