IP Library › Granted Patent US 12,666,023
Granted Patent B2
US 12,666,023 · App. 18/769,272 · Granted Jun 23, 2026

Methods and apparatus of video coding in 4:4:4 color format

Inventors: Xiaoyu Xiu (Beijing, CN); Yi-Wen Chen (Beijing, CN); Tsung-Chuan Ma (Beijing, CN); Hong-Jheng Jhu (Beijing, CN); Wei Chen (Beijing, CN); Che-Wei Kuo (Beijing, CN); Xianglin Wang (Beijing, CN); Bing Yu (Beijing, CN)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/12H04N19/124H04N19/132H04N19/18H04N19/186H04N19/30H04N19/60H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,666,023
App. No.
18/769,272
Filed
Jul 10, 2024
Granted
Jun 23, 2026
Kind
B2
Examiner
PHAM, NAM D
Art Unit
2487
USPC
375/240.03
Abstract

An electronic apparatus performs a method of coding video data. The method comprises: receiving, from the bitstream, syntax elements associated with a coding unit, wherein the syntax elements include a first coded block flag (CBF) for residual samples of a first chroma component, a second CBF for residual samples of a second chroma component, and a third syntax element indicating whether adaptive color transform (ACT) is applied to the coding unit; determining whether to perform the chroma residual scaling to the residual samples of the chroma components according to the first CBF, the second CBF, and the third syntax element; in accordance with a determination to perform the chroma residual scaling to the residual samples of the first and second chroma components, scaling the residual samples of the at least one of the first and second chroma components based on a corresponding scaling parameter.

Claims (61)

1 . A method of video decoding, comprising:

obtaining, from a bitstream, a plurality of syntax elements associated with a coding unit, wherein the syntax elements include a first coded block flag (CBF) for residual samples of a first chroma component of the coding unit, a second CBF for residual samples of a second chroma component of the coding unit, and a third syntax element indicating whether adaptive color transform (ACT) is applied to the coding unit or not, wherein the coding unit is associated with a partitioning method comprising at least one of quaternary partitioning, horizontal ternary partitioning, vertical ternary partitioning, horizontal binary partitioning or vertical binary partitioning;

determining whether to perform chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element; and

in response to a determination to perform the chroma residual scaling to the residual samples of the at least one of the first or second chroma components,

scaling the residual samples of the at least one of the first or second chroma components based on a corresponding scaling parameter; and

reconstructing chroma samples of the coding unit using chroma residual samples after scaling.

2 . The method according to claim 1 , further comprising:

in response to the third syntax element indicating that the ACT is applied to the coding unit:

applying an inverse ACT to luma and chroma residual samples of the coding unit; and

wherein the determining whether to perform the chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element comprises:

in response to the third syntax element indicating that the ACT is applied to the coding unit, determining to perform the chroma residual scaling to residual samples of the at least one of the first or second chroma components after the inverse ACT has been applied regardless of the first CBF and the second CBF.

3 . The method according to claim 1 , wherein the determining whether to perform the chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element comprises:

in response to the third syntax element indicating that the ACT is not applied to the coding unit:

determining to perform the chroma residual scaling to residual samples of one chroma component of at least one of the first or second chroma components of the coding unit when a corresponding CBF of the first CBF or the second CBF associated with said one chroma component is not zero; and

determining not to perform the chroma residual scaling to the residual samples of said one chroma component of the coding unit when the corresponding CBF associated with said one chroma component is zero.

4 . The method according to claim 2 , further comprising: applying an inverse transform to transform coefficients of the coding unit before applying the inverse ACT.

5 . The method according to claim 4 , further comprising: applying an inverse quantization to quantized transform coefficients of the coding unit before applying the inverse transform.

6 . The method according to claim 1 , wherein:

the first CBF is zero when non-zero chroma quantized transform coefficients are not present in quantized transform coefficients of the first chroma component; and

the second CBF is zero when non-zero chroma quantized transform coefficients are not present in quantized transform coefficients of the second chroma component.

7 . The method according to claim 1 , wherein the corresponding scaling parameter is derived from reconstructed luma samples.

8 . The method according to claim 2 , wherein an input to the inverse ACT is in YCgCo space.

9 . The method according to claim 2 , wherein an output of the inverse ACT is in RGB space.

10 . An electronic apparatus comprising:

one or more processing units;

memory coupled to the one or more processing units; and

a plurality of programs stored in the memory that, when executed by the one or more processing units, cause the electronic apparatus to perform acts comprising:

obtaining, from a bitstream, a plurality of syntax elements associated with a coding unit, wherein the syntax elements include a first coded block flag (CBF) for residual samples of a first chroma component of the coding unit, a second CBF for residual samples of a second chroma component of the coding unit, and a third syntax element indicating whether adaptive color transform (ACT) is applied to the coding unit or not, wherein the coding unit is associated with a partitioning method comprising at least one of quaternary partitioning, horizontal ternary partitioning, vertical ternary partitioning, horizontal binary partitioning or vertical binary partitioning;

determining whether to perform chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element; and

in response to a determination to perform the chroma residual scaling to the residual samples of the at least one of the first or second chroma components,

scaling the residual samples of the at least one of the first or second chroma components based on a corresponding scaling parameter; and

reconstructing chroma samples of the coding unit using chroma residual samples after scaling.

11 . The apparatus according to claim 10 , wherein the acts further comprising:

in response to the third syntax element indicating that the ACT is applied to the coding unit:

applying an inverse ACT to luma and chroma residual samples of the coding unit; and

wherein the determining whether to perform the chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element comprises:

in response to the third syntax element indicating that the ACT is applied to the coding unit, determining to perform the chroma residual scaling to residual samples of the at least one of the first or second chroma components after the inverse ACT has been applied regardless of the first CBF and the second CBF.

12 . The apparatus according to claim 10 , wherein the determining whether to perform the chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element comprises:

in response to the third syntax element indicating that the ACT is not applied to the coding unit:

determining to perform the chroma residual scaling to residual samples of one chroma component of at least one of the first or second chroma components of the coding unit when a corresponding CBF of the first CBF or the second CBF associated with said one chroma component is not zero; and

determining not to perform the chroma residual scaling to the residual samples of said one chroma component of the coding unit when the corresponding CBF associated with said one chroma component is zero.

13 . The apparatus according to claim 11 , wherein the acts further comprising: applying an inverse transform to transform coefficients of the coding unit before applying the inverse ACT.

14 . The apparatus according to claim 13 , further comprising: applying an inverse quantization to quantized transform coefficients of the coding unit before applying the inverse transform.

15 . The apparatus according to claim 10 , wherein:

the first CBF is zero when non-zero chroma quantized transform coefficients are not present in quantized transform coefficients of the first chroma component; and

the second CBF is zero when non-zero chroma quantized transform coefficients are not present in quantized transform coefficients of the second chroma component.

16 . The apparatus according to claim 10 , wherein the corresponding scaling parameter is derived from reconstructed luma samples.

17 . The apparatus according to claim 11 , wherein an input to the inverse ACT is in YCgCo space.

18 . The apparatus according to claim 11 , wherein an output of the inverse ACT is in RGB space.

19 . A method for transmitting a bitstream, comprising;

transmitting the bitstream to an image decoding apparatus, wherein the bitstream is to be decoded by performing acts comprising:

obtaining, from the bitstream, a plurality of syntax elements associated with a coding unit, wherein the syntax elements include a first coded block flag (CBF) for residual samples of a first chroma component of the coding unit, a second CBF for residual samples of a second chroma component of the coding unit, and a third syntax element indicating whether adaptive color transform (ACT) is applied to the coding unit or not, wherein the coding unit is associated with a partitioning method comprising at least one of quaternary partitioning, horizontal ternary partitioning, vertical ternary partitioning, horizontal binary partitioning or vertical binary partitioning;

determining whether to perform chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element; and

in response to a determination to perform the chroma residual scaling to the residual samples of the at least one of the first or second chroma components,

scaling the residual samples of the at least one of the first or second chroma components based on a corresponding scaling parameter; and

reconstructing chroma samples of the coding unit using chroma residual samples after scaling.

20 . The method according to claim 19 , wherein the acts further comprise:

in response to the third syntax element indicating that the ACT is applied to the coding unit:

applying an inverse ACT to luma and chroma residual samples of the coding unit; and

wherein the determining whether to perform the chroma residual scaling to residual samples of at least one of the first or second chroma components according to at least one of the first CBF, the second CBF, or the third syntax element comprises:

in response to the third syntax element indicating that the ACT is applied to the coding unit, determining to perform the chroma residual scaling to residual samples of the at least one of the first or second chroma components after the inverse ACT has been applied regardless of the first CBF and the second CBF.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2024
From: XIU, XIAOYU; CHEN, YI-WEN; MA, TSUNG-CHUAN; JHU, HONG-JHENG; CHEN, WEI; KUO, CHE-WEI; WANG, XIANGLIN; YU, BING
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 068665/0889 →
Continuity (4)
Continuation 18064831 · Dec 12, 2022
Continuation PCTUS2021037197 · Jun 14, 2021
Provisional Application 63038692 · Jun 12, 2020
Related Publication 20240364885A1 · Oct 31, 2024
References Cited (35)
US 10469847B2 · Xiu et al. · 2019 [cited by applicant]
US 20120114034A1 · Huang et al. · 2012 [cited by applicant]
US 20130266074A1 · Guo et al. · 2013 [cited by applicant]
US 20150016512A1 · Pu et al. · 2015 [cited by applicant]
US 20150124865A1 · Kim et al. · 2015 [cited by applicant]
US 20150373349A1 · Zhang · 2015 [cited by examiner]
US 20160080751A1 · Xiu et al. · 2016 [cited by applicant]
US 20170318301A1 · Li et al. · 2017 [cited by applicant]
US 20190045209A1 · Ramasubramonian et al. · 2019 [cited by applicant]
US 20200053252A1 · Mahmalat et al. · 2020 [cited by applicant]
CN 104247424A · 2014 [cited by applicant]
CN 104685872A · 2015 [cited by applicant]
CN 105308960A · 2016 [cited by applicant]
CN 105960802A · 2016 [cited by applicant]
CN 106664425A · 2017 [cited by applicant]
CN 107079157A · 2017 [cited by applicant]
CN 106797465B · 2019 [cited by applicant]
CN 107211151B · 2020 [cited by applicant]
GB 2531004A · 2016 [cited by applicant]
JP 2024120053A · 2024 [cited by applicant]
JP 2024120056A · 2024 [cited by applicant]
KR 20160024886A · 2016 [cited by applicant]
KR 20160029144A · 2016 [cited by applicant]
KR 20170057312A · 2017 [cited by applicant]
KR 20170108964A · 2017 [cited by applicant]
KR 101997686B1 · 2019 [cited by applicant]
KR 102051193B1 · 2019 [cited by applicant]
KR 20200053603A · 2020 [cited by applicant]
WO 2021061794A1 · 2021 [cited by applicant]
WO 2021072379A1 · 2021 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 9),” Document: JVET-R2001-vA, Joint Video 1 Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, 20 pages. [cited by applicant]
Bross, Benjamin et al., “Versatile Video Coding (Draft 8),” Joint Video Experts Team 2 (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting, Brussels, BE, Jan. 7-17, 2020, 209 paages. [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 8 (VTM 8),” Document: JVET-Q2002-v3, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussel… [cited by applicant]
Xiu et al., “Mismatch between text specification and reference software on chroma residual scaling when ACT is enabled,” Document JVET-S0234, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/W… [cited by applicant]
Xiu et al., “Mismatch between text specification and reference software on chroma residual scaling when ACT is enabled,” Preview document JVET-S0234 for Teleconference meeting (MPEG No. m54242), 5 pages. [cited by applicant]