IP Library › Granted Patent US 12,477,126
Granted Patent B2
US 12,477,126 · App. 17/835,599 · Granted Nov 18, 2025

Cross-component prediction using multiple components

Inventors: Junru Li (Beijing, CN); Meng Wang (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA)
Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
H04N19/186H04N19/105H04N19/11H04N19/132H04N19/159H04N19/172H04N19/197H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,477,126
App. No.
17/835,599
Granted
Nov 18, 2025
Kind
B2
Abstract

Devices, systems and methods for digital video coding, which includes Prediction from Multiple Cross-components (PMC) methods, are described. An exemplary method for video processing includes making a first determination that a cross-component prediction (CCP) mode is disabled for a conversion between a video block of a video and a bitstream representation of the video and making a second determination, based on the first determination, regarding whether a first syntax element indicating usage of an enhanced Two-Step Cross-component Prediction Mode (TSCPM) coding tool or an enhanced cross-component linear model (CCLM) coding tool is included in the bitstream representation. The method also includes performing a conversion based on the second determination.

Claims (54)

1 . A method of video processing, comprising:

determining, for a conversion between a chroma block of a video and a bitstream of the video, that a first intra prediction mode is applied to derive prediction samples of the chroma block, wherein in the first intra prediction mode, prediction samples of the chroma block are derived based on corresponding luma samples of the chroma block and a linear model,

determining, for the chroma block, a first parameter and a second parameter of the linear model,

performing the conversion based on the first parameter and the second parameter,

wherein the first parameter is set to a first default value and the second parameter is set to a second default value in response to left and/or above neighboring reference samples of the chroma block are not available.

2 . The method of claim 1 , wherein the first intra prediction mode is a Prediction from Multiple Cross-component (PMC) mode, or a PMC_LT mode, or a Two-Step Cross-component Prediction Mode (TSCPM), or a TSCPM_LT, or a TSCPM_L, or a TSCPM_T, and

wherein the first parameter is set to the first default value and the second parameter is set to the second default value in response to left and above neighboring reference samples of the chroma block are not available.

3 . The method of claim 1 , wherein the first intra prediction mode is a PMC_L mode, and

wherein the first parameter is set to the first default value and the second parameter is set to the second default value in response to left neighboring reference samples of the chroma block are not available.

4 . The method of claim 1 , wherein the first intra prediction mode is a PMC_T mode, and

wherein the first parameter is set to the first default value and the second parameter is set to the second default value in response to above neighboring reference samples of the chroma block are not available.

5 . The method of claim 1 , wherein the first default value and the second default value are different.

6 . The method of claim 1 , wherein the chroma block is a Cb chroma block, and the linear model comprises predChroma[x][y]=Clip1(((α Cb *I[x][y])>>iShift)+β Cb ),

wherein α Cb denotes the first parameter,

wherein β Cb denotes the second parameter,

wherein iShift is an integer,

wherein x is an integer no less than 0 and less than 2 W, and W is the width of the Cb chroma block,

wherein y is an integer no less than 0 and less than 2H, and His the height of the Cb chroma block,

wherein I[x][y] denotes a luma sample value in the location [x][y], and

wherein predChroma are used to derive prediction samples of the chroma block.

7 . The method of claim 6 , wherein the first default value is equal to 0.

8 . The method of claim 6 , wherein the second default value is equal to 1<< (BitDepth−1), where BitDepth denotes a bit depth of chroma samples.

9 . The method of claim 6 , wherein the first intra prediction mode is applied to a Cr chroma block corresponding to the Cb chroma block, and

wherein prediction samples of the Cr chroma block are derived based on ((((α Cb +α Cr )*I[x][y])>>iShift)+β Cb +β Cr ), where α Cr and β Cr denote two parameters.

10 . The method of claim 9 , wherein prediction samples of the Cr chroma block are derived as following:

predMatrixTemp[0 ][n ]=(predChroma[0][2 n ]+predChroma[0][2 n+ 1]+1)>>1,

predMatrixTemp[ m][n ]=(predChroma[2 m −1][2 n]+ 2*predChroma[2 m ][2 n ]+predChroma[2 m +1][2 n ]+predChroma[2 m −1][2 n+ 1]+2*predChroma[2 m ][2 n+ 1]+predChroma[2 m +1][2 n+ 1]+4)>>3, and

predMatrix[ k][n ]=predMatrixTemp[ k][n]−Cb[k][n],

wherein m is an integer greater than 0 and less than W, n is an integer no less than 0 and less than H, and k is an integer no less than 0 and less than W,

wherein predChroma[ ][ ] are derived based on ((((α Cb +α Cr )*I[x][y])>>iShift)+β Cb +β Cr ), and

wherein predMatrix[ ][ ] denotes a prediction sample of the Cr chroma block.

11 . The method of claim 9 , wherein α Cr is set to the first default value and β Cr is set to the second default value in response to left and/or above neighboring reference samples of the chroma block are not available.

12 . The method of claim 1 , wherein a first syntax element indicating whether the first intra prediction mode is enabled is included in the bitstream.

13 . The method of claim 1 , wherein a second syntax element indicating whether TSCPM is enabled is included in the bitstream, and Enhanced TSCPM is only enabled in response to the second syntax element indicating TSCPM being enabled.

14 . The method of claim 1 , wherein one or more flags indicating a type of TSCPM are included in the bitstream in case that Enhanced TSCPM is enabled.

15 . The method of claim 1 , wherein in case that a fourth syntax element indicates Intra Block Copy (IBC) mode is disabled for a video block of the video, Adaptive BV Resolution (ABVR) is inferred to be disabled for the video block.

16 . The method of claim 1 , wherein the conversion includes encoding the chroma block into the bitstream.

17 . The method of claim 1 , wherein the conversion includes decoding the chroma block from the bitstream.

18 . An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a chroma block of a video and a bitstream of the video, that a first intra prediction mode is applied to derive prediction samples of the chroma block, wherein in the first intra prediction mode, prediction samples of the chroma block are derived based on corresponding luma samples of the chroma block and a linear model,

determine, for the chroma block, a first parameter and a second parameter of the linear model,

perform the conversion based on the first parameter and the second parameter,

wherein the first parameter is set to a first default value and the second parameter is set to a second default value in response to left and/or above neighboring reference samples of the chroma block are not available.

19 . A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a chroma block of a video and a bitstream of the video, that a first intra prediction mode is applied to derive prediction samples of the chroma block, wherein in the first intra prediction mode, prediction samples of the chroma block are derived based on corresponding luma samples of the chroma block and a linear model,

determine, for the chroma block, a first parameter and a second parameter of the linear model,

perform the conversion based on the first parameter and the second parameter,

wherein the first parameter is set to a first default value and the second parameter is set to a second default value in response to left and/or above neighboring reference samples of the chroma block are not available.

20 . A method for storing a bitstream of a video, comprising:

determining, for a chroma block of the video, that a first intra prediction mode is applied to derive prediction samples of the chroma block, wherein in the first intra prediction mode, prediction samples of the chroma block are derived based on corresponding luma samples of the chroma block and a linear model;

determining, for the chroma block, a first parameter and a second parameter of the linear model;

generating the bitstream based on the first parameter and the second parameter; and

storing the bitstream in a non-transitory computer-readable recording medium,

wherein the first parameter is set to a first default value and the second parameter is set to a second default value in response to left and/or above neighboring reference samples of the chroma block are not available.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2022
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 060148/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2022
From: LI, JUNRU; WANG, MENG
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060148/0413 →
Priority Claims (1)
WO PCT/CN2019/123857 · Dec 8, 2019 · international
Continuity (2)
Continuation PCTCN2020134382 · Dec 8, 2020
Related Publication 20220312020A1 · Sep 29, 2022
References Cited (65)
US 10200700B2 · Zhang et al. · 2019 [cited by applicant]
US 10419757B2 · Chen et al. · 2019 [cited by applicant]
US 10448025B1 · Xu et al. · 2019 [cited by applicant]
US 10469847B2 · Xiu et al. · 2019 [cited by applicant]
US 10939128B2 · Zhang et al. · 2021 [cited by applicant]
US 10979717B2 · Zhang et al. · 2021 [cited by applicant]
US 20120069904A1 · Amon · 2012 [cited by examiner]
US 20140098862A1 · Yang · 2014 [cited by examiner]
US 20140140392A1 · Xu et al. · 2014 [cited by applicant]
US 20170127080A1 · Kawamura et al. · 2017 [cited by applicant]
US 20170244975A1 · Wang et al. · 2017 [cited by applicant]
US 20170324643A1 · Seregin · 2017 [cited by examiner]
US 20170366818A1 · Zhang · 2017 [cited by examiner]
US 20180199062A1 · Zhang et al. · 2018 [cited by applicant]
US 20180205946A1 · Zhang et al. · 2018 [cited by applicant]
US 20180288446A1 · An · 2018 [cited by examiner]
US 20200314419A1 · Wang · 2020 [cited by examiner]
US 20200359051A1 · Zhang et al. · 2020 [cited by applicant]
US 20200366910A1 · Zhang et al. · 2020 [cited by applicant]
US 20200366933A1 · Zhang et al. · 2020 [cited by applicant]
US 20200382769A1 · Zhang et al. · 2020 [cited by applicant]
US 20210092395A1 · Zhang et al. · 2021 [cited by applicant]
US 20210092396A1 · Zhang et al. · 2021 [cited by applicant]
US 20210152837A1 · Zhang et al. · 2021 [cited by applicant]
US 20210211681A1 · Zhang et al. · 2021 [cited by applicant]
US 20210258571A1 · Zhang et al. · 2021 [cited by applicant]
US 20210258572A1 · Zhang et al. · 2021 [cited by applicant]
US 20210297661A1 · Deng · 2021 [cited by examiner]
US 20210297694A1 · Zhang et al. · 2021 [cited by applicant]
US 20210314559A1 · Lin · 2021 [cited by examiner]
US 20210314595A1 · Zhang et al. · 2021 [cited by applicant]
US 20210321131A1 · Zhang · 2021 [cited by examiner]
US 20210329248A1 · Deng · 2021 [cited by examiner]
US 20210344902A1 · Zhang et al. · 2021 [cited by applicant]
US 20210400260A1 · Zhang et al. · 2021 [cited by applicant]
US 20220007034A1 · Wang · 2022 [cited by examiner]
US 20220224891A1 · Chiang · 2022 [cited by examiner]
US 20220272329A1 · Jang · 2022 [cited by examiner]
US 20220279189A1 · Jang · 2022 [cited by examiner]
CN 105723706A · 2016 [cited by applicant]
CN 106664425A · 2017 [cited by applicant]
CN 109716771A · 2019 [cited by applicant]
CN 110100439A · 2019 [cited by applicant]
CN 113261291A · 2021 [cited by applicant]
KR 20050063214A · 2005 [cited by applicant]
WO 2018045207A1 · 2018 [cited by applicant]
WO 2018053293A1 · 2018 [cited by applicant]
WO 2018132710A1 · 2018 [cited by applicant]
WO 2019054200A1 · 2019 [cited by applicant]
WO WO2021110116A1 · 2021 [cited by examiner]
Bross et al. “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P2001, 2019. http://phenix.it-s… [cited by applicant]
Chen et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017, document J… [cited by applicant]
“Information Technology—High Efficiency Coding and Media Delivery in Heterogeneous Environments—Part 2: High Efficiency Video Coding” Apr. 20, 2018, ISO/DIS 23008, 4th Edition. [cited by applicant]
Laroche et al. “CE3-5.1: On Cross-Component Linear Model Simplification,” Joint Video Experts Team (JVET) of TU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, document JVET-L0191, 2… [cited by applicant]
Ma et al. “CE3: Multi-Directional LM (MDLM) (Test 5.4.1 and 5.4.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, document JVET-L0338, 2018. [cited by applicant]
Rosewarne et al. “High Efficiency Video Coding (HEVC) Test Model 16 (HM 16) Improved Encoder Description Update 7,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG1125th Meet… [cited by applicant]
Van Der Auwera et al. “Description of Core Experiment 3: Intra Prediction and Mode Coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018… [cited by applicant]
Wang et al. “CE3: Adaptive Multiple Cross-Component Linear Model (Test 5.9.1),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, JVET-L0419, 201… [cited by applicant]
Zhang et al. “Improving Chroma Intra Prediciton for HEVC,” 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Jul. 15, 2016, pp. 2-4. [cited by applicant]
Zhang et al. “Enhanced Cross-Component Linear Model Intra-Prediction,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, document IVET-D011… [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/133786 dated Mar. 3, 2021 (13 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/134382 dated Mar. 8, 2021 (11 pages). [cited by applicant]
Document: JVET-P2001-v1, Bross B., et al., “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/ IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-Oct. 11, 2019, 456 page… [cited by applicant]
Li J., et al., “Prediction with Multi-cross Component,” IEEE Xplore, 2020, 06 Pages. [cited by applicant]
First Office Action for Chinese Application No. 202080085360.X, mailed Mar. 26, 2025, 18 pages. [cited by applicant]
Cited By (1)
US 12,720,093