IP Library › Granted Patent US 12,407,839
Granted Patent B2
US 12,407,839 · App. 18/750,699 · Granted Sep 2, 2025

Simplifications of cross-component linear model

Inventors: Yi-wen Chen (San Diego, CA); Xianglin Wang (San Diego, CA)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/186H04N19/105H04N19/132H04N19/176H04N19/30H04N19/44H04N19/59
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,839
App. No.
18/750,699
Granted
Sep 2, 2025
Kind
B2
Abstract

A computing device performs a method of decoding video data by reconstructing a luma block corresponding to a chroma block; searching a sub-group of a plurality of reconstructed neighboring luma samples in a predefined order to identify a maximum luma sample and a minimum luma sample; computing a down-sampled maximum luma sample corresponding to the maximum luma sample; computing a down-sampled minimum luma sample corresponding to the minimum luma sample; generating a linear model using the down-sampled maximum luma sample, the down-sampled minimum luma sample, the first reconstructed chroma sample, and the second reconstructed chroma sample; computing down-sampled luma samples from luma samples of the reconstructed luma block, wherein each down-sampled luma sample corresponds to a chroma sample of the chroma block; and predicting chroma samples of the chroma block by applying the liner model to the corresponding down-sampled luma samples.

Claims (46)

1. A method for decoding a video signal, comprising:

reconstructing a luma block corresponding to a chroma block, wherein the luma block is adjacent to a plurality of reconstructed neighboring luma samples, and wherein the chroma block is adjacent to a plurality of reconstructed neighboring chroma samples;

computing a plurality of down-sampled luma samples from the plurality of reconstructed neighboring luma samples;

identifying, from a sub-group of the plurality of computed down-sampled luma samples, two down-sampled maximum luma samples, wherein the two down-sampled maximum luma samples correspond to two first reconstructed chroma samples of the plurality of reconstructed neighboring chroma samples respectively, and the sub-group is composed of a predefined number of the computed down-sampled luma samples among the plurality of computed down-sampled luma samples;

identifying, from the sub-group of the plurality of computed down-sampled luma samples, two down-sampled minimum luma samples, wherein the two down-sampled minimum luma samples correspond to two second reconstructed chroma samples of the plurality of reconstructed neighboring chroma samples respectively;

averaging the two down-sampled maximum luma samples, the two down-sampled minimum luma samples, the two first reconstructed chroma samples, and the two second reconstructed chroma samples, respectively, to obtain an averaged down-sampled maximum luma sample, an averaged down-sampled minimum luma sample, an averaged first reconstructed chroma sample and an averaged second reconstructed chroma sample;

fitting a linear model through the averaged down-sampled maximum luma sample, the averaged down-sampled minimum luma sample, the averaged first reconstructed chroma sample, and the averaged second reconstructed chroma sample;

computing down-sampled luma samples from luma samples of the reconstructed luma block, wherein each down-sampled luma sample corresponds to a chroma sample of the chroma block; and

predicting chroma samples of the chroma block by applying the linear model to the corresponding computed down-sampled luma samples.

2. The method of claim 1 , wherein the chroma block and the luma block are encoded using a 4:2:0 or 4:2:2 chroma sub-sampling scheme, and wherein the chroma block and the luma block have different resolutions.

3. The method of claim 1 , wherein the plurality of reconstructed neighboring luma samples includes luma samples located above the reconstructed luma block and/or luma samples to left of the reconstructed luma block.

4. The method of claim 1 , wherein the computing down-sampled luma samples from luma samples of the reconstructed luma block comprises performing a weighted average of six neighboring luma samples to the luma sample.

5. The method of claim 1 , wherein the fitting the linear model comprises fitting a linear equation through a data point associated with the averaged down-sampled maximum luma sample and the averaged first reconstructed chroma sample and a data point associated with the averaged down-sampled minimum luma sample and the averaged second reconstructed chroma sample.

6. A decoding device comprising:

one or more processors;

memory coupled to the one or more processors; and

a plurality of programs stored in the memory that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:

reconstructing a luma block corresponding to a chroma block, wherein the luma block is adjacent to a plurality of reconstructed neighboring luma samples, and wherein the chroma block is adjacent to a plurality of reconstructed neighboring chroma samples;

computing a plurality of down-sampled luma samples from the plurality of reconstructed neighboring luma samples;

identifying, from a sub-group of the plurality of computed down-sampled luma samples, two down-sampled maximum luma samples, wherein the two down-sampled maximum luma samples correspond to two first reconstructed chroma samples of the plurality of reconstructed neighboring chroma samples respectively, and the sub-group is composed of a predefined number of the computed down-sampled luma samples among the plurality of computed down-sampled luma samples;

identifying, from the sub-group of the plurality of computed down-sampled luma samples, two down-sampled minimum luma samples, wherein the two down-sampled minimum luma samples correspond to two second reconstructed chroma samples of the plurality of reconstructed neighboring chroma samples respectively;

averaging the two down-sampled maximum luma samples, the two down-sampled minimum luma samples, the two first reconstructed chroma samples, and the two second reconstructed chroma samples, respectively, to obtain an averaged down-sampled maximum luma sample, an averaged down-sampled minimum luma sample, an averaged first reconstructed chroma sample and an averaged second reconstructed chroma sample;

fitting a linear model through the averaged down-sampled maximum luma sample, the averaged down-sampled minimum luma sample, the averaged first reconstructed chroma sample, and the averaged second reconstructed chroma sample;

computing down-sampled luma samples from luma samples of the reconstructed luma block, wherein each down-sampled luma sample corresponds to a chroma sample of the chroma block; and

predicting chroma samples of the chroma block by applying the linear model to the corresponding computed down-sampled luma samples.

7. The decoding device of claim 6 , wherein the chroma block and the luma block are encoded using a 4:2:0 or 4:2:2 chroma sub-sampling scheme, and wherein the chroma block and the luma block have different resolutions.

8. The decoding device of claim 6 , wherein the plurality of reconstructed neighboring luma samples includes luma samples located above the reconstructed luma block and/or luma samples to left of the reconstructed luma block.

9. The decoding device of claim 6 , wherein the computing down-sampled luma samples from luma samples of the reconstructed luma block comprises performing a weighted average of six neighboring luma samples to the luma sample.

10. The decoding device of claim 6 , wherein the fitting the linear model comprises fitting a linear equation through a data point associated with the averaged down-sampled maximum luma sample and the averaged first reconstructed chroma sample and a data point associated with the averaged down-sampled minimum luma sample and the averaged second reconstructed chroma sample.

11. A method for storing a bitstream, comprising:

performing an encoding method to generate a bitstream; and

storing the bitstream,

wherein the encoding method comprises:

reconstructing a luma block corresponding to a chroma block, wherein the luma block is adjacent to a plurality of reconstructed neighboring luma samples, and wherein the chroma block is adjacent to a plurality of reconstructed neighboring chroma samples;

computing a plurality of down-sampled luma samples from the plurality of reconstructed neighboring luma samples;

identifying, from a sub-group of the plurality of computed down-sampled luma samples, two down-sampled maximum luma samples, wherein the two down-sampled maximum luma samples correspond to two first reconstructed chroma samples of the plurality of reconstructed neighboring chroma samples respectively, and the sub-group is composed of a predefined number of the computed down-sampled luma samples among the plurality of computed down-sampled luma samples;

identifying, from the sub-group of the plurality of computed down-sampled luma samples, two down-sampled minimum luma samples, wherein the two down-sampled minimum luma samples correspond to two second reconstructed chroma samples of the plurality of reconstructed neighboring chroma samples respectively;

averaging the two down-sampled maximum luma samples, the two down-sampled minimum luma samples, the two first reconstructed chroma samples, and the two second reconstructed chroma samples, respectively, to obtain an averaged down-sampled maximum luma sample, an averaged down-sampled minimum luma sample, an averaged first reconstructed chroma sample and an averaged second reconstructed chroma sample;

fitting a linear model through the averaged down-sampled maximum luma sample, the averaged down-sampled minimum luma sample, the averaged first reconstructed chroma sample, and the averaged second reconstructed chroma sample;

computing down-sampled luma samples from luma samples of the reconstructed luma block, wherein each down-sampled luma sample corresponds to a chroma sample of the chroma block; and

predicting chroma samples of the chroma block by applying the linear model to the corresponding computed down-sampled luma samples,

wherein the bitstream is to be decoded by the method of claim 1 .

12. The method of claim 11 , wherein the chroma block and the luma block are encoded using a 4:2:0 or 4:2:2 chroma sub-sampling scheme, and wherein the chroma block and the luma block have different resolutions.

13. The method of claim 11 , wherein the plurality of reconstructed neighboring luma samples includes luma samples located above the reconstructed luma block and/or luma samples to left of the reconstructed luma block.

14. The method of claim 11 , wherein the computing down-sampled luma samples from luma samples of the reconstructed luma block comprises performing a weighted average of six neighboring luma samples to the luma sample.

15. The method of claim 11 , wherein the fitting the linear model comprises fitting a linear equation through a data point associated with the averaged down-sampled maximum luma sample and the averaged first reconstructed chroma sample and a data point associated with the averaged down-sampled minimum luma sample and the averaged second reconstructed chroma sample.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: CHEN, YI-WEN; WANG, XIANGLIN
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 067803/0744 →
Continuity (7)
Continuation 18212640 · Jun 21, 2023
Continuation 18126179 · Mar 24, 2023
Continuation 17700238 · Mar 21, 2022
Continuation 17225955 · Apr 8, 2021
Continuation PCTUS2019055208 · Oct 8, 2019
Provisional Application 62742806 · Oct 8, 2018
Related Publication 20240348802A1 · Oct 17, 2024
References Cited (75)
US 11323726B2 · Chen · 2022 [cited by examiner]
US 11632559B2 · Chen · 2023 [cited by examiner]
US 11962789B2 · Chen · 2024 [cited by examiner]
US 12063377B2 · Chen · 2024 [cited by examiner]
US 20120328013A1 · Budagavi et al. · 2012 [cited by applicant]
US 20130188703A1 · Liu · 2013 [cited by examiner]
US 20130322746A1 · Cote et al. · 2013 [cited by applicant]
US 20150124865A1 · Kim et al. · 2015 [cited by applicant]
US 20160277762A1 · Zhang · 2016 [cited by examiner]
US 20170150183A1 · Zhang et al. · 2017 [cited by applicant]
US 20170295365A1 · Budagavi · 2017 [cited by examiner]
US 20170359595A1 · Zhang et al. · 2017 [cited by applicant]
US 20170366818A1 · Zhang et al. · 2017 [cited by applicant]
US 20170374372A1 · Liu et al. · 2017 [cited by applicant]
US 20180048889A1 · Zhang et al. · 2018 [cited by applicant]
US 20180063527A1 · Chen et al. · 2018 [cited by applicant]
US 20180070107A1 · Ramasubramonian et al. · 2018 [cited by applicant]
US 20180077426A1 · Zhang · 2018 [cited by examiner]
US 20180152721A1 · Rusanovskyy et al. · 2018 [cited by applicant]
US 20180205946A1 · Zhang et al. · 2018 [cited by applicant]
US 20190045184A1 · Zhang et al. · 2019 [cited by applicant]
US 20200195930A1 · Choi · 2020 [cited by examiner]
US 20200288135A1 · Laroche et al. · 2020 [cited by applicant]
US 20200413062A1 · Onno · 2020 [cited by examiner]
US 20200413069A1 · Lim et al. · 2020 [cited by applicant]
US 20210136392A1 · Ma · 2021 [cited by examiner]
US 20210136409A1 · Ma · 2021 [cited by examiner]
US 20210227235A1 · Chen et al. · 2021 [cited by applicant]
CN 103918269A · 2014 [cited by applicant]
CN 104380741A · 2015 [cited by applicant]
CN 104471940A · 2015 [cited by applicant]
CN 105723707A · 2016 [cited by applicant]
CN 107302699A · 2017 [cited by applicant]
CN 107371040A · 2017 [cited by applicant]
CN 107431795A · 2017 [cited by applicant]
CN 108604391A · 2018 [cited by applicant]
EP 3272120A1 · 2018 [cited by applicant]
KR 20120140366A · 2012 [cited by applicant]
WO 2008145039A1 · 2008 [cited by applicant]
WO 2017140211A1 · 2017 [cited by applicant]
WO 2017203930A1 · 2017 [cited by applicant]
WO 2017214420A1 · 2017 [cited by applicant]
WO 2018053293A1 · 2018 [cited by applicant]
WO 2018118940A1 · 2018 [cited by applicant]
WO 2020263392A1 · 2020 [cited by applicant]
“Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding”—Kai Zhang, Jianle Chen, Li Zhang, Xiang Li, Marta Karczewicz; IEEE Transactions on Image Processing, vol. 27, No. 8, Aug. 2018. (Year: … [cited by examiner]
“Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC”—Xingyu Zhang, Christophe Gisquet, Edouard François, Feng Zou, Oscar C. Au; IEEE Transactions on Image Processing, vol. 23, No. 1, Jan. 2014. (Year: 2… [cited by examiner]
International Search Report and Written Opinion dated Feb. 3, 2020 received in International Application No. PCT/US2019/055208. [cited by applicant]
International Preliminary Report on Patentability dated Apr. 8, 2021 received in International ApplicationNo. PCT/US2019/055208. [cited by applicant]
Office Action dated Jun. 4, 2021 received in U.S. Appl. No. 17/225,955. [cited by applicant]
Office Action dated Sep. 24, 2021 received in U.S. Appl. No. 17/225,955. [cited by applicant]
Notice of Allowance dated Dec. 29, 2021 received in U.S. Appl. No. 17/225,955. [cited by applicant]
Jianle Chen et al. Algorithm Description of Joint Exploration Test Model 4, JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-D1001 v1, 4th Meeting, Chengdu, CN, Oct. 15-21, 2016, 38 pgs. [cited by applicant]
Jianle Chen et al. Algorithm Description of Joint Exploration Test Model 5, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-E1001 v1, 5th Meeting: Geneva, CH, Jan. 12-20,… [cited by applicant]
Kai Zhang, et al., CE3-related: CCLM prediction with single-line neighbouring luma samples, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC 29/WG 11, JVET-L329-v1, 12th Meeting: Macao, CN, Oct. 3… [cited by applicant]
Philippe Hanhart, et al., CE3-related: Enabling different chroma sample location types in CCLM, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0239-v2, 12th Meeting: Macau, CN, … [cited by applicant]
Xiang Ma, CE3: CCLM/MDLM using simplified coefficients derivation method (Test 5.6.1, 5.6.2 and 5.6.3), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-L0340_rl, 12th Me… [cited by applicant]
“Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding”—Kai Zhang, Jianle Chen, Li Zhang, Xiang Li, Marta Karczewicz; IEEE Transactions on Image Processing, vol. 27, No. 8, Aug. 2018. [cited by applicant]
“Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC”—Xingyu ZHANG, Christophe Gisquet, Edouard François, Feng Zou, Oscar C. Au; IEEE Transactions on Tmacge Processing vol. 23 No. 1, Jan. 2014. [cited by applicant]
Office Action dated Nov. 9, 2022 received in U.S. Appl. No. 17/700,238. [cited by applicant]
Office Action dated Nov. 23, 2021 received in U.S. Appl. No. 17/222,461. [cited by applicant]
First Office Action of CN202210198549.0 from CNIPA dated Jul. 13, 2022. [cited by applicant]
Laroche et al.; ‘Non-CE3: On cross-component linear model simplification’, Joint VideoExperts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-K0204-v3, 11th Meeting: Ljubljana, SI, Jul. 10-… [cited by applicant]
Notice of Allowance dated Feb. 7, 2023 received in U.S. Appl. No. 17/700,238. [cited by applicant]
First Office Action dated Jan. 12, 2024 received in Chinese Patent Application No. CN 202310987345.X. [cited by applicant]
First Office Action dated Dec. 4, 2023 received in Chinese Patent Application No. CN 202310744433.7. [cited by applicant]
Office Action dated Dec. 19, 2023 received in Japanese Patent Application No. JP 2023-040322. [cited by applicant]
Yan, X. et al., “Bitrate decrease by interleave intra prediction coding for HEVC”, Video engineering, 2017, 41(9/10), pp. 27-32. [cited by applicant]
Notification of Due Registration Formalities and Granting Patent Right to Invention dated Feb. 1, 2024 received in Chinese Patent Application No. CN 202310242277.4. [cited by applicant]
Office Action dated Oct. 24, 2023 received in U.S. Appl. No. 18/126,179. [cited by applicant]
Xiang Ma, et al., CE3: Classification-based mean value for CCLM coefficients derivation (tests 2.5.1-2.5.4). Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,JVET-M0401-v1.13 th Meeting: … [cited by applicant]
Gang-Yi, J. et al., “A Novel Fast Mode Selection Algorithm for Intra Prediction Based on Characteristics of Block's Reference Pixels”, Journal of Electronics & Information Technology, Oct. 2006, pp. 1874-1878, vol. 28, … [cited by applicant]
First Office Action dated Feb. 5, 2024 received in Chinese Patent Application No. CN 202311000873.8. [cited by applicant]
Notification of Due Registration Formalities and Granting Patent Right to Invention dated Feb. 4, 2024 received in Chinese Patent Application No. CN 202311006402.8. [cited by applicant]
Notification of Due Registration Formalities and Granting Patent Right to Invention dated Feb. 1, 2024 received in Chinese Patent Application No. CN 202310744433.7. [cited by applicant]