IP Library › Granted Patent US 12,192,452
Granted Patent B2
US 12,192,452 · App. 18/355,415 · Granted Jan 7, 2025

Method and an apparatus for processing a video signal based on inter-component reference

Inventors: Dong Gyu Sim (Seoul, KR); Sea Nae Park (Seoul, KR)
Assignee: KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
H04N19/115H04N19/176H04N19/186H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,452
App. No.
18/355,415
Granted
Jan 7, 2025
Kind
B2
Abstract

A method and apparatus for processing a video signal according to the present invention derives a first prediction value of a chrominance block using a sample of a luminance block, calculates a compensation parameter based on a predetermined reference area, derives a second prediction value of a chrominance block, and reconstructs a chrominance block based on a second prediction value of a chrominance block.

Claims (52)

1. A method of decoding a video signal, with a decoding apparatus, comprising:

receiving, with the decoding apparatus, a bitstream including a flag indicating whether to decode a chrominance block based on a luminance block corresponding to the chrominance block and a luminance reference region adjacent to the luminance block;

predicting, with the decoding apparatus, the chrominance block based on the luminance block and the luminance reference region according to the flag; and

reconstructing, with the decoding apparatus, the predicted chrominance block,

wherein the luminance reference region includes a top luminance reference region adjacent to a top boundary of the luminance block and a left luminance reference region adjacent to a left boundary of the luminance block,

wherein the top luminance reference region includes a plurality of horizontal sample lines,

wherein the left luminance reference region includes a plurality of vertical sample lines,

wherein a number of the horizontal sample lines belonging to the top luminance reference region is variably determined based on an availability of the top luminance reference region,

wherein a number of the vertical sample lines belonging to the left luminance reference region is variably determined based on an availability of the left luminance reference region,

wherein a second prediction sample of the predicted chrominance block is obtained based on compensation parameters including a weight and an offset,

wherein the second prediction sample is obtained by multiplying a first prediction sample by the weight and summing the offset,

wherein the first prediction sample is obtained by predicting the luminance block,

wherein the compensation parameters are calculated based on a representative luminance value of a luminance reference region adjacent to the luminance block and a representative chrominance value of chrominance reference region adjacent to the chrominance block,

wherein the representative luminance value is derived to be one or more of average values, minimum values, maximum values or median values of some of samples belonging to the luminance reference region, and

wherein the representative chrominance value is derived from a luminance value of the luminance reference region at a corresponding location.

2. The method of claim 1 , wherein, when the luminance reference region is unavailable, the unavailable luminance reference region is replaced with an adjacent region of the unavailable luminance reference region in a right or bottom direction.

3. The method of claim 1 , wherein the number of the horizontal sample lines belonging to the top luminance reference region is different from the number of the vertical sample lines belonging to the left luminance reference region.

4. A method of encoding a video signal, with an encoding apparatus, comprising:

predicting, with the encoding apparatus, a chrominance block based on a luminance block corresponding to the chrominance block and a luminance reference region adjacent to the luminance block;

obtaining, with the encoding apparatus, a residual block of the chrominance block based on an original block of the chrominance block and a predicted chrominance block obtained by predicting the chrominance block; and

generating, with the encoding apparatus, a bitstream by encoding the residual block,

wherein the bitstream includes a flag indicating whether to encode the chrominance block based on the luminance block and the luminance reference region,

wherein the luminance reference region includes a top luminance reference region adjacent to a top boundary of the luminance block and a left luminance reference region adjacent to a left boundary of the luminance block,

wherein the top luminance reference region includes a plurality of horizontal sample lines,

wherein the left luminance reference region includes a plurality of vertical sample lines,

wherein a number of the horizontal sample lines belonging to the top luminance reference region is variably determined based on an availability of the top luminance reference region,

wherein a number of the vertical sample lines belonging to the left luminance reference region is variably determined based on an availability of the left luminance reference region,

wherein a second prediction sample of the predicted chrominance block is obtained based on compensation parameters including a weight and an offset,

wherein the second prediction sample is obtained by multiplying a first prediction sample by the weight and summing the offset,

wherein the first prediction sample is obtained by predicting the luminance block,

wherein the compensation parameters are calculated based on a representative luminance value of a luminance reference region adjacent to the luminance block and a representative chrominance value of chrominance reference region adjacent to the chrominance block,

wherein the representative luminance value is derived to be one or more of average values, minimum values, maximum values or median values of some of samples belonging to the luminance reference region, and

wherein the representative chrominance value is derived from a luminance value of the luminance reference region at a corresponding location.

5. The method of claim 4 , wherein, when the luminance reference region is unavailable, the unavailable luminance reference region is replaced with an adjacent region of the unavailable luminance reference region in a right or bottom direction.

6. The method of claim 4 , wherein the number of the horizontal sample lines belonging to the top luminance reference region is different from the number of the vertical sample lines belonging to the left luminance reference region.

7. A method of transmitting a bitstream generated by an encoding method, the encoding method comprising:

predicting a chrominance block based on a luminance block corresponding to the chrominance block and a luminance reference region adjacent to the luminance block;

obtaining a residual block of the chrominance block based on an original block of the chrominance block and a predicted chrominance block obtained by predicting the chrominance block; and

generating the bitstream by encoding the residual block,

wherein the bitstream includes a flag indicating whether to encode the chrominance block based on the luminance block and the luminance reference region,

wherein the luminance reference region includes a top luminance reference region adjacent to a top boundary of the luminance block and a left luminance reference region adjacent to a left boundary of the luminance block,

wherein the top luminance reference region includes a plurality of horizontal sample lines,

wherein the left luminance reference region includes a plurality of vertical sample lines,

wherein a number of the horizontal sample lines belonging to the top luminance reference region is variably determined based on an availability of the top luminance reference region,

wherein a number of the vertical sample lines belonging to the left luminance reference region is variably determined based on an availability of the left luminance reference region,

wherein a second prediction sample of the predicted chrominance block is obtained based on compensation parameters including a weight and an offset,

wherein the second prediction sample is obtained by multiplying a first prediction sample by the weight and summing the offset,

wherein the first prediction sample is obtained by predicting the luminance block,

wherein the compensation parameters are calculated based on a representative luminance value of a luminance reference region adjacent to the luminance block and a representative chrominance value of chrominance reference region adjacent to the chrominance block,

wherein the representative luminance value is derived to be one or more of average values, minimum values, maximum values or median values of some of samples belonging to the luminance reference region, and

wherein the representative chrominance value is derived from a luminance value of the luminance reference region at a corresponding location.

8. The method of claim 7 , wherein the number of the horizontal sample lines belonging to the top luminance reference region is different from the number of the vertical sample lines belonging to the left luminance reference region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2024
From: SIM, DONG GYU; PARK, SEA NAE
To: KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
Reel/Frame 066217/0940 →
Continuity (4)
Continuation 17196880 · Mar 9, 2021
Continuation 16590305 · Oct 1, 2019
Continuation 16184350 · Nov 8, 2018
Related Publication 20230370592A1 · Nov 16, 2023
References Cited (53)
US 9674521B2 · Lee et al. · 2017 [cited by applicant]
US 10477205B1 · Sim · 2019 [cited by examiner]
US 10972727B2 · Sim · 2021 [cited by examiner]
US 11297351B2 · Baylon et al. · 2022 [cited by applicant]
US 11765348B2 · Sim · 2023 [cited by examiner]
US 20040062445A1 · Kim et al. · 2004 [cited by applicant]
US 20130182761A1 · Chen et al. · 2013 [cited by applicant]
US 20130336591A1 · Jeon et al. · 2013 [cited by applicant]
US 20140140401A1 · Lee et al. · 2014 [cited by applicant]
US 20140369426A1 · Li et al. · 2014 [cited by applicant]
US 20160065988A1 · Kawamura et al. · 2016 [cited by applicant]
US 20170105025A1 · Jeon · 2017 [cited by examiner]
US 20170359595A1 · Zhang et al. · 2017 [cited by applicant]
US 20180278940A1 · Park et al. · 2018 [cited by applicant]
US 20190215512A1 · Lee et al. · 2019 [cited by applicant]
CN 103200401A · 2013 [cited by applicant]
CN 103416066A · 2013 [cited by applicant]
CN 105103552A · 2015 [cited by applicant]
CN 107302699A · 2017 [cited by applicant]
CN 107810635A · 2018 [cited by applicant]
JP 2013141187A · 2013 [cited by applicant]
KR 101756843B1 · 2013 [cited by applicant]
KR 20170129750A · 2017 [cited by applicant]
KR 20180033303A · 2018 [cited by applicant]
KR 20180048713A · 2018 [cited by applicant]
WO WO2013169049A1 · 2013 [cited by applicant]
WO 2018066849A1 · 2018 [cited by applicant]
Liu, Shan, Ximin Zhang, and Shawmin Lei. “Rectangular Partitioning for Intra Prediction in HEVC.” Visual Communication and Image Processing (VCIP), 2012 IEEE. IEEE, 2012 (Year: 2012). [cited by examiner]
Kwangwoon University Industry-Academic Collaboration Foundation, First Office Action, CN201980039260.0, Jul. 5, 2023, 16 pgs. [cited by applicant]
Iu, Shan, Ximin Zhang, and Shawmin Lei. “Rectangular partitioning for Intra prediction in HEVC.” Visual Communications and Image Processing (VCIP), 2012 IEEE. IEEE, 2012 (Year: 2012). [cited by applicant]
Zhang, Tao, et al. ““Improving chroma intra prediction for HEVC.”” Multimedia & Expo Workshops (ICMEVV), 2016 EEE International Conference on.IEEE, 2016 (Year: 2016). [cited by applicant]
D. Gyu et al., Korean Notice of Allowance, KR10-2018-0067164, dated Dec. 7, 2018, 4 pgs. [cited by applicant]
K. Zhang, et al. Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding. IEEE Trans. on Image Processing. Apr. 26, 2018. vol. 27, No. 8, pp. 3983-3997. [cited by applicant]
Lee et al., Intra Prediction Mode Dependent Reference Sample Selection Method for Cross-Component Linear Model (2018) Korean Society of Broad Engineers Summer Conference. Jun. 2018, pp. 188-189. [cited by applicant]
X. Zhang, et al. Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC. IEEE Trans. on Image Processing. Jan. 2014. vol. 23, No. 1, pp. 274-286. [cited by applicant]
Sim et al., Non Final Office Action, U.S. Appl. No. 16/184,350, Feb. 14, 2019, 14 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 16/184,350, Jul. 2, 2019, 8 pgs. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 16/590,305, Aug. 21, 2020, 17 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 16/590,305, Dec. 10, 2020, 8 pgs. [cited by applicant]
Kwangwoon University Industry-University Cooperation Foundation, International Search Report, PCT/KR2019/006959, Jun. 10, 2019, 3 pgs. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 17/196,880, Jun. 22, 2022, 26 pgs. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 17/196,880, Dec. 19, 2022, 33 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 17/196,880, Apr. 19, 2023, 10 pgs. [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Office Action, Korean Application No. 10-2019-0025175, Jul. 1, 2021, 4 pgs. [cited by applicant]
J. Chen, et al. Algorithm Description of Joint Exploration Test Model 7 (JEM 7). JVET of ITU-T and ISO/IEC. JVET-G1001 Ver.1, Aug. 19, 2017, pp. 1-44. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 17/196,880, Jul. 19, 2023, 10 pgs. [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Final Rejection, Korean Application No. 10-2022-0047607, Feb. 23, 2023, 4 pgs. [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Written Opinion, Korean Application No. 10-2022-0047607, May 18, 2023, 7 pgs. [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Final Rejection, Korean Application No. 10-2022-0047607, Jun. 16, 2023, 4 pgs. [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Office Action, Korean Application No. 10-2022-0047607, Jun. 13, 2022, 5 pgs. [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Korean Notice of Allowance, KR Patent Application No. 10-2023-0124076, Jan. 22, 2024, 9 pgs. [cited by applicant]
Huanbang Chen et al., “Description of SDR, HDR and 360° Video Coding Technology Proposal by Huawei, GoPro, HiSilicon, and Samsung”, Document: JVET-J0025_v2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and IS… [cited by applicant]
Kwangwoon University Industry-Academic Collaboration Foundation, Chinese Office Action, CN Patent Application No. 201980039260.0, Jun. 19, 2024, 9 pgs. [cited by applicant]