IP Library › Granted Patent US 12,301,842
Granted Patent B2
US 12,301,842 · App. 18/337,356 · Granted May 13, 2025

Method, device and system for encoding and decoding image

Inventors: Yoon Sik Choe (Goyang-Si, KR); Jang Won Choi (Incheon, KR)
Assignee: IDEAHUB INC.
H04N19/186H04N19/117H04N19/80H04N19/11H04N19/182H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,842
App. No.
18/337,356
Granted
May 13, 2025
Kind
B2
Abstract

Disclosed are methods, apparatuses, and systems for encoding and decoding an image. The present invention provides an intra prediction unit receives an input image, removes high frequency ingredients by low pass filtering an encoded luma pixel value in the input image during intra prediction, and generates a prediction block by predicting a chroma pixel value by using a low pass filter (LPF) LM chroma mode for applying an LM chroma mode, which is an extended chroma mode technique for generating a prediction block by predicting the chroma pixel value by applying a correlation between color planes to the luma pixel value having removed therefrom the high frequency ingredients.

Claims (43)

1. An image encoding method employed by an image encoding apparatus comprising a processor, the method comprising:

selecting one of an intra prediction mode and an inter prediction mode as a prediction mode of a current block; and

predicting, in response to the intra prediction mode being selected as the prediction mode of the current block, a chroma pixel of the current block based on one of a plurality of LMmode candidates of a LMmode, the LMmode representing that chroma pixels are predicted by luma pixels,

wherein a flag specifying whether the LMmode is applied to the current block is encoded into a bitstream,

wherein, in response to the flag specifying that the LMmode is applied to the current block, index information specifying the one of the plurality of LMmode candidates selected for the current block is additionally encoded into the bitstream, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein predicting the chroma pixel of the current block comprises:

obtaining a first filtered luma value to predict the chroma pixel;

obtaining a weight and an offset based on a linear relationship between luma pixels and chroma pixels; and

predicting the chroma pixel based on the first filtered luma value, the weight and the offset,

wherein, under the first LMmode, the weight and the offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein a horizontal neighboring luma pixel adjacent to a co-located luma pixel is relied on to derive the first filtered luma value and the co-located luma pixel having a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation using the co-located luma pixel and the horizontal neighboring luma pixel, and

wherein the chroma pixel is predicted by an equation C pred [x, y]=αG recon lpf [x, y]+β (wherein, G recon lpf [x, y] denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

2. The method of claim 1 , wherein the horizontal neighboring luma pixel comprises at least one of a left neighboring luma pixel and a right neighboring luma pixel.

3. An image decoding method employed by an image decoding apparatus comprising a processor, the method comprising:

determining a prediction mode of a current block as one of an intra prediction mode and an inter prediction mode; and

determining, in response to the prediction mode of the current block being the intra prediction mode, whether a LMmode that represents that a chroma pixel is predicted by a luma pixel is applied to the current block based on a flag parsed from a bitstream;

selecting one of a plurality of LMmode candidates of the LMmode; and

predicting the chroma pixel of the current block according to the selected LMmode candidate,

wherein when it is determined that the LMmode is applied to the current block, index information is additionally parsed from the bitstream, the index information specifies the one of the plurality of LMmode candidates applied to the current block, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein predicting the chroma pixel of the current block comprises:

obtaining a first filtered luma value to predict the chroma pixel;

obtaining a weight and an offset based on a linear relationship between luma pixels and chroma pixels; and

predicting the chroma pixel based on the first filtered luma value, the weight and the offset,

wherein, under the first LMmode, the weight and the offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein a horizontal neighboring luma pixel adjacent to a co-located luma pixel is relied on to derive the first filtered luma value, and the co-located luma pixel has a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation using the co-located luma pixel and the horizontal neighboring luma pixel; and

wherein the chroma pixel is predicted by an equation C pred [x, y]=αG recon lpf [x, y]+β (wherein, G recon lpf [x, y] denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

4. The method of claim 3 , wherein the horizontal neighboring luma pixel comprises at least one of a left neighboring luma pixel and a right neighboring luma pixel.

5. A method of transmitting a bitstream generated by an encoding method, the encoding method comprising:

selecting one of an intra prediction mode and an inter prediction mode as a prediction mode of a current block; and

predicting, in response to the intra prediction mode being selected as the prediction mode of the current block, a chroma pixel of the current block based on one of a plurality of LMmode candidates of a LMmode, the LMmode representing that chroma pixels are predicted by luma pixels,

wherein a flag specifying whether the LMmode is applied to the current block is encoded into the bitstream,

wherein, in response to the flag specifying that the LMmode is applied to the current block, index information specifying the one of the plurality of LMmode candidates selected for the current block is additionally encoded into the bitstream, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein predicting the chroma pixel of the current block comprises:

obtaining a first filtered luma value to predict the chroma pixel;

obtaining a weight and an offset based on a linear relationship between luma pixels and chroma pixels; and

predicting the chroma pixel based on the first filtered luma value, the weight and the offset,

wherein, under the first LMmode, the weight and the offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein a horizontal neighboring luma pixel adjacent to a co-located luma pixel is relied on to derive the first filtered luma value and the co-located luma pixel having a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation using the co-located luma pixel and the horizontal neighboring luma pixel, and

wherein the chroma pixel is predicted by an equation C pred [x, y]=αG recon lpf [x, y]+β (wherein, G recon lpf [x, y] denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

6. The method of claim 5 , wherein the horizontal neighboring luma pixel comprises at least one of a left neighboring luma pixel and a right neighboring luma pixel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: UNIVERSITY INDUSTRY FOUNDATION OF YONSEI UNIVERSITY
To: IDEAHUB INC.
Reel/Frame 069169/0538 →
Priority Claims (1)
KR 10-2013-0116220 · Sep 30, 2013 · national
Continuity (4)
Continuation 17576610 · Jan 14, 2022
Continuation 17138076 · Dec 30, 2020
Continuation 15026154
Related Publication 20230353761A1 · Nov 2, 2023
References Cited (37)
US 7227585B1 · Murdock et al. · 2007 [cited by applicant]
US 9288500B2 · Budagavi · 2016 [cited by applicant]
US 9307237B2 · Liu · 2016 [cited by examiner]
US 9351001B2 · Yang et al. · 2016 [cited by applicant]
US 9948938B2 · Gupte et al. · 2018 [cited by applicant]
US 10158882B2 · Choe et al. · 2018 [cited by applicant]
US 20060245660A1 · Hung · 2006 [cited by applicant]
US 20070115384A1 · Furukawa · 2007 [cited by examiner]
US 20080284792A1 · Bell et al. · 2008 [cited by applicant]
US 20090297054A1 · Regunathan et al. · 2009 [cited by applicant]
US 20100208993A1 · Sambongi · 2010 [cited by applicant]
US 20120328013A1 · Budagavi et al. · 2012 [cited by applicant]
US 20130114706A1 · Gisquet · 2013 [cited by examiner]
US 20130182761A1 · Chen et al. · 2013 [cited by applicant]
US 20130188703A1 · Liu · 2013 [cited by examiner]
US 20130188883A1 · Gisquet · 2013 [cited by examiner]
US 20130336591A1 · Jeon · 2013 [cited by examiner]
US 20140078394A1 · Lou et al. · 2014 [cited by applicant]
US 20140140401A1 · Lee et al. · 2014 [cited by applicant]
US 20140314142A1 · Oh et al. · 2014 [cited by applicant]
US 20150003524A1 · Yamamoto et al. · 2015 [cited by applicant]
US 20150063460A1 · Gamei et al. · 2015 [cited by applicant]
US 20150078447A1 · Gamei et al. · 2015 [cited by applicant]
US 20150341636A1 · Tsai et al. · 2015 [cited by applicant]
US 20160241861A1 · Choe et al. · 2016 [cited by applicant]
JP 2009538086A · 2009 [cited by applicant]
JP 4989048B2 · 2012 [cited by applicant]
KR 1019980074945A · 1998 [cited by applicant]
KR 1020070072327A · 2007 [cited by applicant]
KR 1020120003147A · 2012 [cited by applicant]
KR 1020120041287A · 2012 [cited by applicant]
KR 1020130004214A · 2013 [cited by applicant]
KR 1020130044263A · 2013 [cited by applicant]
KR 1020130078320A · 2013 [cited by applicant]
B.K. Gunturk et al., Color plane interpolation using alternating projections, IEEE Transactions on Image Processing, pp. 997-1013, (vol. 11, Issue: 9, Sep. 2002). [cited by applicant]
Jianle Chen, et al., CE6.a.4: Chroma intra prediction by reconstructed luma samples, Document: JCTVC-E266, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting: Gen… [cited by applicant]
Jungsun Kim, RCE1: The performance of extended chroma for non 4:2:0 format, Document: JCTVC-M0097, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC I/SC 29/WG 11, 13th Meeting: Incheon… [cited by applicant]