IP Library Granted Patent US 10,904,539
Granted Patent B2
US 10,904,539 · App. 15/026,154 · Granted Jan 26, 2021

Method, device and system for encoding and decoding image

Inventors: Yoon Sik Choe (Gyeonggi-do, KR); Jang Won Choi (Incheon, KR)
Assignee: UNIVERSITY-INDUSTRY FOUNDATION(UIF), YONSEI UNIVERSITY
H04N19/186H04N19/117H04N19/80H04N19/11H04N19/182H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,904,539
App. No.
15/026,154
Granted
Jan 26, 2021
Kind
B2
Abstract

Disclosed are methods, apparatuses, and systems for encoding and decoding an image. The present invention provides an intra prediction unit receives an input image, removes high frequency ingredients by low pass filtering an encoded luma pixel value in the input image during intra prediction, and generates a prediction block by predicting a chroma pixel value by using a low pass filter (LPF) LM chroma mode for applying an LM chroma mode, which is an extended chroma mode technique for generating a prediction block by predicting the chroma pixel value by applying a correlation between color planes to the luma pixel value having removed therefrom the high frequency ingredients.

Claims (45)

1. An image encoding apparatus comprising: a processor that functions as an intra predictor; and

the intra predictor determining whether a LMmode that represents that chroma pixels are predicted by luma pixels is applied to a current block, selecting one of a plurality of LMmode candidates when it is determined that the LMmode is applied to the current block, and predicting a chroma pixel of the current block according to the selected LMmode candidate,

wherein a flag specifying whether the LMmode is applied to the current block is encoded into a bitstream,

wherein when the LMmode is applied to the current block, index information specifying one of the plurality of LMmode candidates selected for the current block is additionally encoded into the bitstream, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein prediction of the chroma pixel is performed based on a first filtered luma value, a weight and an offset,

wherein, under the first LMmode, the weight and offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein both a horizontal neighboring luma pixel and a vertical neighboring luma pixel adjacent to a co-located luma pixel are relied on to derive the first filtered luma value, and the co-located luma pixel has a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation of the co-located luma pixel, the horizontal neighboring luma pixel and the vertical neighboring luma pixel; and

wherein the intra predictor predicts the chroma pixel by an equation C pred [x,y]=αG recon lpf [x,y]+β (wherein, G lpf recon denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

2. The apparatus of claim 1 , wherein the horizontal neighboring luma pixel comprises at least one of a left neighboring luma pixel and a right neighboring luma pixel, and the vertical neighboring luma pixel comprises at least one of a top neighboring luma pixel and a bottom neighboring luma pixel.

3. An image decoding apparatus comprising: a processor that functions as an intra predictor; and

the intra predictor determining whether a LMmode that represents that a chroma pixel is predicted by a luma pixel is applied to a current block, selecting one of a plurality of LMmode candidates when it is determined that the LMmode is applied to the current block, and predicting the chroma pixel of the current block according to the selected LMmode candidate,

wherein whether the LMmode is applied to the current block is determined based on a flag parsed from a bitstream,

wherein when it is determined that the LMmode is applied to the current block, index information is additionally parsed from the bitstream, the index information specifies one of the plurality of LMmode candidates applied to the current block, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein prediction of the chroma pixel is performed based on a first filtered luma value, a weight and an offset,

wherein the weight and the offset are obtained based on a linear relationship between luma pixels and chroma pixels,

wherein, under the first LMmode, the weight and offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein both a horizontal neighboring luma pixel and a vertical neighboring lima pixel adjacent to a co-located luma pixel are relied on to derive the first filtered luma value and the co-located luma pixel having a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation of the co-located luma pixel, the horizontal neighboring luma pixel and the vertical neighboring luma pixel; and

wherein the intra predictor predicts the chroma pixel by an equation C pred [x,y]=αG recon lpf [x,y]+β (wherein, G lpf recon denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

4. An image encoding method employed by an image encoding apparatus comprising a processor, the method comprising:

determining whether a LMmode that represents that a chroma pixel is predicted by a luma pixel is applied to a current block;

selecting one of a plurality of LMmode candidates when it is determined that the LMmode is applied to the current block: and

predicting the chroma pixel of the current block according to the selected LMmode candidate,

wherein a flag specifying whether the LMmode is applied to the current block is encoded into a bitstream,

wherein when the LMmode is applied to the current block, index information specifying one of the plurality of LMmode candidates selected for the current block is additionally encoded into the bitstream, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein predicting the chroma pixel of the current block comprises:

obtaining a first filtered luma value to predict a chroma pixel;

obtaining a weight and an offset based on a linear relationship between luma pixels and chroma pixels; and

predicting the chroma pixel based on the first filtered luma value, the weight and the offset, wherein, under the first LMmode, the weight and offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein both a horizontal neighboring luma pixel and a vertical neighboring luma pixel adjacent to a co-located luma pixel are relied on to derive the first filtered luma value and the co-located luma pixel having a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation of the co-located luma pixel, the horizontal neighboring luma pixel and the vertical neighboring luma pixel; and

wherein the chroma pixel is predicted by an equation C pred [x,y]=αG recon lpf [x,y]+β (wherein, G lpf recon denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

5. An image decoding method employed by an image decoding apparatus comprising a processor, the method comprising:

determining whether a LMmode that represents that a chroma pixel is predicted by a luma pixel is applied to a current block based on a flag parsed from a bitstream;

selecting one of a plurality of LMmode candidates when it is determined that the LMmode is applied to the current block; and

predicting the chroma pixel of the current block according to the selected LMmode candidate,

wherein when it is determined that the LMmode is applied to the current block, index information is additionally parsed from the bitstream, the index information specifies one of the plurality of LMmode candidates applied to the current block, and the plurality of LMmode candidates comprises a first LMmode and a second LMmode,

wherein predicting the chroma pixel of the current block comprises:

obtaining a first filtered luma value to predict the chroma pixel;

obtaining a weight and an offset based on a linear relationship between luma pixels and chroma pixels; and

predicting the chroma pixel based on the first filtered luma value, the weight and the offset, wherein, under the first LMmode, the weight and offset are obtained based on a second filtered luma value, while, under the second LMmode, the weight and the offset are obtained in absence of the second filtered luma value,

wherein both of a horizontal neighboring luma pixel and a vertical neighboring luma pixel adjacent to a co-located luma pixel are relied on to derive the first filtered luma value, and the co-located luma pixel has a position corresponding to the chroma pixel,

wherein the first filtered luma value is obtained based on a weighted sum operation of the co-located luma pixel, the horizontal neighboring luma pixel and the vertical neighboring luma pixel; and

wherein the chroma pixel is predicted by an equation C pred [x,y]=αG recon lpf [x,y]+β (wherein, G lpf recon denotes the first filtered luma value, α denotes the weight, and β denotes the offset), and wherein the second filtered luma value is obtained based on a neighboring luma pixel.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2021
From: UNIVERSITY INDUSTRY FOUNDATION OF YONSEI UNIVERSITY
To: IDEAHUB INC.
Reel/Frame 056358/0816 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2016
From: CHOE, YOON SIK; CHOI, JANG WON
To: UNIVERSITY-INDUSTRY FOUNDATION (UIF), YONSEI UNIVERSITY
Reel/Frame 038879/0223 →
Priority Claims (1)
KR 10-2013-0116220 · Sep 30, 2013 · national
Continuity (1)
Related Publication 20160241861A1 · Aug 18, 2016