IP Library Granted Patent US 11,051,021
Granted Patent B2
US 11,051,021 · App. 16/644,525 · Granted Jun 29, 2021

Coding device predicting chrominance based on downsampled luminance

Inventors: Tomoko Aono (Sakai, JP); Tomohiro Ikai (Sakai, JP); Takeshi Chujoh (Sakai, JP)
Assignees: SHARP KABUSHIKI KAISHA; FG Innovation Company Limited
H04N19/132H04N19/105H04N19/117H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,051,021
App. No.
16/644,525
Granted
Jun 29, 2021
Kind
B2
Abstract

The coding efficiency and the amount of processing can be further improved in methods that use the correlation between spatial and temporal directions to estimate parameters that are required for predictions. In LM prediction that predicts pixel values of chrominance, based on pixel values of luminance, an index for a filter that downsamples a luminance image is adaptively signalled.

Claims (26)

1. A decoding device for generating a prediction image of chrominance by using a luminance image, the decoding device comprising:

a decoding circuitry that decodes information related to a downsampling in a sequence parameter set, the information indicating a position relationship between at least one luma pixel and a chroma pixel; and

a predictor that derives (i) a downsampled luminance image derived by downsampling the luminance image of a target block, (ii) a downsampled neighbouring luminance image derived by downsampling a neighbouring luminance image, (iii) a neighbouring chrominance image and (iv) parameters derived from the downsampled neighbouring luminance image and the neighbouring chrominance image, wherein:

each of the downsampled luminance image and the downsampled neighbouring luminance image is derived by using (i) a plurality of first filter coefficients or a plurality of second filter coefficients and (ii) the information,

the plurality of first filter coefficients is used, in a case that a position of the chroma pixel is identical to a position of one of the at least one luma pixel,

the plurality of second filter coefficients is used, in a case that the position of the chroma pixel is located in an intermediate of two of the at least one luma pixel on a left side of a 2×2 luma pixel block, and

the prediction image is derived by using the downsampled luminance image and the parameters.

2. The decoding device of claim 1 , wherein the position of the chroma pixel is located in the intermediate of the two of the at least one luma pixel on the left side of the 2×2 luma pixel block.

3. The decoding device of claim 1 , wherein the position of the chroma pixel is identical to the position of the one of the at least one luma pixel.

4. The decoding device of claim 1 , wherein the downsampled neighbouring luminance image is derived by multiplying each of (i) the luminance image with a target pixel and (ii) the luminance image with a first neighboring pixel, which is located in a horizontal direction for the target pixel, by a corresponding one of the plurality of first filter coefficients.

5. The decoding device of claim 1 , wherein the downsampled neighbouring luminance image is derived by multiplying each of (i) the luminance image with a target pixel, (ii) the luminance image with a first neighboring pixel, which is located in a horizontal direction for the target pixel, (iii) the luminance image with a second neighboring pixel, which is located in a vertical direction for the target pixel and (iv) the luminance image with a pixel, which is located in a diagonal direction for the target pixel, by a corresponding one of the plurality of second filter coefficients.

6. A coding device for generating a prediction image of chrominance by using a luminance image, the decoding device comprising:

a coding circuitry that codes information related to a downsampling in a sequence parameter set, the information indicating a position relationship between at least one luma pixel and a chroma pixel; and

a predictor that derives (i) a downsampled luminance image derived by downsampling the luminance image of a target block, (ii) a downsampled neighbouring luminance image derived by downsampling a neighbouring luminance image, (iii) a neighbouring chrominance image and (iv) parameters derived from the downsampled neighbouring luminance image and the neighbouring chrominance image, wherein:

each of the downsampled luminance image and the downsampled neighbouring luminance image is derived by using (i) a plurality of first filter coefficients or a plurality of second filter coefficients and (ii) the information,

the plurality of first filter coefficients is used, in a case that a position of the chroma pixel is identical to a position of one of the at least one luma pixel,

the plurality of second filter coefficients is used, in a case that the position of the chroma pixel is located in an intermediate of two of the at least one luma pixel on a left side of a 2×2 luma pixel block, and

the prediction image is derived by using the downsampled luminance image and the parameters.

7. A prediction image generation method for generating a prediction image of chrominance by using a luminance image, the prediction image generation method including:

deriving a downsampled luminance image by downsampling the luminance image of a target block, by using (i) a plurality of first filter coefficients or a plurality of second filter coefficients and (ii) information related to a downsampling, the information indicating a position relationship between at least one luma pixel and a chroma pixel,

deriving a downsampled neighbouring luminance image by downsampling a neighbouring luminance image, by using (i) the plurality of first filter coefficients or the plurality of second filter coefficients and (ii) the information,

deriving a neighbouring chrominance image,

deriving parameters derived from the downsampled neighbouring luminance image and the neighbouring chrominance image, and

deriving the prediction image by using the downsampled luminance image and the parameters, wherein:

the plurality of first filter coefficients is used, in a case that a position of the chroma pixel is identical to a position of one of the at least one luma pixel, and

the plurality of second filter coefficients is used, in a case that the position of the chroma pixel is located in an intermediate of two of the at least one luma pixel on a left side of a 2×2 luma pixel block.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2024
From: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
To: SHARP KABUSHIKI KAISHA
Reel/Frame 069027/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2020
From: SHARP KABUSHIKI KAISHA
To: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
Reel/Frame 053248/0064 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: AONO, TOMOKO; IKAI, TOMOHIRO; CHUJOH, TAKESHI
To: SHARP KABUSHIKI KAISHA
Reel/Frame 052023/0097 →
Priority Claims (1)
JP JP2017-176817 · Sep 14, 2017 · national
Continuity (1)
Related Publication 20200296380A1 · Sep 17, 2020
Cited By (3)
US 12,231,655 US 12,278,948 US 12,382,015