IP Library Granted Patent US 9,942,563
Granted Patent B2
US 9,942,563 · App. 14/779,838 · Granted Apr 10, 2018

Video encoding using subsampling to reduce number of reference pixels

Inventors: Kei Kawamura (Tokyo, JP); Sei Naito (Saitama, JP)
Assignee: KDDI CORPORATION
H04N19/59H04N9/8045H04N19/105H04N19/119H04N19/157H04N19/182H04N19/186H04N19/44H04N19/593H04N19/122H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,942,563
App. No.
14/779,838
Granted
Apr 10, 2018
Kind
B2
Abstract

An intra prediction unit that performs intra-frame prediction includes a luminance reference pixel acquisition unit and a chrominance reference pixel acquisition unit. When the coding unit is set to a smallest CU block, the luminance reference pixel acquisition unit subsamples reference pixels arranged at integer pixel locates neighboring a luminance block that corresponds to a chrominance prediction target block, and acquires the pixel values of the reference pixels after the subsampling. Furthermore, when the coding unit is set to a smallest CU block, the chrominance reference pixel acquisition unit subsamples reference pixels arranged at integer pixel locates neighboring the chrominance prediction target block, and acquires the pixel values of the reference pixels after the subsampling. Such an arrangement is capable of reducing the number of reference pixels used to reduce the redundancy between the color components.

Claims (54)

1. A video encoding apparatus that encodes a video configured comprising a plurality of color components, the video encoding apparatus comprising an intra frame prediction unit that performs intra frame prediction, wherein the intra frame prediction unit comprises:

a luminance reference pixel subsampling unit that, in subsamples reference pixels located neighboring a luminance block that corresponds to a chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the luminance block consecutively from the left;

a luminance reference pixel acquisition unit that acquires pixel values of the reference pixels after the subsampling by means of the luminance reference pixel subsampling unit;

a chrominance reference pixel subsampling unit that, in subsamples the reference pixels located neighboring the chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the chrominance prediction target block consecutively from the left;

a chrominance reference pixel acquisition unit that acquires pixel values of the reference pixels after the subsampling by means of the chrominance reference pixel subsampling unit;

a prediction coefficient derivation unit that derives a prediction coefficient based on the pixel values acquired by the luminance reference pixel acquisition unit and the pixel values acquired by the chrominance reference pixel acquisition unit; and

a chrominance linear prediction unit that calculates a predicted pixel value in a linear manner for each pixel that forms the chrominance prediction target block based on a local decoded pixel value of the luminance block that corresponds to the chrominance prediction target block and the prediction coefficient derived by the prediction coefficient derivation unit,

wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing only when a smallest coding unit prepared beforehand is selected as a coding unit.

2. The video encoding apparatus according to claim 1 , wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing at all times regardless of a coding unit size.

3. The video encoding apparatus according to claim 1 , wherein the luminance reference pixel subsampling unit subsamples the reference pixels located neighboring a luminance block that corresponds to the chrominance prediction target block such that the number of reference pixels is reduced to half of an original number of reference pixels,

and wherein the chrominance reference pixel subsampling unit subsamples the reference pixels located neighboring the chrominance prediction target block such that the number of reference pixels is reduced to half of an original number of reference pixels.

4. A video decoding apparatus that decodes a video configured comprising a plurality of color components, the video decoding apparatus comprising an intra frame prediction unit that performs intra frame prediction, wherein the intra frame prediction unit comprises:

a luminance reference pixel subsampling unit that, in subsamples reference pixels located neighboring a luminance block that corresponds to a chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the luminance block consecutively from the left;

a luminance reference pixel acquisition unit that acquires pixel values of the reference pixels after the subsampling by means of the luminance reference pixel subsampling unit;

a chrominance reference pixel subsampling unit that, in subsamples the reference pixels located neighboring the chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the chrominance prediction target block consecutively from the left;

a chrominance reference pixel acquisition unit that acquires pixel values of the reference pixels after the subsampling by means of the chrominance reference pixel subsampling unit;

a prediction coefficient derivation unit that derives a prediction coefficient based on the pixel values acquired by the luminance reference pixel acquisition unit and the pixel values acquired by the chrominance reference pixel acquisition unit; and

a chrominance linear prediction unit that calculates a predicted pixel value in a linear manner for each pixel that forms the chrominance prediction target block based on a local decoded pixel value of the luminance block that corresponds to the chrominance prediction target block and the prediction coefficient derived by the prediction coefficient derivation unit,

wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing only when a smallest coding unit prepared beforehand is selected as a coding unit.

5. The video decoding apparatus according to claim 4 , wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing at all times regardless of a coding unit size.

6. The video decoding apparatus according to claim 4 , wherein the luminance reference pixel subsampling unit subsamples the reference pixels located neighboring a luminance block that corresponds to the chrominance prediction target block such that the number of reference pixels is reduced to half of an original number of reference pixels,

and wherein the chrominance reference pixel subsampling unit subsamples the reference pixels located neighboring the chrominance prediction target block such that the number of reference pixels is reduced to half of an original number of reference pixels.

7. A video encoding method used by a video encoding apparatus comprising an intra-frame prediction unit, which comprises a luminance reference pixel subsampling unit, a luminance reference pixel acquisition unit, a chrominance reference pixel subsampling unit, a chrominance reference pixel acquisition unit, a prediction coefficient derivation unit, and a chrominance linear prediction unit, and which is configured to encode a video comprising a plurality of color components, wherein the video encoding method comprises:

first processing in which the luminance reference pixel subsampling unit subsamples reference pixels located neighboring a luminance block that corresponds to a chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the luminance block consecutively from the left;

second processing in which the luminance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the luminance reference pixel subsampling unit;

third processing in which the chrominance reference pixel subsampling unit subsamples the reference pixels located neighboring the chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the chrominance prediction target block consecutively from the left;

fourth processing in which the chrominance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the chrominance reference pixel subsampling unit;

fifth processing in which the prediction coefficient derivation unit derives a prediction coefficient based on the pixel values acquired by the luminance reference pixel acquisition unit and the pixel values acquired by the chrominance reference pixel acquisition unit; and

sixth processing in which the chrominance linear prediction unit calculates a predicted pixel value in a linear manner for each pixel that forms the chrominance prediction target block based on a local decoded pixel value of the luminance block that corresponds to the chrominance prediction target block and the prediction coefficient derived by the prediction coefficient derivation unit,

wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing only when a smallest coding unit prepared beforehand is selected as a coding unit.

8. A video decoding method used by a video decoding apparatus comprising an intra-frame prediction unit, which comprises a luminance reference pixel subsampling unit, a luminance reference pixel acquisition unit, a chrominance reference pixel subsampling unit, a chrominance reference pixel acquisition unit, a prediction coefficient derivation unit, and a chrominance linear prediction unit, and which is configured to decode a video comprising a plurality of color components, wherein the video decoding method comprises:

first processing in which the luminance reference pixel subsampling unit subsamples reference pixels located neighboring a luminance block that corresponds to a chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the luminance block consecutively from the left;

second processing in which the luminance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the luminance reference pixel subsampling unit;

third processing in which the chrominance reference pixel subsampling unit subsamples the reference pixels located neighboring the chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the chrominance prediction target block consecutively from the left;

fourth processing in which the chrominance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the chrominance reference pixel subsampling unit;

fifth processing in which the prediction coefficient derivation unit derives a prediction coefficient based on the pixel values acquired by the luminance reference pixel acquisition unit and the pixel values acquired by the chrominance reference pixel acquisition unit; and

sixth processing in which the chrominance linear prediction unit calculates a predicted pixel value in a linear manner for each pixel that forms the chrominance prediction target block based on a local decoded pixel value of the luminance block that corresponds to the chrominance prediction target block and the prediction coefficient derived by the prediction coefficient derivation unit,

wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing only when a smallest coding unit prepared beforehand is selected as a coding unit.

9. A computer program product including a non-transitory computer readable medium storing a program which, when executed by a computer, causes the computer to perform a video encoding method used by a video encoding apparatus comprising an intra-frame prediction unit, which comprises a luminance reference pixel subsampling unit, a luminance reference pixel acquisition unit, a chrominance reference pixel subsampling unit, a chrominance reference pixel acquisition unit, a prediction coefficient derivation unit, and a chrominance linear prediction unit, and which is configured to encode a video comprising a plurality of color components, wherein the video encoding method comprises:

first processing in which the luminance reference pixel subsampling unit subsamples reference pixels located neighboring a luminance block that corresponds to a chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the luminance block consecutively from the left;

second processing in which the luminance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the luminance reference pixel subsampling unit;

third processing in which the chrominance reference pixel subsampling unit subsamples the reference pixels located neighboring the chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the chrominance prediction target block consecutively from the left;

fourth processing in which the chrominance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the chrominance reference pixel subsampling unit;

fifth processing in which the prediction coefficient derivation unit derives a prediction coefficient based on the pixel values acquired by the luminance reference pixel acquisition unit and the pixel values acquired by the chrominance reference pixel acquisition unit; and

sixth processing in which the chrominance linear prediction unit calculates a predicted pixel value in a linear manner for each pixel that forms the chrominance prediction target block based on a local decoded pixel value of the luminance block that corresponds to the chrominance prediction target block and the prediction coefficient derived by the prediction coefficient derivation unit,

wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing only when a smallest coding unit prepared beforehand is selected as a coding unit.

10. A computer program product including a non-transitory computer readable medium storing a program which, when executed by a computer, causes the computer to perform a video decoding method used by a video decoding apparatus comprising an intra-frame prediction unit, which comprises a luminance reference pixel subsampling unit, a luminance reference pixel acquisition unit, a chrominance reference pixel subsampling unit, a chrominance reference pixel acquisition unit, a prediction coefficient derivation unit, and a chrominance linear prediction unit, and which is configured to decode a video comprising a plurality of color components, wherein the video decoding method comprises:

first processing in which the luminance reference pixel subsampling unit subsamples reference pixels located neighboring a luminance block that corresponds to a chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the luminance block consecutively from the left;

second processing in which the luminance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the luminance reference pixel subsampling unit;

third processing in which the chrominance reference pixel subsampling unit subsamples the reference pixels located neighboring the chrominance prediction target block, the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the left side or from the left side to the left by every other column consecutively from the uppermost, and the number of reference pixels is reduced to half of an original number of reference pixels adjacent to the upper side of the chrominance prediction target block consecutively from the left;

fourth processing in which the chrominance reference pixel acquisition unit acquires pixel values of the reference pixels after the subsampling by means of the chrominance reference pixel subsampling unit;

fifth processing in which the prediction coefficient derivation unit derives a prediction coefficient based on the pixel values acquired by the luminance reference pixel acquisition unit and the pixel values acquired by the chrominance reference pixel acquisition unit; and

sixth processing in which the chrominance linear prediction unit calculates a predicted pixel value in a linear manner for each pixel that forms the chrominance prediction target block based on a local decoded pixel value of the luminance block that corresponds to the chrominance prediction target block and the prediction coefficient derived by the prediction coefficient derivation unit,

wherein the luminance reference pixel subsampling unit and the chrominance reference pixel subsampling unit each perform the subsampling processing only when a smallest coding unit prepared beforehand is selected as a coding unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2016
From: KAWAMURA, KEI; NAITO, SEI
To: KDDI CORPORATION
Reel/Frame 039928/0092 →
Priority Claims (1)
JP 2013-070215 · Mar 28, 2013 · national
Continuity (1)
Related Publication 20160065988A1 · Mar 3, 2016