IP Library Granted Patent US 11,070,815
Granted Patent B2
US 11,070,815 · App. 16/619,244 · Granted Jul 20, 2021

Method and apparatus of intra-inter prediction mode for video coding

Inventors: Chen-Yen Lai (Hsinchu, TW); Ching-Yeh Chen (Hsinchu, TW); Chih-Wei Hsu (Hsinchu, TW); Yu-Wen Huang (Hsinchu, TW)
Assignee: MEDIATEK INC.
H04N19/159H04N19/126H04N19/176H04N19/503H04N19/55H04N19/593H04N19/182H04N19/573
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,070,815
App. No.
16/619,244
Granted
Jul 20, 2021
Kind
B2
Abstract

Method and apparatus of video coding are disclosed. According to the method, a boundary region in the current block is determined. For each pixel in the boundary region, an Intra predictor and an Inter predictor care derived. An Intra-Inter predictor is generated by blending the Intra predictor and the Inter predictor. Pixels in the boundary region of the current block are encoded or decoded using the Intra-Inter predictor. For the remaining pixels in the current block not belonging to the boundary region, the pixels are encoded or decoded using the Inter predictor or the Intra predictor. In another method, the Intra-Inter prediction process is implemented by scaling the sum of the Intra weighting factor and the Inter weighting factor is scaled to a power-of-2 number to avoid the need for the division operation. In yet another method, the Intra-Inter prediction is applied depending on the current block size.

Claims (49)

1. A method of video coding performed by a video encoder or a video decoder, the method comprising:

receiving input data associated with a current block in a current picture at an encoder side or receiving a video bitstream including compressed data of the current block at a decoder side:

deriving an Intra predictor from Infra reference pixels, the Intra reference pixels being in the current picture located above a top boundary of the current block or on a left side of a left boundary of the current block, and the Intra reference pixels being coded prior to the current block;

deriving an Inter predictor comprising Inter reference pixels located in a reference block in a reference picture, the reference block being coded prior to the current block:

generating a weighted sum of the Intra predictor and the Inter predictor, comprising:

multiplying the Intra predictor with an Intra weighting factor to obtain a weighted Intra predictor:

multiplying the Triter predictor with an Inter weighting factor to obtain a weighted Inter predictor; and

adding the weighted Intra predictor and the weighted Inter predictor,

wherein a sum of the Intra weighting factor and the Inter weighting factor is a power-of-2 number;

generating a normalized Intra-Inter predictor by applying a right-shift operation by a number of bit or bits to the weighted sum of the Intra predictor and the Inter predictor. the number being log-base-2 of the sum of the Intra weighting factor and the Inter weighting factor: and

encoding or decoding the current block using the normalized Intra-Inter predictor.

2. The method of claim 1 , wherein the generating a-the weighted sum of the Intra predictor and the Inter predictor further comprises

adding a bias to a result of the adding the weighted Intra predictor and the weighted Inter predictor.

3. An apparatus of video coding in a video coding system, the apparatus comprising one or more electronic devices or processors configured to:

receive input data associated with a current block in a current picture at an encoder side or receiving a video bitstream including compressed data of the current block at a decoder side;

derive an Intra predictor from Infra. reference pixels, wherein the Intra reference pixels being in the current picture located above a top boundary of the current block or on a left side of a left boundary of the current block, and the Intra reference pixel being coded prior to the current block;

derive an Inter predictor comprising Inter reference pixels located in a reference block in a reference picture, the reference block being coded prior to the current block:

generate a weighted sum of the Intra predictor and the Inter predictor by performing:

multiplying the Intra predictor with an Intra weighting factor to obtain a weighted Intra predictor:

multiplying the Inter predictor with an Inter weighting factor to obtain a weighted Inter predictor; and

adding the weighted Intra predictor and the weighted Inter predictor,

wherein a sum of the Intra weighting factor and the Inter weighting factor is scaled to a power-of-2 number;

generate a normalized Intra-Inter predictor by applying a right-shift operation by a number of bit or bits to the weighted sum of the Intra predictor and the Inter predictor, the number being log-base-2 of the sum of the Intra weighting factor and the Inter weighting factor; and

encode or decode the current block using the normalized Intra-Inter predictor.

4. A method of video coding performed by a video encoder or a video decoder, the method comprising:

receiving input data associated with a current block in a current picture at an encoder side or receiving a video bitstream including compressed data of the current block at a decoder side;

disabling an Intra-Inter prediction mode for the current block if a size of the current block meets one of conditions including (i) being greater than a maximum block size and (ii) being smaller than a minimum block size;

in a case that the Intra-Inter prediction mode is not disabled, determining whether the Intra-Inter prediction mode is selected for the current block;

when the Intra-Inter prediction mode is determined as selected for the current block:

deriving an Intra predictor from Infra reference pixels, the Intra reference pixels being in the current picture located above a top boundary of the current block or on a left side of a left boundary of the current block, and the Intra reference pixel being coded prior to the current block;

deriving an Inter predictor comprising Inter reference pixels located in a reference block in a reference picture, the reference block being coded prior to the current block:

generating an Intra-Inter predictor by blending the Intra predictor and the Inter predictor; and

encoding or decoding the current block using the Intra-Inter predictor; and

when the Intra-Inter prediction mode is determined as disabled or not selected for the current block:

deriving either the Intra predictor or the Inter predictor; and

encoding or decoding the current block using the derived Intra predictor or the derived Inter predictor.

5. An apparatus of video coding in a video coding system, the apparatus comprising one or more electronic devices or processors configured to:

receive input data associated with a current block in a current picture at an encoder side or receiving a video bitstream including compressed data of the current block at a decoder side;

disable an Intra-Inter prediction mode for the current block if a size of the current block meets one of conditions including (i) being greater than a maximum block size and (ii) being smaller than a minimum block size;

in a case that the Intra-Inter prediction mode is not disabled, determine whether the Intra-Inter prediction mode is selected for the current block:

when the Intra-Inter prediction mode is determined as selected for the current block:

derive an Intra predictor from Intra reference pixels, the Intra reference pixels being in the current picture located above a top boundary of the current block or on a left side of a left boundary of the current block, and the Intra reference pixel being coded prior to the current block;

derive an Inter predictor comprising Inter reference pixels located in a reference block in a reference picture, the reference block being coded prior to the current block;

generate an Intra-Inter predictor by blending the Intra predictor and the Inter predictor; and

encode or decode the current block using the Intra-Inter predictor; and

when the Intra-Inter prediction mode is determined as disabled or not selected for the current block:

derive either the Intra predictor or the Inter predictor; and

encode or decode the current block using the derived Intra predictor or the derived Inter predictor.

6. The method of claim 4 , wherein whether the Intra-Inter prediction mode is selected for the current block is specified by a block level flag.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2022
From: MEDIATEK INC.
To: HFI INNOVATION INC.
Reel/Frame 059369/0481 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2019
From: LAI, CHEN-YEN; CHEN, CHING-YEH; HSU, CHIH-WEI; HUANG, YU-WEN
To: MEDIATEK INC.
Reel/Frame 051375/0840 →
Continuity (2)
Provisional Application 62516157 · Jun 7, 2017
Related Publication 20200204824A1 · Jun 25, 2020
Cited By (6)
US 12,363,286 US 12,363,287 US 12,375,649 US 12,395,622 US 12,581,066 US 12,713,024