IP Library › Granted Patent US 11,425,406
Granted Patent B2
US 11,425,406 · App. 17/356,220 · Granted Aug 23, 2022

Weighting processing of combined intra-inter prediction

Inventors: Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN); Na Zhang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/46H04N19/105H04N19/107H04N19/126H04N19/159H04N19/176H04N19/521H04N19/58H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,425,406
App. No.
17/356,220
Granted
Aug 23, 2022
Kind
B2
Abstract

The present application relates to improved weighting processing of combined intra-inter prediction. A method for processing video includes: determining, during a conversion between a current video block, which is coded in a combined intra and inter prediction (CIIP) mode, of a video and a bitstream representation of the current video block, a weight pair comprising a first weight for a first prediction result of the current video block and a second weight for a second prediction result of the current video block, based on one or more neighboring video blocks to the current video block, wherein the first prediction result is generated by an intra prediction mode and the second prediction result is generated by an inter prediction mode; and determining a prediction result of the current block based on a weighted sum of the first prediction result and the second prediction result.

Claims (68)

1. A method for processing video, comprising:

determining, during a conversion between a current video block, which is coded in a combined intra and inter prediction mode, of a video data and a bitstream, a weight pair comprising a first weight for a first prediction result of the current video block and a second weight for a second prediction result of the current video block, based on one or more neighboring video blocks of the current video block,

wherein the first prediction result is generated by an intra prediction mode, and the second prediction result is generated by an inter prediction mode; and

determining a prediction result of the current block based on a weighted sum of the first prediction result and the second prediction result; and

performing the conversion based on the prediction result,

wherein the weight pair is determined according to a prediction mode of the one or more neighboring video blocks of the current video block,

wherein when at least one neighboring video block of the one or more neighboring video blocks is coded with the combined intra and inter prediction mode, the at least one neighboring video block is treated as a video block coded with an inter prediction mode which is a non-intra prediction mode,

wherein the one or more neighboring video block comprises a video block covering a location (xCb−1, yCb−1+(cbHeight<<a)) and a video block covering a location (xCb−1+(cbWidth<<a), yCb−1), wherein (xCb, yCb) is a location of a top-left sample of the current video block, cbWidth and cbHeight are a width and a height of the current video block, respectively, and a is determined using a cIdx of the current block, wherein cIdx is a variable specifying a color component index for the current block, and wherein the color component index of the current block indicates a color component of the current block is a luma component.

2. The method of claim 1 , wherein the prediction mode of the one or more neighboring video block indicates whether the one or more neighboring video block is coded with an intra prediction mode or a non-intra prediction mode.

3. The method of claim 1 , wherein when the at least one neighboring video block is coded with at least one of an intra block copy mode, a combined intra and inter prediction mode, a geometric partitioning mode, or a palette mode, the at least one neighboring video block is treated as a block coded with non-intra prediction mode.

4. The method of claim 1 , wherein the weight pair is determined further according to a color component of the current video block.

5. The method of claim 4 , wherein a location of the one or more neighboring video blocks is determined on the color component of the current block.

6. The method of any one of claim 1 , wherein the one or more neighboring video blocks comprise at least one of a left neighboring video block or a top neighboring video block.

7. The method of claim 1 , wherein the weight pair is determined according to whether the one or more neighboring video block is available, and wherein a variable checkPredModeY specifying whether availability of the one or more neighboring video block depends on a prediction mode is set to false.

8. The method of claim 1 , wherein in response to the cIdx of the current block being equal to 0, the value of a is set to 0.

9. The method of claim 1 , wherein in response to the cIdx of the current block not being equal to 0, the value of a is set to 1.

10. The method of claim 1 , wherein the weight pair is determined based on two or more neighboring video blocks;

when all of the two or more neighboring video blocks are coded with the intra prediction mode, the weight pair is a first candidate weight pair,

when all of the two or more neighboring video blocks are non-intra prediction mode, the weight pair is a second candidate weight pair different from the first candidate weight pair,

otherwise, the weight pair is a third candidate weight pair different from the first and the second candidate weight pairs.

11. The method of claim 1 , wherein the first candidate weight pair is (3, 1), the second candidate weight is (1, 3) and the third candidate weight pair is (2, 2), wherein for the (x, y), x is the first weight and y is the second weight.

12. The method of claim 1 , wherein the prediction result is obtained by applying the weight pair for the intra prediction result and the inter prediction result as:

P

-

=

(

wInter

*

P_inter

+

wIntra

*

P_intra

+

offset

)

⪢

N

and wherein P_ is the prediction result, P_inter is the first prediction result, P_intra is the second prediction result, (wInter,wIntra) is the weight pair, offset is set to 2.

13. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, during a conversion between a current video block, which is coded in a combined intra and inter prediction mode, of a video data and a bitstream, a weight pair comprising a first weight for a first prediction result of the current video block and a second weight for a second prediction result of the current video block, based on one or more neighboring video blocks of the current video block,

wherein the first prediction result is generated by an intra prediction mode, and the second prediction result is generated by an inter prediction mode;

determine a prediction result of the current block based on a weighted sum of the first prediction result and the second prediction result; and

performing the conversion based on the prediction result,

wherein the weight pair is determined according to a prediction mode of the one or more neighboring video blocks of the current video block,

wherein when at least one neighboring video block of the one or more neighboring video blocks is coded with the combined intra and inter prediction mode, the at least one neighboring video block is treated as a video block coded with an inter prediction mode which is a non-intra prediction mode,

wherein the one or more neighboring video block comprises a video block covering a location (xCb−1, yCb−1+(cbHeight<<a)) and a video block covering a location (xCb−1+(cbWidth<<a), yCb−1), wherein (xCb, yCb) is a location of a top-left sample of the current video block, cbWidth and cbHeight are a width and a height of the current video block, respectively, and a is determined using a cIdx of the current block, wherein cIdx is a variable specifying a color component index for the current block, and wherein the color component index of the current block indicates a color component of the current block is a luma component.

14. The apparatus of claim 13 , wherein the prediction mode of the one or more neighboring video block indicates whether the one or more neighboring video block is coded with an intra prediction mode or a non-intra prediction mode.

15. The apparatus of claim 13 , wherein the prediction mode of the one or more neighboring video block indicates whether the one or more neighboring video block is coded with an intra prediction mode or a non-intra prediction mode.

16. The apparatus of claim 13 , wherein when the at least one neighboring video block is coded with at least one of an intra block copy mode, a combined intra and inter prediction mode, a geometric partitioning mode, or a palette mode, the at least one neighboring video block is treated as a block coded with non-intra prediction mode.

17. The apparatus of claim 13 , wherein the weight pair is determined further according to a color component of the current video block.

18. The apparatus of claim 17 , wherein a location of the one or more neighboring video blocks is determined on the color component of the current block.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, during a conversion between a current video block, which is coded in a combined intra and inter prediction mode, of a video data and a bitstream, a weight pair comprising a first weight for a first prediction result of the current video block and a second weight for a second prediction result of the current video block, based on one or more neighboring video blocks of the current video block,

wherein the first prediction result is generated by an intra prediction mode, and the second prediction result is generated by an inter prediction mode; and

determine a prediction result of the current block based on a weighted sum of the first prediction result and the second prediction result; and

performing the conversion based on the prediction result,

wherein the weight pair is determined according to a prediction mode of the one or more neighboring video blocks of the current video block,

wherein when at least one neighboring video block of the one or more neighboring video blocks is coded with the combined intra and inter prediction mode, the at least one neighboring video block is treated as a video block coded with an inter prediction mode which is a non-intra prediction mode,

wherein the one or more neighboring video block comprises a video block covering a location (xCb−1, yCb−1+(cbHeight<<a)) and a video block covering a location (xCb−1+(cbWidth<<a), yCb−1), wherein (xCb, yCb) is a location of a top-left sample of the current video block, cbWidth and cbHeight are a width and a height of the current video block, respectively, and a is determined using a cIdx of the current block, wherein cIdx is a variable specifying a color component index for the current block, and wherein the color component index of the current block indicates a color component of the current block is a luma component.

20. A non-transitory computer-readable recording medium storing a bitstream of a video data which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current video block, which is coded in a combined intra and inter prediction mode, a weight pair comprising a first weight for a first prediction result of the current video block and a second weight for a second prediction result of the current video block, based on one or more neighboring video blocks of the current video block,

wherein the first prediction result is generated by an intra prediction mode, and the second prediction result is generated by an inter prediction mode; and

determining a prediction result of the current block based on a weighted sum of the first prediction result and the second prediction result; and

generating the bitstream based on the prediction result,

wherein the weight pair is determined according to a prediction mode of the one or more neighboring video blocks of the current video block,

wherein when at least one neighboring video block of the one or more neighboring video blocks is coded with the combined intra and inter prediction mode, the at least one neighboring video block is treated as a video block coded with an inter prediction mode which is a non-intra prediction mode,

wherein the one or more neighboring video block comprises a video block covering a location (xCb−1, yCb−1+(cbHeight<<a)) and a video block covering a location (xCb−1+(cbWidth<<a), yCb−1), wherein (xCb, yCb) is a location of a top-left sample of the current video block, cbWidth and cbHeight are a width and a height of the current video block, respectively, and a is determined using a cIdx of the current block, wherein cIdx is a variable specifying a color component index for the current block, and wherein the color component index of the current block indicates a color component of the current block is a luma component.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2021
From: ZHANG, LI; ZHANG, KAI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 056644/0056 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2021
From: LIU, HONGBIN; WANG, YUE; ZHANG, NA
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 056644/0116 →
Priority Claims (2)
WO PCT/CN2019/079148 · Mar 21, 2019 · international
WO PCT/CN2019/100616 · Aug 14, 2019 · international
Continuity (2)
Continuation PCTCN2020080632 · Mar 23, 2020
Related Publication 20220124349A1 · Apr 21, 2022
Cited By (3)
US 12,401,791 US 12,425,578 US 12,720,066