IP Library Granted Patent US 11,146,797
Granted Patent B2
US 11,146,797 · App. 17/154,736 · Granted Oct 12, 2021

Using combined inter intra prediction in video processing

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/159H04N19/105H04N19/107H04N19/117H04N19/176H04N19/186H04N19/577H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,146,797
App. No.
17/154,736
Filed
Jan 21, 2021
Granted
Oct 12, 2021
Kind
B2
Examiner
HABIB, IRFAN
Art Unit
2485
USPC
375/240.13
Abstract

Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.

Claims (33)

1. A method for video processing, comprising:

determining, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

performing the conversion based on the determining;

wherein in response to the combined inter and intra prediction coding technique being to be applied to the current block, an intermedia inter prediction value and an intermedia intra prediction value is used to derive a prediction value of the current block;

wherein in case W is greater than T1 or H is greater than T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

2. The method of claim 1 , wherein in case that W is equal to T1 or H is equal to T1, the combined inter and intra prediction coding technique is disabled for the current block.

3. The method of claim 1 , wherein whether the combined inter and intra prediction coding technique is to be applied to the current block is further based on whether a first coding technique is applied to the current block.

4. The method of claim 3 , wherein the first coding technique is a bi-prediction coding technique.

5. The method of claim 1 , wherein in response to the combined inter and intra prediction coding technique being applied to the current block, at least one coding tool is disabled.

6. The method of claim 5 , wherein the at least one coding tool comprises a bi-directional optical flow coding tool.

7. The method of claim 5 , wherein the at least one coding tool comprises a decoder-side motion vector refinement coding tool.

8. The method of claim 1 , wherein an intra-prediction process for the current block is different from an intra-prediction process for a second block that is coded using an intra-prediction coding technique.

9. The method of claim 8 , wherein, in the intra-prediction process for the current block, filtering of neighboring samples is skipped.

10. The method of claim 1 , wherein, in an intra-prediction process for the current block, at least one of a position-dependent intra prediction sample filtering process, a multiline intra-prediction process, or a wide-angle intra-prediction process is disabled.

11. The method of claim 1 , wherein performing the conversion includes decoding the current block from the bitstream.

12. The method of claim 1 , wherein performing the conversion includes encoding the current block into the bitstream.

13. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

perform the conversion based on the determining;

wherein in response to the combined inter and intra prediction coding technique being to be applied to the current block, an intermedia inter prediction value and an intermedia intra prediction value is used to derive a prediction value of the current block;

wherein in case W is greater than T1 or H is greater than T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

14. The apparatus of claim 13 , wherein in case that W is equal to T1 or H is equal to T1, the combined inter and intra prediction coding technique is disabled for the current block.

15. The apparatus of claim 13 , wherein in response to the combined inter and intra prediction coding technique being applied to the current block, at least one coding tool is disabled, wherein the at least one coding tool comprises at least one of: a bi-directional optical flow coding tool or a decoder-side motion vector refinement process coding tool.

16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

perform the conversion based on the determining;

wherein in response to the combined inter and intra prediction coding technique being to be applied to the current block, an intermedia inter prediction value and an intermedia intra prediction value is used to derive a prediction value of the current block;

wherein in case W is greater than T1 or H is greater than T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

17. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

generating the bitstream from the current block based on the determining;

wherein in response to the combined inter and intra prediction coding technique being to be applied to the current block, an intermedia inter prediction value and an intermedia intra prediction value is used to derive a prediction value of the current block;

wherein in case W is greater than T1 or H is greater than T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2021
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 054996/0379 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 055087/0383 →
Priority Claims (9)
WO PCT/CN2018/115042 · Nov 12, 2018 · international
WO PCT/CN2018/115840 · Nov 16, 2018 · international
WO PCT/CN2019/070060 · Jan 2, 2019 · international
WO PCT/CN2019/070549 · Jan 6, 2019 · international
WO PCT/CN2019/075546 · Feb 20, 2019 · international
WO PCT/CN2019/075858 · Feb 22, 2019 · international
WO PCT/CN2019/077179 · Mar 6, 2019 · international
WO PCT/CN2019/078939 · Mar 20, 2019 · international
WO PCT/CN2019/079397 · Mar 24, 2019 · international
Continuity (2)
Continuation PCTCN2019117523 · Nov 12, 2019
Related Publication 20210144388A1 · May 13, 2021