IP Library › Granted Patent US 11,843,725
Granted Patent B2
US 11,843,725 · App. 17/483,570 · Granted Dec 12, 2023

Using combined inter intra prediction in video processing

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/159H04N19/105H04N19/107H04N19/117H04N19/176H04N19/186H04N19/577H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,843,725
App. No.
17/483,570
Filed
Sep 23, 2021
Granted
Dec 12, 2023
Kind
B2
Examiner
HABIB, IRFAN
Art Unit
2485
USPC
375/240.13
Abstract

Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.

Claims (44)

1. A method for video processing, comprising:

determining, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

performing the conversion based on the determining;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intermediate inter prediction value and an intermediate intra prediction value is used to derive a prediction value of the current block;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intra-prediction process for the current block, during which at least one of a multiline intra-prediction process, or a wide-angle intra-prediction process is disabled, is determined;

wherein in response to the combined inter and intra prediction coding technique being applied to the current block, at least one coding tool is disabled, and

wherein the at least one coding tool comprises a bi-directional optical flow coding tool or a decoder-side motion vector refinement coding tool.

2. The method of claim 1 , wherein in case that W is equal to T1 or H is equal to T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

3. The method of claim 1 , wherein whether the combined inter and intra prediction coding technique is to be applied to the current block is further based on whether a first coding technique is applied to the current block.

4. The method of claim 3 , wherein the first coding technique is a bi-prediction coding technique.

5. The method of claim 1 , wherein an intra-prediction process for the current block is different from an intra-prediction process for a second block that is coded using an intra-prediction coding technique.

6. The method of claim 5 , wherein, in the intra-prediction process for the current block, filtering of neighboring samples is skipped.

7. The method of claim 1 , wherein, in the intra-prediction process for the current block, a position-dependent intra prediction sample filtering process is disabled.

8. The method of claim 1 , wherein performing the conversion includes decoding the current block from the bitstream.

9. The method of claim 1 , wherein performing the conversion includes encoding the current block into the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

perform the conversion based on the determining;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intermediate inter prediction value and an intermediate intra prediction value is used to derive a prediction value of the current block;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intra-prediction process for the current block, during which at least one of a multiline intra-prediction process, or a wide-angle intra-prediction process is disabled, is determined;

wherein in response to the combined inter and intra prediction coding technique being applied to the current block, at least one coding tool is disabled, and

wherein the at least one coding tool comprises a bi-directional optical flow coding tool or a decoder-side motion vector refinement coding tool.

11. The apparatus of claim 10 , wherein in case that W is equal to T1 or H is equal to T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

12. The apparatus of claim 10 , wherein whether the combined inter and intra prediction coding technique is to be applied to the current block is further based on whether a first coding technique is applied to the current block, and the first coding technique is a bi-prediction coding technique.

13. The apparatus of claim 10 , wherein an intra-prediction process for the current block is different from an intra-prediction process for a second block that is coded using an intra-prediction coding technique, and in the intra-prediction process for the current block, filtering of neighboring samples is skipped.

14. The apparatus of claim 10 , wherein, in the intra-prediction process for the current block, a position-dependent intra prediction sample filtering process is disabled.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

perform the conversion based on the determining;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intermediate inter prediction value and an intermediate intra prediction value is used to derive a prediction value of the current block;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intra-prediction process for the current block, during which at least one of a multiline intra-prediction process, or a wide-angle intra-prediction process is disabled, is determined;

wherein in response to the combined inter and intra prediction coding technique being applied to the current block, at least one coding tool is disabled, and

wherein the at least one coding tool comprises a bi-directional optical flow coding tool or a decoder-side motion vector refinement coding tool.

16. The non-transitory computer-readable storage medium of claim 15 , wherein in case that W is equal to T1 or H is equal to T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

17. The non-transitory computer-readable storage medium of claim 15 , wherein whether the combined inter and intra prediction coding technique is to be applied to the current block is further based on whether a first coding technique is applied to the current block, and the first coding technique is a bi-prediction coding technique.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current block of the video, whether a combined inter and intra prediction coding technique is to be applied to the current block based on at least one of a height H of the current block, or a width W of the current block; and

generating the bitstream from the current block based on the determining;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intermediate inter prediction value and an intermediate intra prediction value is used to derive a prediction value of the current block;

wherein, in response to the combined inter and intra prediction coding technique being applied to the current block, an intra-prediction process for the current block, during which at least one of a multiline intra-prediction process, or a wide-angle intra-prediction process is disabled, is determined;

wherein in response to the combined inter and intra prediction coding technique being applied to the current block, at least one coding tool is disabled, and

wherein the at least one coding tool comprises a bi-directional optical flow coding tool or a decoder-side motion vector refinement coding tool.

19. The non-transitory computer-readable recording medium of claim 18 , wherein in case that W is equal to T1 or H is equal to T1, the combined inter and intra prediction coding technique is disabled for the current block, and wherein T1=64.

20. The non-transitory computer-readable recording medium of claim 18 , wherein whether the combined inter and intra prediction coding technique is to be applied to the current block is further based on whether a first coding technique is applied to the current block, and the first coding technique is a bi-prediction coding technique.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 057583/0609 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057596/0940 →
Continuity (3)
Continuation 17154736 · Jan 21, 2021
Continuation PCTCN2019117523 · Nov 12, 2019
Related Publication 20220014761A1 · Jan 13, 2022
Cited By (5)
US 12,348,760 US 12,363,337 US 12,432,355 US 12,537,946 US 12,634,457