IP Library › Granted Patent US 11,303,907
Granted Patent B2
US 11,303,907 · App. 17/154,680 · Granted Apr 12, 2022

Simplification of combined inter-intra prediction

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/159H04N19/105H04N19/107H04N19/117H04N19/176H04N19/186H04N19/577H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,303,907
App. No.
17/154,680
Filed
Jan 21, 2021
Granted
Apr 12, 2022
Kind
B2
Art Unit
2487
USPC
375/240.13
Abstract

Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video coded using a combined inter and intra prediction (CIIP) coding technique and a bitstream representation of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.

Claims (44)

1. A method for video processing, comprising:

determining, for a conversion between a current block of a video coded using a combined inter and intra prediction coding technique and a bitstream of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block; and

performing the conversion based on the determining;

wherein a weight pair is determined for the current block, and the weight pair comprising a first weight for an intermediate inter prediction value of the current block and a second weight for an intermediate intra prediction value of the current block, wherein the combined inter and intra prediction coding technique uses a weighted sum of the intermediate inter prediction value and the intermediate intra prediction value by using the weight pair to derive a prediction value of the current block, and

wherein the intra-prediction mode of the current block is determined without referencing an intra-prediction mode of any neighboring block,

wherein whether a combined inter and intra prediction process is applicable to a color component of the current block is determined based on a color format of the current block, and

wherein in response to the combined inter and intra prediction process being applicable to the color component, the intermediate inter prediction value and the intermediate intra prediction value of the color component are used to derive a prediction value of the color component.

2. The method of claim 1 , wherein the neighboring block comprises a block coded using the combined inter and intra prediction coding technique.

3. The method of claim 1 , wherein determining the intra-prediction mode bypasses a Most Probable Modes (MPM) construction process of the current block.

4. The method of claim 1 , wherein only a subset of a list of Most Probable Modes (MPMs) for a normal intra coding technique is used for the current block.

5. The method of claim 4 , wherein the subset comprises a single MPM mode in the list of MPM modes for the normal intra coding technique.

6. The method of claim 4 , wherein the single MPM mode is the first MPM mode in the list.

7. The method of claim 5 , wherein an index indicating the single MPM mode is omitted in the bitstream.

8. The method of claim 1 , wherein a Planar intra prediction mode is used for the current block.

9. The method of claim 1 , wherein whether the combined inter and intra prediction process is applicable to the color component of the current block is further based on a size of the current block.

10. The method of claim 9 , wherein the color component comprises a chroma component, and wherein the combined inter and intra prediction process is not performed to the chroma component in case that the color format is 4:2:0 and a width of the current block is equal to or smaller than 4.

11. The method of claim 9 , wherein the color component comprises a chroma component, and wherein the combined inter and intra prediction process is not performed to the chroma component in case that the color format is 4:2:0 and a height of the current block is equal to or smaller than 4.

12. The method of claim 9 , wherein the chroma component uses a Planar intra prediction mode.

13. The method of claim 9 , wherein the color component comprises a chroma component, and wherein the combined inter and intra prediction process is not performed to the chroma component in case that the color format is 4:4:4 and a width or a height of the current block is smaller than 4.

14. The method of claim 1 , wherein performing the conversion includes decoding the current block from the bitstream.

15. The method of claim 1 , wherein performing the conversion includes encoding the current block into the bitstream.

16. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a video coded using a combined inter and intra prediction coding technique and a bitstream of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block; and

perform the conversion based on the determining;

wherein a weight pair is determined for the current block, and the weight pair comprising a first weight for an intermediate inter prediction value of the current block and a second weight for an intermediate intra prediction value of the current block, wherein the combined inter and intra prediction coding technique uses a weighted sum of the intermediate inter prediction value and the intermediate intra prediction value by using the weight pair to derive a prediction value of the current block, and

wherein the intra-prediction mode of the current block is determined without referencing an intra-prediction mode of any neighboring block,

wherein whether a combined inter and intra prediction process is applicable to a color component of the current block is determined based on a color format of the current block, and

wherein, in response to the combined inter and intra prediction process being applicable to the color component, the intermediate inter prediction value and the intermediate intra prediction value of the color component are used to derive a prediction value of the color component.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current block of a video coded using a combined inter and intra prediction coding technique and a bitstream of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block; and

perform the conversion based on the determining;

wherein a weight pair is determined for the current block, and the weight pair comprising a first weight for an intermediate inter prediction value of the current block and a second weight for an intermediate intra prediction value of the current block, wherein the combined inter and intra prediction coding technique uses a weighted sum of the intermediate inter prediction value and the intermediate intra prediction value by using the weight pair to derive a prediction value of the current block, and

wherein the intra-prediction mode of the current block is determined without referencing an intra-prediction mode of any neighboring block,

wherein whether a combined inter and intra prediction process is applicable to a color component of the current block is determined based on a color format of the current block;

wherein, in response to the combined inter and intra prediction process being applicable to the color component, the intermediate inter prediction value and the intermediate intra prediction value of the color component to derive a prediction value of the color component.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current block of a video coded using a combined inter and intra prediction coding technique, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block; and

generating the bitstream from the current block based on the determining;

wherein a weight pair is determined for the current block, and the weight pair comprising a first weight for an intermediate inter prediction value of the current block and a second weight for an intermediate intra prediction value of the current block, wherein the combined inter and intra prediction coding technique uses a weighted sum of the intermediate inter prediction value and the intermediate intra prediction value by using the weight pair to derive a prediction value of the current block, and

wherein the intra-prediction mode of the current block is determined without referencing an intra-prediction mode of any neighboring block,

wherein whether a combined inter and intra prediction process is applicable to a color component of the current block is determined based on a color format of the current block, and

wherein, in response to the combined inter and intra prediction process being applicable to the color component, the intermediate inter prediction value and the intermediate intra prediction value of the color component to derive a prediction value of the color component.

19. The apparatus of claim 16 , wherein the neighboring block comprises a block coded using the combined inter and intra prediction coding technique.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the neighboring block comprises a block coded using the combined inter and intra prediction coding technique.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2021
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 054996/0271 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 054996/0342 →
Priority Claims (9)
WO PCT/CN2018/115042 · Nov 12, 2018 · international
WO PCT/CN2018/115840 · Nov 16, 2018 · international
WO PCT/CN2019/070060 · Jan 2, 2019 · international
WO PCT/CN2019/070549 · Jan 6, 2019 · international
WO PCT/CN2019/075546 · Feb 20, 2019 · international
WO PCT/CN2019/075858 · Feb 22, 2019 · international
WO PCT/CN2019/077179 · Mar 6, 2019 · international
WO PCT/CN2019/078939 · Mar 20, 2019 · international
WO PCT/CN2019/079397 · Mar 24, 2019 · international
Continuity (2)
Continuation PCTCN2019117508 · Nov 12, 2019
Related Publication 20210144366A1 · May 13, 2021