IP Library Patent Application 17931676
Patent Application
App. No. 17/931,676

METHODS AND SYSTEMS FOR PERFORMING COMBINED INTER AND INTRA PREDICTION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/931,676
Abstract

A method for video processing, wherein a combined inter and intra prediction (CIIP) and luma mapping with chroma scaling (LMCS) are applied. The method includes obtaining an inter prediction signal, an intra prediction signal, and an overlapped block motion compensation (OBMC) prediction signal; obtaining an intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal; and obtaining a final prediction signal by weighting the intermediate weighted prediction signal and a second prediction signal of intra prediction signal and the OBMC prediction signal; wherein the intermediate weighted prediction signal and the second prediction signal are both in one of a mapped domain or an original domain.

Claims (89)

1 . A method for video processing, wherein a combined inter and intra prediction (CIIP) and luma mapping with chroma scaling (LMCS) are applied, the method comprises:

obtaining an inter prediction signal, an intra prediction signal, and an overlapped block motion compensation (OBMC) prediction signal;

obtaining an intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal; and

obtaining a final prediction signal by weighting the intermediate weighted prediction signal and a second prediction signal of intra prediction signal and the OBMC prediction signal;

wherein the intermediate weighted prediction signal and the second prediction signal are both in one of a mapped domain or an original domain.

2 . The method according to claim 1 , wherein obtaining the inter prediction signal, the intra prediction signal, and the OBMC prediction signal further comprises:

obtaining the inter prediction signal in an original domain;

obtaining the intra prediction signal in a mapped domain; and

obtaining the OBMC prediction signal in the original domain.

3 . The method according to claim 2 , wherein obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the first prediction signal of the intra prediction signal and the OBMC prediction signal comprises:

converting the inter prediction signal from the original domain to the mapped domain; and

obtaining the intermediate weighted prediction signal by weighting the converted inter prediction signal and the intra prediction signal in the mapped domain; and

wherein obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the second prediction signal of intra prediction signal and the OBMC prediction signal further comprises:

converting the OBMC prediction signal from the original domain to the mapped domain; and

obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the mapped domain.

4 . The method according to claim 2 , wherein obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the first prediction signal of the intra prediction signal and the OBMC prediction signal comprises:

converting the inter prediction signal from the original domain to the mapped domain; and

obtaining the intermediate weighted prediction signal by weighting the converted inter prediction signal and the intra prediction signal in the mapped domain; and

wherein obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the second prediction signal of intra prediction signal and the OBMC prediction signal further comprises:

converting the intermediate weighted prediction signal from the mapped domain to the original domain;

obtaining an intermediate final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the original domain; and

obtaining the final prediction signal by converting the intermediate final prediction signal from the original domain to the mapped domain.

5 . The method according to claim 2 , wherein obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal comprises:

converting the intra prediction signal from the mapped domain to the original domain; and

obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the converted intra prediction signal in the original domain; and

wherein obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the second prediction signal of intra prediction signal and the OBMC prediction signal further comprises:

obtaining an intermediate final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the original domain; and

obtaining the final prediction signal by converting the intermediate final prediction signal from the original domain to the mapped domain.

6 . The method according to claim 2 , wherein obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal comprises:

obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the OBMC prediction signal in the original domain; and

wherein obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the second prediction signal of intra prediction signal and the OBMC prediction signal further comprises:

converting the intermediate weighted prediction signal from the original domain to the mapped domain; and

obtaining the final prediction signal by weighting the converted intermediate weighted prediction signal and the intra prediction signal in the mapped domain.

7 . The method according to claim 1 , wherein the inter prediction signal is obtained using an inter prediction process applied to a regular merge mode.

8 . The method according to claim 1 , wherein the OBMC prediction signal is obtained using a motion from neighboring blocks.

9 . An apparatus for performing video data processing, wherein a combined inter and intra prediction (CIIP) and luma mapping with chroma scaling (LMCS) are applied, the apparatus comprising:

a memory figured to store instructions; and

one or more processors configured to execute the instructions to cause the apparatus to perform:

obtaining an inter prediction signal, an intra prediction signal, and an overlapped block motion compensation (OBMC) prediction signal;

obtaining an intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal; and

obtaining a final prediction signal by weighting the intermediate weighted prediction signal and a second prediction signal of intra prediction signal and the OBMC prediction signal;

wherein the intermediate weighted prediction signal and the second prediction signal are both in one of a mapped domain or an original domain.

10 . The apparatus according to claim 9 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to perform:

obtaining the inter prediction signal in an original domain;

obtaining the intra prediction signal in a mapped domain; and

obtaining the OBMC prediction signal in the original domain.

11 . The apparatus according to claim 10 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to perform:

converting the inter prediction signal from the original domain to the mapped domain;

obtaining the intermediate weighted prediction signal by weighting the converted inter prediction signal and the intra prediction signal in the mapped domain;

converting the OBMC prediction signal from the original domain to the mapped domain; and

obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the mapped domain.

12 . The apparatus according to claim 10 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to perform:

converting the inter prediction signal from the original domain to the mapped domain; and

obtaining the intermediate weighted prediction signal by weighting the converted inter prediction signal and the intra prediction signal in the mapped domain;

converting the intermediate weighted prediction signal from the mapped domain to the original domain;

obtaining an intermediate final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the original domain; and

obtaining the final prediction signal by converting the intermediate final prediction signal from the original domain to the mapped domain.

13 . The apparatus according to claim 10 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to perform:

converting the intra prediction signal from the mapped domain to the original domain;

obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the converted intra prediction signal in the original domain;

obtaining an intermediate final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the original domain; and

obtaining the final prediction signal by converting the intermediate final prediction signal from the original domain to the mapped domain.

14 . The apparatus according to claim 10 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to perform:

obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the OBMC prediction signal in the original domain;

converting the intermediate weighted prediction signal from the original domain to the mapped domain; and

obtaining the final prediction signal by weighting the converted intermediate weighted prediction signal and the intra prediction signal in the mapped domain.

15 . The apparatus according to claim 9 , wherein the inter prediction signal is obtained using an inter prediction process applied to a regular merge mode.

16 . The apparatus according to claim 9 , wherein the OBMC prediction signal is obtained using a motion from neighboring blocks.

17 . A non-transitory computer readable storage medium storing a bitstream of a video for processing according to a method, wherein a combined inter and intra prediction (CIIP) and luma mapping with chroma scaling (LMCS) are applied on the video, and the method comprises:

obtaining an inter prediction signal, an intra prediction signal, and an overlapped block motion compensation (OBMC) prediction signal;

obtaining an intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal; and

obtaining a final prediction signal by weighting the intermediate weighted prediction signal and a second prediction signal of intra prediction signal and the OBMC prediction signal;

wherein the intermediate weighted prediction signal and the second prediction signal are both in one of a mapped domain or an original domain.

18 . The non-transitory computer readable storage medium according to claim 17 , wherein obtaining the inter prediction signal, the intra prediction signal, and the OBMC prediction signal further comprises:

obtaining the inter prediction signal in an original domain;

obtaining the intra prediction signal in a mapped domain; and

obtaining the OBMC prediction signal in the original domain.

19 . The non-transitory computer readable storage medium according to claim 18 , wherein obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the first prediction signal of the intra prediction signal and the OBMC prediction signal comprises:

converting the inter prediction signal from the original domain to the mapped domain; and

obtaining the intermediate weighted prediction signal by weighting the converted inter prediction signal and the intra prediction signal in the mapped domain; and

wherein obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the second prediction signal of intra prediction signal and the OBMC prediction signal further comprises:

converting the intermediate weighted prediction signal from the mapped domain to the original domain;

obtaining an intermediate final prediction signal by weighting the intermediate weighted prediction signal and the OBMC prediction signal in the original domain; and

obtaining the final prediction signal by converting the intermediate final prediction signal from the original domain to the mapped domain.

20 . The non-transitory computer readable storage medium according to claim 18 , wherein obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and a first prediction signal of the intra prediction signal and the OBMC prediction signal comprises:

obtaining the intermediate weighted prediction signal by weighting the inter prediction signal and the OBMC prediction signal in the original domain; and

wherein obtaining the final prediction signal by weighting the intermediate weighted prediction signal and the second prediction signal of intra prediction signal and the OBMC prediction signal further comprises:

converting the intermediate weighted prediction signal from the original domain to the mapped domain; and

obtaining the final prediction signal by weighting the converted intermediate weighted prediction signal and the intra prediction signal in the mapped domain.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2024
From: LIAO, RU-LING; CHEN, JIE; LI, XINWEI; YE, YAN
To: ALIBABA SINGAPORE HOLDING PRIVATE LIMITED
Reel/Frame 067042/0934 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2024
From: ALIBABA SINGAPORE HOLDING PRIVATE LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 066348/0252 →