Granted Patent B2

US 12,238,331 · App. 18/239,122 · Granted Feb 25, 2025

Inventors: Xiaoyu Xiu (San Diego, CA); Yi-Wen Chen (San Diego, CA); Xianglin Wang (San Diego, CA)

Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.

H04N19/577H04N19/103H04N19/176H04N19/513

Abstract

Claims (51)

1. A method for video encoding, comprising:

obtaining a current block from a current picture;

determining, for the current block, a first prediction corresponding to a first reference picture, wherein the first reference picture is displayed before the current picture;

determining, for the current block, a second prediction corresponding to a second reference picture, wherein the second reference picture is displayed after the current picture;

calculating first gradient values for the first prediction and second gradient values for the second prediction;

calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction based on a motion refinement threshold and a plurality of internal parameters representing different summation characters of the first prediction and the second prediction;

calculating a final bi-prediction of the current block based on the first prediction, the second prediction, respective motion refinements, the first gradient values and the second gradient values, wherein calculating the final bi-prediction of the current block comprises:

calculating the final bi-prediction of the current block based further on a fourth right shift value for combining the first prediction and the second prediction; and

generating a video bitstream based on the final bi-prediction.

2. The method of claim 1 , wherein calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction comprises:

calculating a horizontal summation by adding a first horizontal gradient and a second horizontal gradient, and calculating a vertical summation by adding a first vertical gradient and a second vertical gradient, wherein a first right shift value is introduced into the horizontal summation and the vertical summation for lowering a bit-width of each of the horizontal summation and the vertical summation; and

calculating a respective motion refinement of each subblock of the current block based on the horizontal summation and the vertical summation.

3. The method of claim 1 , wherein a second right shift value is introduced into the calculation of the first gradient values for the first prediction and the calculation of the second gradient values for the second prediction.

4. The method of claim 1 , wherein calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction comprises: clipping a horizontal motion refinement and a vertical motion refinement in the respective motion refinement to a range of [-th BDOF , th BDOF ], wherein th BDOF is a motion refinement threshold, and wherein the respective motion refinement comprises the horizontal motion refinement and the vertical motion refinement.

5. The method of claim 1 , wherein a third right shift value is introduced into the calculation of the difference between the first prediction and the second prediction.

6. The method of claim 1 , wherein calculating the first gradient values for the first prediction and the second gradient values for the second prediction further comprises calculating a horizontal gradient and a vertical gradient at each of a first prediction position of the first prediction and a second prediction position of the second prediction.

7. The method of claim 1 , wherein the fourth right shift value comprises an additional right shift value, and wherein the additional right shift value is set to be equal to a bit-depth of a video for decoding.

8. The method of claim 1 , wherein the first prediction is determined based on a first motion vector from the current block to the first reference picture, and wherein the second prediction is determined based on a second motion vector from the current block to the second reference picture.

9. A computing device, comprising:

one or more processors;

a non-transitory storage coupled to the one or more processors; and

a plurality of programs stored in the non-transitory storage that, when executed by the one or more processors individually or collectively, cause the computing device to perform acts comprising:

obtaining a current block from a current picture;

determining, for the current block of, a first prediction corresponding to a first reference picture, wherein the first reference picture is displayed before the current picture;

determining, for the current block, a second prediction corresponding to a second reference picture, wherein the second reference picture is displayed after the current picture;

calculating first gradient values for the first prediction and second gradient values for the second prediction;

calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction based on a motion refinement threshold and a plurality of internal parameters representing different summation characters of the first prediction and the second prediction;

calculating a final bi-prediction of the current block based on the first prediction, the second prediction, respective motion refinements, the first gradient values, and the second gradient values, wherein calculating the final bi-prediction of the current block comprises:

calculating the final bi-prediction of the current block based further on a fourth right shift value for combining the first prediction and the second prediction; and

generating a video bitstream based on the final bi-prediction.

10. The computing device of claim 9 , calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction comprises:

calculating a horizontal summation by adding a first horizontal gradient and a second horizontal gradient, and calculating a vertical summation by adding a first vertical gradient and a second vertical gradient, wherein a first right shift value is introduced into the horizontal summation and the vertical summation for lowering a bit-width of each of the horizontal summation and the vertical summation; and

calculating a respective motion refinement of each subblock of the current block based on the horizontal summation and the vertical summation.

11. The computing device of claim 9 , wherein a first right shift value is introduced into the calculation of both the first gradient values for the first prediction and the calculation of the second gradient values for the second prediction.

12. The computing device of claim 9 , wherein calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction comprises: clipping a horizontal motion refinement and a vertical motion refinement in the respective motion refinement to a range of [-th BDOF , th BDOF ], wherein th BDOF is a motion refinement threshold, and wherein the respective motion refinement comprises the horizontal motion refinement and the vertical motion refinement.

13. The computing device of claim 9 , wherein a second right shift value is introduced into the calculation of the difference between the first prediction and the second prediction.

14. The computing device of claim 9 , calculating the first gradient values for the first prediction and the second gradient values for the second prediction further comprises calculating a horizontal gradient and a vertical gradient at each of a first prediction position of the first prediction and a second prediction position of the second prediction.

15. The computing device of claim 9 , wherein the fourth right shift value comprises an additional right shift value, and wherein the additional right shift value is set to be equal to a bit-depth of a video for decoding.

16. The computing device of claim 9 , wherein the first prediction is determined based on a first motion vector from the current block to the first reference picture, and wherein the second prediction is determined based on a second motion vector from the current block to the second reference picture.

17. A non-transitory computer readable storage medium storing a plurality of programs for execution by a computing device having one or more processors, wherein the plurality of programs, when executed by the one or more processors individually or collectively, cause the computing device to perform acts to generate a video bitstream and store the generated video bitstream in the non-transitory computer readable storage medium, the acts comprising:

obtaining a current block from a current picture;

determining, for the current block of, a first prediction corresponding to a first reference picture, wherein the first reference picture is displayed before the current picture;

determining, for the current block, a second prediction corresponding to a second reference picture, wherein the second reference picture is displayed after the current picture;

calculating first gradient values for the first prediction and second gradient values for the second prediction;

calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction based on a motion refinement threshold and a plurality of internal parameters representing different summation characters of the first prediction and the second prediction;

calculating a final bi-prediction of the current block based on the first prediction, the second prediction, respective motion refinements, the first gradient values and the second gradient values, wherein calculating the final bi-prediction of the current block comprises:

calculating the final bi-prediction of the current block based further on a fourth right shift value for combining the first prediction and the second prediction; and

generating a video bitstream based on the final bi-prediction.

18. The storage medium of claim 17 , wherein calculating a respective motion refinement of each subblock of the current block by minimizing a difference between the first prediction and the second prediction comprises:

calculating a horizontal summation by adding the first horizontal gradient and the second horizontal gradient, and calculating a vertical summation by adding the first vertical gradient and the second vertical gradient, wherein a first right shift value is introduced into the horizontal summation and the vertical summation for lowering a bit-width of each of the horizontal summation and the vertical summation; and

calculating a respective motion refinement of each subblock of the current block based on the horizontal summation and the vertical summation.

Assignments (1)

Continuity (6)

References Cited (34)