Granted Patent B2

US 12,301,863 · App. 18/534,336 · Granted May 13, 2025

Inventors: Kai Zhang (San Diego, CA); Jianle Chen (San Diego, CA); Xin Zhao (Santa Clara, CA); Marta Karczewicz (San Diego, CA)

Assignee: QUALCOMM Incorporated

H04N19/52H04N19/109H04N19/147H04N19/174H04N19/176H04N19/184H04N19/54H04N19/70H04N19/96

Abstract

Claims (45)

1. A method of decoding video data, the method comprising:

obtaining, from a syntax structure in a bitstream comprising an encoded representation of the video data, an instance of a first syntax element, wherein a first value for the first syntax element indicates that 6-parameter affine prediction is enabled for a plurality of blocks corresponding to the syntax structure and a second value for the first syntax element indicates that the 6-parameter affine prediction is disabled for the plurality of blocks corresponding to the syntax structure, wherein the plurality of blocks corresponding to the syntax structure comprise a first block and a second block;

in response to the instance of the first syntax element indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure, obtaining from the bitstream, a first instance of a second syntax element, wherein the second syntax element indicates whether the first block is encoded with 4-parameter affine prediction or the 6-parameter affine prediction, wherein a value for the first instance of the second syntax element indicates that the first block is encoded with the 4-parameter affine prediction, wherein the second syntax element comprises a block-level syntax element separate from the syntax structure;

based on the instance of the first syntax element indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure and based on the value for the first instance of the second syntax element indicating that the first block is encoded with the 4-parameter affine prediction, using the 4-parameter affine prediction without the 6-parameter affine prediction to generate a first predictive block for the first block, wherein using the 4-parameter affine prediction without the 6-parameter affine prediction to generate the first predictive block for the first block comprises using only two control point motion vectors to determine the first predictive block; and

using the first predictive block and first residual data to determine a first reconstructed block;

in response to the instance of the first syntax element indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure, obtaining, from the bitstream, a second instance of the second syntax element indicating whether the second block is encoded with the 4-parameter affine prediction or the 6-parameter affine prediction, wherein a value for the second instance of the second syntax element indicates that the second block is encoded with the 6-parameter affine prediction;

based on the second instance of the second syntax element indicating that the second block is encoded with the 6-parameter affine prediction, using the 6-parameter affine prediction without the 4-parameter affine prediction to generate a second predictive block for the second block, wherein using the 6-parameter affine prediction without the 4-parameter affine prediction to generate the second predictive block for the second block comprises using three control point motion vectors to determine the second predictive block;

using the second predictive block and second residual data to determine a second reconstructed block; and

outputting a picture of decoded video data based on the first reconstructed block and the second reconstructed block.

2. The method of claim 1 , wherein the syntax structure comprises a sequence parameter set.

3. The method of claim 1 , wherein the first syntax element comprises a 1-bit flag.

4. The method of claim 1 , wherein using the first predictive block and the first residual data to determine the first reconstructed block comprises adding the first predictive block to a residual block, the method further comprising:

performing one or more filtering operations on the first reconstructed block to determine a final block; and

outputting the picture of decoded video data comprising the final block.

5. A device for decoding video data, the device comprising:

a memory configured to store video data; and

one or more processors coupled to the memory, implemented in processing circuitry, and configured to:

obtain, from a syntax structure in a bitstream comprising an encoded representation of the video data, an instance of a first syntax element, wherein a first value for the first syntax element indicates that 6-parameter affine prediction is enabled for a plurality of blocks corresponding to the syntax structure and a second value for the first syntax element indicates that the 6-parameter affine prediction is disabled for the plurality of blocks corresponding to the syntax structure, wherein the plurality of blocks corresponding to the syntax structure comprise a first block and a second block;

in response to the instance of the first syntax element indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure, obtain from the bitstream, a first instance of a second syntax element, wherein the second syntax element indicates whether the first block is encoded with 4-parameter affine prediction or the 6-parameter affine prediction, wherein a value for the first instance of the second syntax element indicates that the first block is encoded with the 4-parameter affine prediction, wherein the second syntax element comprises a block-level syntax element separate from the syntax structure;

based on the instance of the first syntax element indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure and based on the value for the first instance of the second syntax element indicating that the first block is encoded with the 4-parameter affine prediction, use the 4-parameter affine prediction without the 6-parameter affine prediction to generate a first predictive block for the first block, wherein to use the 4-parameter affine prediction without the 6-parameter affine prediction to generate the first predictive block for the first block, the one or more processors are further configured to use only two control point motion vectors to determine the first predictive block; and

use the first predictive block and first residual data to reconstruct the first block determine a first reconstructed block;

in response to the instance of the first syntax element indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure, obtain, from the bitstream, a second instance of the second syntax element indicating whether the second block is encoded with the 4-parameter affine prediction or the 6-parameter affine prediction, wherein a value for the second instance of the second syntax element indicates that the second block is encoded with the 6-parameter affine prediction;

based on the second instance of the second syntax element indicating that the second block is encoded with the 6-parameter affine prediction, use the 6-parameter affine prediction without the 4-parameter affine prediction to generate a second predictive block for the second block, wherein using the 6-parameter affine prediction without the 4-parameter affine prediction to generate the second predictive block for the second block comprises using three control point motion vectors to determine the second predictive block;

use the second predictive block and second residual data to determine a second reconstructed block; and

output a picture of decoded video data based on the first reconstructed block and the second reconstructed block.

6. The device of claim 5 , wherein the syntax structure comprises a sequence parameter set.

7. The device of claim 5 , wherein the first syntax element comprises a 1-bit flag.

8. The device of claim 5 , wherein to use the first predictive block and the first residual data to determine the first reconstructed block, the one or more processors are configured to add the first predictive block to a residual block, wherein the one or more processors are further configured to:

perform one or more filtering operations on the first reconstructed block to determine a final block; and

output the picture of decoded video data comprising the final block.

9. The device of claim 5 , further comprising a display configured to display decoded video data.

10. The device of claim 5 , wherein the device comprises one or more of a cellular phone, a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box.

11. A device for encoding video data, the device comprising:

a memory configured to store video data; and

one or more processors coupled to the memory, implemented in processing circuitry, and configured to:

determine that 6-parameter affine prediction is enabled for a plurality of blocks corresponding to a syntax structure, wherein the plurality of blocks corresponding to the syntax structure comprise a first block and a second block;

use 4-parameter affine prediction to determine a first predictive block for the first block, wherein using the 4-parameter affine prediction to generate the first predictive block for the first block comprises using only two control point motion vectors to determine the first predictive block;

use the first predictive block to determine residual data for the first block;

use the 6-parameter affine prediction to determine a second predictive block for the second block, wherein using the 6-parameter affine prediction to generate the second predictive block for the second block comprises using only three control point motion vectors to determine the second predictive block;

use the second predictive block to determine residual data for the second block;

include, in a bitstream, the residual data for the first block, the residual data for the second block, and a syntax structure comprising an instance of a first syntax element set to a first value indicating that the 6-parameter affine prediction is enabled for the plurality of blocks corresponding to the syntax structure, wherein a second value for the first syntax element indicates that the 6-parameter affine prediction is disabled for the plurality of blocks corresponding to the syntax structure;

in response to the 6-parameter affine prediction being enabled for the plurality of blocks corresponding to the syntax structure, include in the bitstream a first instance of a second syntax element indicating whether the first block is encoded with the 4-parameter affine prediction or the 6-parameter affine prediction, wherein a value for the first instance of the second syntax element indicates that the first block is encoded with the 4-parameter affine prediction without the 6-parameter affine prediction, wherein the second syntax element comprises a block-level syntax element separate from the syntax structure;

in response to the 6-parameter affine prediction being enabled for the plurality of blocks corresponding to the syntax structure, including in the bitstream a second instance of the second syntax element indicating whether the second block is encoded with the 4-parameter affine prediction or the 6-parameter affine prediction, wherein a value for the second instance of the second syntax element indicates that the first block is encoded with the 6-parameter affine prediction without the 4-parameter affine prediction.

12. The device of claim 11 , wherein the syntax structure comprises a sequence parameter set.

13. The device of claim 11 , wherein the device comprises a cellular phone.

Assignments (1)

Continuity (3)

References Cited (111)