Encoder, decoder, encoding method, and decoding method
Provided is an encoder that achieves further improvement. The encoder includes processing circuitry and memory. Using the memory, the processing circuitry: obtains two prediction images from two reference pictures; derives a luminance gradient value of each pixel position in each of the two prediction images; derives a luminance local motion estimation value of each pixel position in a current block; generates a luminance final prediction image using a luminance value and the luminance gradient value in each of the two prediction images, and the luminance local motion estimation value of the current block; and generates a chrominance final prediction image using at least one of the luminance gradient value of each of the two prediction images or the luminance local motion estimation value of the current block, and chrominance of each of the two prediction images.
1. An encoder, comprising:
processing circuitry; and
memory,
wherein using the memory, the processing circuitry:
generates a luminance final prediction image and a chrominance final prediction image by performing inter frame prediction on a current block; and
encodes the current block using the luminance final prediction image and the chrominance final prediction image, and
the inter frame prediction includes:
obtaining two prediction images from two reference pictures by performing motion compensation using two motion vectors of the current block;
deriving a luminance gradient value of each pixel position in each of the two prediction images by referring to a pixel surrounding the pixel position in each of the two reference pictures;
deriving a luminance local motion estimation value for each pixel position in the current block using a luminance value and the luminance gradient value in each of the two prediction images, the luminance value and the luminance gradient value corresponding to the pixel position in the current block;
generating the luminance final prediction image using the luminance value and the luminance gradient value of the pixel position in each of the two prediction images, and the luminance local motion estimation value of the pixel position in the current block; and
generating the chrominance final prediction image using at least one of the luminance gradient value of the pixel position in each of the two prediction images or the luminance local motion estimation value of the pixel position in the current block, and chrominance of the pixel position in each of the two prediction images.
2. The encoder according to claim 1 ,
wherein the inter frame prediction further includes deriving a chrominance local motion estimation value for each pixel position in the current block using the chrominance and the luminance gradient value in each of the two prediction images, the chrominance and the luminance gradient value corresponding to the pixel position in the current block, and
in the generating of the chrominance final prediction image, the chrominance final prediction image is generated using the luminance gradient value of each pixel position in each of the two prediction images, the chrominance local motion estimation value of the pixel position in the current block, and the chrominance of the pixel position in each of the two prediction images.
3. The encoder according to claim 1 ,
wherein the inter frame prediction further includes deriving a chrominance gradient value of each pixel position in each of the two prediction images by referring to a pixel surrounding each pixel position in each of the two reference pictures, and
in the generating of the chrominance final prediction image, the chrominance final prediction image is generated using the chrominance gradient value of the pixel position in each of the two prediction images, the luminance local motion estimation value of each pixel position in the current block, and the chrominance of the pixel position in each of the two prediction images.
4. The encoder according to claim 1 ,
wherein in the generating of the chrominance final prediction image,
a chrominance gradient value is calculated using C=α×L+ß, where L denotes a luminance gradient value, C denotes a chrominance gradient value, and α and ß each denote a real number, and
the chrominance final prediction image is generated based on the chrominance gradient value calculated using the luminance gradient value.
5. The encoder according to claim 1 ,
wherein in the generating of the chrominance final prediction image,
a chrominance local motion estimation value is calculated using C=α×L+ß, where L denotes a luminance local motion estimation value, C denotes a chrominance local motion estimation value, and α and ß each denote a real number, and
the chrominance final prediction image is generated based on the chrominance local motion estimation value calculated using the luminance local motion estimation value.
6. A decoder, comprising:
processing circuitry; and
memory,
wherein using the memory, the processing circuitry:
generates a luminance final prediction image and a chrominance final prediction image by performing inter frame prediction on a current block; and
decodes the current block using the luminance final prediction image and the chrominance final prediction image, and
the inter frame prediction includes:
obtaining two prediction images from two reference pictures by performing motion compensation using two motion vectors of the current block;
deriving a luminance gradient value of each pixel position in each of the two prediction images by referring to a pixel surrounding the pixel position in each of the two reference pictures;
deriving a luminance local motion estimation value for each pixel position in the current block using a luminance value and the luminance gradient value in each of the two prediction images, the luminance value and the luminance gradient value corresponding to the pixel position in the current block;
generating the luminance final prediction image using the luminance value and the luminance gradient value of the pixel position in each of the two prediction images, and the luminance local motion estimation value of the pixel position in the current block; and
generating the chrominance final prediction image using at least one of the luminance gradient value of the pixel position in each of the two prediction images or the luminance local motion estimation value of the pixel position in the current block, and chrominance of the pixel position in each of the two prediction images.
7. The decoder according to claim 6 ,
wherein the inter frame prediction further includes deriving a chrominance local motion estimation value for each pixel position in the current block using the chrominance and the luminance gradient value in each of the two prediction images, the chrominance and the luminance gradient value corresponding to the pixel position in the current block, and
in the generating of the chrominance final prediction image, the chrominance final prediction image is generated using the luminance gradient value of each pixel position in each of the two prediction images, the chrominance local motion estimation value of the pixel position in the current block, and the chrominance of the pixel position in each of the two prediction images.
8. The decoder according to claim 6 ,
wherein the inter frame prediction further includes deriving a chrominance gradient value of each pixel position in each of the two prediction images by referring to a pixel surrounding each pixel position in each of the two reference pictures, and
in the generating of the chrominance final prediction image, the chrominance final prediction image is generated using the chrominance gradient value of the pixel position in each of the two prediction images, the luminance local motion estimation value of each pixel position in the current block, and the chrominance of the pixel position in each of the two prediction images.
9. The decoder according to claim 6 ,
wherein in the generating of the chrominance final prediction image,
a chrominance gradient value is calculated using C=α×L+ß, where L denotes a luminance gradient value, C denotes a chrominance gradient value, and α and ß each denote a real number, and
the chrominance final prediction image is generated based on the chrominance gradient value calculated using the luminance gradient value.
10. The decoder according to claim 6 ,
wherein in the generating of the chrominance final prediction image,
a chrominance local motion estimation value is calculated using C=α×L+ß, where L denotes a luminance local motion estimation value, C denotes a chrominance local motion estimation value, and α and ß each denote a real number, and
the chrominance final prediction image is generated based on the chrominance local motion estimation value calculated using the luminance local motion estimation value.
11. An encoding method, comprising:
generating a luminance final prediction image and a chrominance final prediction image by performing inter frame prediction on a current block; and
encoding the current block using the luminance final prediction image and the chrominance final prediction image,
wherein the inter frame prediction includes:
obtaining two prediction images from two reference pictures by performing motion compensation using two motion vectors of the current block;
deriving a luminance gradient value of each pixel position in each of the two prediction images by referring to a pixel surrounding the pixel position in each of the two reference pictures;
deriving a luminance local motion estimation value for each pixel position in the current block using a luminance value and the luminance gradient value in each of the two prediction images, the luminance value and the luminance gradient value corresponding to the pixel position in the current block;
generating the luminance final prediction image using the luminance value and the luminance gradient value of the pixel position in each of the two prediction images, and the luminance local motion estimation value of the pixel position in the current block; and
generating the chrominance final prediction image using at least one of the luminance gradient value of the pixel position in each of the two prediction images or the luminance local motion estimation value of the pixel position in the current block, and chrominance of the pixel position in each of the two prediction images.
12. A decoding method, comprising:
generating a luminance final prediction image and a chrominance final prediction image by performing inter frame prediction on a current block; and
decoding the current block using the luminance final prediction image and the chrominance final prediction image,
wherein the inter frame prediction includes:
obtaining two prediction images from two reference pictures by performing motion compensation using two motion vectors of the current block;
deriving a luminance gradient value of each pixel position in each of the two prediction images by referring to a pixel surrounding the pixel position in each of the two reference pictures;
deriving a luminance local motion estimation value for each pixel position in the current block using a luminance value and the luminance gradient value in each of the two prediction images, the luminance value and the luminance gradient value corresponding to the pixel position in the current block;
generating the luminance final prediction image using the luminance value and the luminance gradient value of the pixel position in each of the two prediction images, and the luminance local motion estimation value of the pixel position in the current block; and
generating the chrominance final prediction image using at least one of the luminance gradient value of the pixel position in each of the two prediction images or the luminance local motion estimation value of the pixel position in the current block, and chrominance of the pixel position in each of the two prediction images.