IP Library Granted Patent US 11,115,654
Granted Patent B2
US 11,115,654 · App. 16/901,869 · Granted Sep 7, 2021

Encoder, decoder, encoding method, and decoding method

Inventors: Kiyofumi Abe (Osaka, JP); Takahiro Nishi (Nara, JP); Tadamasa Toma (Osaka, JP); Ryuichi Kanoh (Osaka, JP)
Assignee: Panasonic Intellectual Property Corporation of America
H04N19/105H04N19/119H04N19/139H04N19/14H04N19/176H04N19/52H04N19/573
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,115,654
App. No.
16/901,869
Granted
Sep 7, 2021
Kind
B2
Abstract

An encoder is disclosed which includes circuitry and memory. Using the memory, the circuitry, in a first operating mode, derives first motion vectors for a first block obtained by splitting a picture, and generates a prediction image corresponding to the first block, with a bi-directional optical flow flag settable to true, and by referring to spatial gradients of luminance generated based on the first motion vectors. Using the memory, the circuitry, in a second operating mode, derives second motion vectors for a sub-block obtained by splitting a second block, the second block being obtained by splitting the picture, and generates a prediction image corresponding to the sub-block, with the bi-directional optical flow flag set to false.

Claims (35)

1. A decoder comprising:

circuitry; and

memory,

wherein, using the memory, the circuitry:

in a first operating mode,

derives first motion vectors for a first block obtained by splitting a picture, and

generates a prediction image corresponding to the first block, with a bi-directional optical flow flag set to true, by referring to spatial gradients of luminance generated based on the first motion vectors; and

in a second operating mode,

derives second motion vectors for a sub-block obtained by splitting a second block, the second block being obtained by splitting the picture, and

generates a prediction image corresponding to the sub-block, with the bi-directional optical flow flag set to false.

2. The decoder according to claim 1 ,

wherein the circuitry:

in the first operating mode, derives the first motion vectors in a unit of the first block using a first inter frame prediction mode; and

in the second operating mode, derives the second motion vectors in a unit of the sub-block using a second inter frame prediction mode different from the first inter frame prediction mode.

3. The decoder according to claim 2 ,

wherein the second inter frame prediction mode uses a degree of matching between two reconstructed images of two regions in two different pictures.

4. The decoder according to claim 3 ,

wherein the first inter frame prediction mode is one of (i) a third inter frame prediction mode that uses a degree of matching between a reconstructed image of a region in a current picture neighboring a current block, and a reconstructed image of a region in a reference picture, and (ii) a fourth inter frame prediction mode that uses a degree of matching between two reconstructed images of two regions in two different reference pictures, and

the second inter frame prediction mode is the other of the third inter frame prediction mode and the fourth inter frame prediction mode.

5. The decoder according to claim 4 ,

wherein the first inter frame prediction mode is the third inter frame prediction mode, and

the second inter frame prediction mode is the fourth inter frame prediction mode.

6. The decoder according to claim 3 ,

wherein the first inter frame prediction mode obtains, from an encoded bitstream, information for identifying the first motion vectors in the unit of the first block, and derives the first motion vectors using the information.

7. A decoding method, comprising:

in a first operating mode,

deriving first motion vectors for a first block obtained by splitting a picture, and

generating a prediction image corresponding to the first block, with a bi-directional optical flow flag set to true, by referring to spatial gradients of luminance generated based on the first motion vectors; and

in a second operating mode,

deriving second motion vectors for a sub-block obtained by splitting a second block, the second block being obtained by splitting the picture, and

generating a prediction image corresponding to the sub-block, with the bi-directional optical flow flag set to false.

8. The decoding method according to claim 7 ,

wherein a size of the first block obtained by splitting the picture is variable.

9. The decoder according to claim 1 ,

wherein a size of the first block obtained by splitting the picture is variable.

Continuity (4)
Continuation 16702254 · Dec 3, 2019
Continuation PCTJP2018020659 · May 30, 2018
Provisional Application 62515208 · Jun 5, 2017
Related Publication 20200314417A1 · Oct 1, 2020
Cited By (1)
US 12,464,158