IP Library Granted Patent US 11,477,485
Granted Patent B2
US 11,477,485 · App. 17/510,519 · Granted Oct 18, 2022

Encoder, decoder, encoding method, and decoding method

Inventors: Takahiro Nishi (Nara, JP); Tadamasa Toma (Osaka, JP); Kiyofumi Abe (Osaka, JP); Ryuichi Kanoh (Osaka, JP); Luca Rigazio (Campbell, CA); Alec Hodgkinson (Pescadero, CA)
Assignee: Panasonic Intellectual Property Corporation of America
H04N19/61H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,477,485
App. No.
17/510,519
Granted
Oct 18, 2022
Kind
B2
Abstract

The encoder includes processing circuitry, and memory. Using the memory, the processing circuitry: generates a predicted image of an input image that is a current image to be encoded, based on generated data output from a generator network in response to a reference image being input to the generator network, the generator network being a neural network; calculates a prediction error by subtracting the predicted image from the input image; and generates an encoded image by at least transforming the prediction error.

Claims (41)

1. An encoder, comprising:

processing circuitry; and

memory, wherein

using the memory, the processing circuitry:

generates a predicted image of an input image that is a current image to be encoded, based on generated data output from a generator network in response to a reference image being input to the generator network, the generator network being a neural network;

calculates a prediction error by subtracting the predicted image from the input image;

generates an encoded image by at least transforming the prediction error, wherein in generating the predicted image, the processing circuitry:

generates a first intra-predicted image by a first intra prediction based on the reference image and an intra prediction parameter, the intra prediction parameter being obtained as the generated data output from the generator network in response to the reference image being input to the generator network;

generates a second intra-predicted image of the input image by a second intra prediction based on the reference image;

selects, as the predicted image, from among the first intra-predicted image and the second intra-predicted image; and

when the processing circuitry selects the second intra-predicted image, calculates the prediction error by subtracting the second intra-predicted image from the input image in calculating the prediction error.

2. A decoder, comprising:

processing circuitry; and

memory, wherein

using the memory, the processing circuitry:

generates a decoding prediction error by performing at least inverse transform on an encoded image that is a current image to be decoded;

generates a predicted image of the encoded image, based on generated data output from a generator network in response to a reference image being input to the generator network, the generator network being a neural network;

generates a decoded image by adding the decoding prediction error to the predicted image; and

in generating the predicted image, the processing circuitry:

generates a first intra-predicted image by a first intra prediction based on the reference image and an intra prediction parameter, the intra prediction parameter being obtained as the generated data output from the generator network in response to the reference image being input to the generator network;

generates a second intra-predicted image of the encoded image by a second intra prediction based on the reference image;

selects, as the predicted image, from among the first intra-predicted image and the second intra-predicted image; and

when the processing circuitry selects the second intra-predicted image, generates the decoded image by adding the decoding prediction error to the second intra-predicted image in generating the decoded image.

3. An encoding method, comprising:

generating a predicted image of an input image that is a current image to be encoded, based on generated data output from a generator network in response to a reference image being input to the generator network, the generator network being a neural network;

calculating a prediction error by subtracting the predicted image from the input image; and

generating an encoded image by at least transforming the prediction error,

wherein the generating the predicted image includes:

generating a first intra-predicted image by a first intra prediction based on the reference image and an intra prediction parameter, the intra prediction parameter being obtained as the generated data output from the generator network in response to the reference image being input to the generator network;

generating a second intra-predicted image of the input image by a second intra prediction based on the reference image;

selecting, as the predicted image, from among the first intra-predicted image and the second intra-predicted image; and

when the second intra-predicted image is selected as the predicted image, calculating the prediction error by subtracting the second intra-predicted image from the input image in calculating the prediction error.

4. A decoding method, comprising:

generating a decoding prediction error by performing at least inverse transform on an encoded image that is a current image to be decoded;

generating a predicted image of the encoded image, based on generated data output from a generator network in response to a reference image being input to the generator network, the generator network being a neural network; and

generating a decoded image by adding the decoding prediction error to the predicted image; and

wherein the generating the predicted image includes:

generating a first intra-predicted image by a first intra prediction based on the reference image and an intra prediction parameter, the intra prediction parameter being obtained as the generated data output from the generator network in response to the reference image being input to the generator network;

generating a second intra-predicted image of the encoded image by a second intra prediction based on the reference image;

selecting, as the predicted image, from among the first intra-predicted image and the second intra-predicted image; and

when the second intra-predicted image is selected as the predicted image, generating the decoded image by adding the decoding prediction error to the second intra-predicted image in generating the decoded image.

Continuity (4)
Continuation 16664084 · Oct 25, 2019
Continuation PCTJP2018016516 · Apr 24, 2018
Provisional Application 62489644 · Apr 25, 2017
Related Publication 20220046284A1 · Feb 10, 2022