IP Library Granted Patent US 11,653,016
Granted Patent B2
US 11,653,016 · App. 17/298,177 · Granted May 16, 2023

Prediction image generation device, moving image decoding device, moving image encoding device, and prediction image generation method

Inventors: Takeshi Chujoh (Sakai, JP); Tomonori Hashimoto (Sakai, JP); Tomoko Aono (Sakai, JP); Tomohiro Ikai (Sakai, JP)
Assignees: SHARP KABUSHIKI KAISHA; FG Innovation Company Limited
H04N19/513H04N19/105H04N19/159H04N19/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,653,016
App. No.
17/298,177
Granted
May 16, 2023
Kind
B2
Abstract

A prediction image generation method using two prediction images to generate a prediction image by a device is provided. First and second prediction image are generated. Bidirectional prediction gradient change prediction processing is performed by using a first shift value and difference values of the first and second prediction images respectively in horizontal and vertical directions to generate a first, second, third and fourth gradient images. Motion information is derived by using the first and second prediction images, the first, second, third and fourth gradient images, a second shift value, and a third shift value. Motion compensation correction value is derived by using the motion information and the first, second, third and the fourth gradient images. The prediction image is generated by using the first and second prediction images and the motion compensation correction value. The first, second and third shift values are respectively equal to 6, 4 and 1.

Claims (34)

1. A prediction image generation device for generating prediction images, the prediction image generation device comprising:

prediction image generation circuitry generating a first prediction image and a second prediction image;

gradient image generation circuitry performing bidirectional prediction gradient change prediction processing by:

generating a first gradient image by calculating a first difference value of two horizontally neighboring samples of each of a plurality of current samples of the first prediction image and right shifting the first difference value by a first shift value of six;

generating a second gradient image by calculating a second difference value of two vertically neighboring samples of each of the plurality of current samples of the first prediction image and right shifting the second difference value by the first shift value;

generating a third gradient image by calculating a third difference value of two horizontally neighboring samples of each of a plurality of current samples of the second prediction image and right shifting the third difference value by the first shift value; and

generating a fourth gradient image by calculating a fourth difference value of two vertically neighboring samples of each of the plurality of current samples of the second prediction image and right shifting the fourth difference value by the first shift value;

motion compensation correction value derivation circuitry that:

uses the first prediction image, the second prediction image, and a second shift value of four to generate a first intermediate image;

uses the first gradient image, the third gradient image, and a third shift value of one to generate a second intermediate image;

uses the second gradient image, the fourth gradient image, and the third shift value to generate a third intermediate image;

uses the first intermediate image, the second intermediate image, and the third intermediate image to derive motion information; and

uses the motion information, the first gradient image, the second gradient image, the third gradient image, and the fourth gradient image to derive a motion compensation correction value; and

prediction image generation circuitry that uses the first prediction image, the second prediction image, and the motion compensation correction value to generate a third prediction image,

wherein the first shift value, the second shift value, and the third shift value are derived based on a pixel bit length bitDepth of eight.

2. The prediction image generation device according to claim 1 , wherein the motion compensation correction value derivation uses a first threshold of 16 to derive the motion information.

3. A moving image decoding device comprising the prediction image generation device according to claim 1 , wherein an encoding object image is restored by adding a residual image to or subtracting the residual image from the generated third prediction image.

4. A moving image encoding device comprising the prediction image generation device according to claim 1 , wherein a residual of the generated prediction image and an encoding object image is encoded.

5. A prediction image generation method for generating prediction images, the prediction image generation method comprising:

generating a first prediction image and a second prediction image; and

performing bidirectional prediction gradient change prediction processing by:

generating a first gradient image by calculating a first difference value of two horizontally neighboring samples of each of a plurality of current samples of the first prediction image and right shifting the first difference value by a first shift value of six;

generating a second gradient image by calculating a second difference value of two vertically neighboring samples of each of the plurality of current samples of the first prediction image and right shifting the second difference value by the first shift value;

generating a third gradient image by calculating a third difference value of two horizontally neighboring samples of each of a plurality of current samples of the second prediction image and right shifting the third difference value by the first shift value;

generating a fourth gradient image by calculating a fourth difference value of two vertically neighboring samples of each of the plurality of current samples of the second prediction image and right shifting the fourth difference value by the first shift value;

using the first prediction image, the second prediction image, and a second shift value of four to generate a first intermediate image;

using the first gradient image, the third gradient image, and a third shift value of one to generate a second intermediate image;

using the second gradient image, the fourth gradient image, and the third shift value to generate a third intermediate image;

using the first intermediate image, the second intermediate image, and the third intermediate image to derive motion information;

using the motion information, the first gradient image, the second gradient image, the third gradient image, and the fourth gradient image to derive a motion compensation correction value; and

using the first prediction image, the second prediction image, and the motion compensation correction value to generate a third prediction image,

wherein the first shift value, the second shift value, and the third shift value are derived based on a pixel bit length bitDepth of eight.

6. The prediction image generation method according to claim 5 , further comprising:

using a first threshold of 16 to derive the motion information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2024
From: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
To: SHARP KABUSHIKI KAISHA
Reel/Frame 069027/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 31, 2021
From: CHUJOH, TAKESHI; HASHIMOTO, TOMONORI; AONO, TOMOKO; IKAI, TOMOHIRO
To: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
Reel/Frame 058513/0824 →
Priority Claims (2)
JP JP2018-232640 · Dec 12, 2018 · national
JP JP2019-000704 · Jan 7, 2019 · national
Continuity (1)
Related Publication 20220103853A1 · Mar 31, 2022