IP Library Granted Patent US 12,003,755
Granted Patent B2
US 12,003,755 · App. 18/089,374 · Granted Jun 4, 2024

Picture decoding device, picture decoding method, and picture decoding program with history-based candidate selection

Inventors: Hideki Takehara (Yokohama, JP); Hiroya Nakamura (Yokohama, JP); Satoru Sakazume (Yokohama, JP); Shigeru Fukushima (Yokohama, JP); Toru Kumakura (Yokohama, JP); Hiroyuki Kurashige (Yokohama, JP)
Assignee: GODO KAISHA IP BRIDGE 1
H04N19/513H04N19/105H04N19/159H04N19/176G06T9/004G06T9/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,003,755
App. No.
18/089,374
Granted
Jun 4, 2024
Kind
B2
Abstract

A picture decoding device includes a spatial candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a decoding target block and register the derived spatial candidate as a candidate to a first candidate list, a history-based candidate derivation unit configured to generate a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list, a candidate selection unit configured to select a selection candidate from candidates included in the second candidate list, and an inter prediction unit configured to perform inter prediction using the selection candidate.

Claims (69)

1. A picture decoding device comprising:

a spatial candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a decoding target block and register the derived spatial candidate as a candidate to a first candidate list;

a history-based candidate derivation unit configured to generate a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list;

a candidate selection unit configured to select a selection candidate from candidates included in the second candidate list; and

an inter prediction unit configured to perform inter prediction using the selection candidate,

wherein the history-based candidate derivation unit switches between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein the history-based candidate derivation unit decides whether to add the history-based candidate to the first candidate list based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, when the prediction mode is the merge mode, and adds the history-based candidate as a candidate to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture when the prediction mode is the motion vector predictor mode.

2. A picture decoding method for use in a picture decoding device, the picture decoding method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a decoding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list; and

performing inter prediction using the selection candidate,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

3. A computer program stored in a computer-readable non-transitory storage medium in a picture decoding device, the computer program including instructions for causing a computer of the picture decoding device to execute:

deriving a spatial candidate from inter prediction information of a block neighboring a decoding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list; and

performing inter prediction using the selection candidate,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

4. A picture coding device comprising:

a spatial candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a coding target block and register the derived spatial candidate as a candidate to a first candidate list;

a history-based candidate derivation unit configured to generate a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list;

a candidate selection unit configured to select a selection candidate from candidates included in the second candidate list; and

an inter prediction unit configured to perform inter prediction using the selection candidate,

wherein the history-based candidate derivation unit switches between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein the history-based candidate derivation unit decides whether to add the history-based candidate to the first candidate list based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, when the prediction mode is the merge mode, and adds the history-based candidate as a candidate to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture when the prediction mode is the motion vector predictor mode.

5. A picture coding method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list; and

performing inter prediction using the selection candidate,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

6. A computer program stored in a computer-readable non-transitory storage medium in a picture coding device, the computer program including instructions for causing a computer of the picture coding device to execute:

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list; and

performing inter prediction using the selection candidate,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

7. A non-transitory computer readable medium storing a bitstream that is generated by an encoding method, wherein the encoding method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list; and

performing inter prediction using the selection candidate,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

8. A method of transmitting a bitstream formed by a picture coding device, the method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list;

performing inter prediction using the selection candidate;

coding inter prediction information of the coding target block and generating a bitstream; and

transmitting the bitstream,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

9. A method of storing a bitstream formed by a picture coding device, the method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and registering the derived spatial candidate as a candidate to a first candidate list;

generating a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list and switching between whether or not a history-based candidate overlapping a candidate included in the first candidate list is added in accordance with a prediction mode;

selecting a selection candidate from candidates included in the second candidate list;

performing inter prediction using the selection candidate;

coding inter prediction information of the coding target block and generating a bitstream; and

storing the bitstream on a computer-readable recording medium,

wherein the prediction mode is a merge mode and a motion vector predictor mode, the candidate when the prediction mode is the merge mode is motion information, and the candidate when the prediction mode is the motion vector predictor mode is a motion vector, and

wherein, when the prediction mode is the merge mode, whether to add the history-based candidate to the first candidate list is decided based on whether the motion vector and a reference index included in the history-based candidate and the motion vector and the reference index included in a candidate included in the first candidate list are the same, and, when the prediction mode is the motion vector predictor mode, the history-based candidate as a candidate is added to the first candidate list regardless of whether or not the history-based candidate overlaps a candidate included in the first candidate list if a reference index of the history-based candidate is the same as a reference index of a decoding target picture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2022
From: TAKEHARA, HIDEKI; NAKAMURA, HIROYA; SAKAZUME, SATORU; FUKUSHIMA, SHIGERU; KUMAKURA, TORU; KURASHIGE, HIROYUKI
To: JVCKENWOOD CORPORATION
Reel/Frame 062220/0909 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2022
From: JVCKENWOOD CORPORATION
To: GODO KAISHA IP BRIDGE 1
Reel/Frame 062220/0939 →
Priority Claims (2)
JP 2018-247402 · Dec 28, 2018 · national
JP 2019-171784 · Sep 20, 2019 · national
Continuity (2)
Continuation 17269962
Related Publication 20230132950A1 · May 4, 2023