IP Library Granted Patent US 12689769
Granted Patent B2
US 12689769 · App. 18/882,440 · Granted Jul 21, 2026

Image decoding device, method and program with prediction refinement optical flow

Inventors: Kyohei Unno (Saitama, JP); Kei Kawamura (Saitama, JP); Sei Naito (Saitama, JP)
Assignee: KDDI CORPORATION
H04N19/70H04N19/139H04N19/172H04N19/174H04N19/46H04N19/50H04N19/51H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12689769
App. No.
18/882,440
Granted
Jul 21, 2026
Kind
B2
Abstract

An image decoding device includes: a decoding unit configured to decode a first flag which is included in a slice header and controls enabling/disabling of PROF processing from encoded data; and an affine prediction signal generation unit configured to perform the PROF processing in a case where the first flag indicates that the PROF processing is enabled in a slice corresponding to the slice header, and generate a prediction signal without performing the PROF processing in a case where the first flag indicates that the PROF processing is disabled in a slice corresponding to the slice header.

Claims (34)

1 . An image decoding device comprising a circuit, wherein

the circuit:

decodes a first flag which is included in a picture sequence parameter set and controls enabling/disabling of PROF (Prediction Refinement with Optical Flow) processing from encoded data;

decodes a second flag indicating whether or not a flag indicating enabling/disabling of the PROF processing is included in a low order header of a picture parameter set from the sequence parameter set additionally in a case where the first flag indicates enabling of the PROF processing in units of sequences;

decodes a third flag which is included in a low order header of the picture parameter set and indicates enabling/disabling of the PROF processing from the encoded data in a case where the second flag indicates that the flag indicating enabling/disabling of the PROF processing is included in the low order header of a picture parameter set;

regards that the third flag indicates enabling of the PROF processing in case where the third flag is not decoded;

determines non-application conditions of the PROF processing for each block;

determines not to apply the PROF processing to a block that meets at least one of the non-application conditions of the PROF processing and generate a prediction signal without performing the PROF processing; and

calculates “diffMV” corresponding to each pixel position in each sub-block to which a block that doesn't meet any of the non-application conditions of the PROF processing is divided and performs correction of the prediction signal by executing the PROF processing with the “diffMV”,

the non-application conditions of the PROF processing include a condition that the first flag indicates disabling of the PROF processing in units of sequences,

the non-application conditions of the PROF processing include a condition that the third flag indicates disabling of the PROF processing, and

the non-application conditions of the PROF processing include a condition that “fallbackMode” is applied to a block.

2 . An image decoding method comprising:

decoding a first flag which is included in a picture sequence parameter set and controls enabling/disabling of PROF (Prediction Refinement with Optical Flow) processing from encoded data;

decoding a second flag indicating whether or not a flag indicating enabling/disabling of the PROF processing is included in a low order header of a picture parameter set from the sequence parameter set additionally in a case where the first flag indicates enabling of the PROF processing in units of sequences;

decoding a third flag which is included in a low order header of the picture parameter set and indicates enabling/disabling of the PROF processing from the encoded data in a case where the second flag indicates that the flag indicating enabling/disabling of the PROF processing is included in the low order header of a picture parameter set;

regarding that the third flag indicates enabling of the PROF processing in case where the third flag is not decoded;

determining non-application conditions of the PROF processing for each block;

determining not to apply the PROF processing to a block that meets at least one of the non-application conditions of the PROF processing and generating a prediction signal without performing the PROF processing; and

calculating “diffMV” corresponding to each pixel position in each sub-block to which a block that doesn't meet any of the non-application conditions of the PROF processing is divided and performing correction of the prediction signal by executing the PROF processing with the “diffMV”,

the non-application conditions of the PROF processing include a condition that the first flag indicates disabling of the PROF processing in units of sequences,

the non-application conditions of the PROF processing include a condition that the third flag indicates disabling of the PROF processing, and

the non-application conditions of the PROF processing include a condition that “fallbackMode” is applied to a block.

3 . A program stored on a non-transitory computer-readable medium for causing a computer to execute:

decoding a first flag which is included in a picture sequence parameter set and controls enabling/disabling of PROF (Prediction Refinement with Optical Flow) processing from encoded data;

decoding a second flag indicating whether or not a flag indicating enabling/disabling of the PROF processing is included in a low order header of a picture parameter set from the sequence parameter set additionally in a case where the first flag indicates enabling of the PROF processing in units of sequences;

decoding a third flag which is included in a low order header of the picture parameter set and indicates enabling/disabling of the PROF processing from the encoded data in a case where the second flag indicates that the flag indicating enabling/disabling of the PROF processing is included in the low order header of a picture parameter set;

regarding that the third flag indicates enabling of the PROF processing in case where the third flag is not decoded;

determining non-application conditions of the PROF processing for each block;

determining not to apply the PROF processing to a block that meets at least one of the non-application conditions of the PROF processing and generating a prediction signal without performing the PROF processing; and

calculating “diffMV” corresponding to each pixel position in each sub-block to which a block that doesn't meet any of the non-application conditions of the PROF processing is divided and performing correction of the prediction signal by executing the PROF processing with the “diffMV”,

the non-application conditions of the PROF processing include a condition that the first flag indicates disabling of the PROF processing in units of sequences,

the non-application conditions of the PROF processing include a condition that the third flag indicates disabling of the PROF processing, and

the non-application conditions of the PROF processing include a condition that “fallbackMode” is applied to a block.