IP Library › Granted Patent US 12,284,334
Granted Patent B2
US 12,284,334 · App. 18/358,189 · Granted Apr 22, 2025

Image decoding device, image decoding method, and image decoding program

Inventor: Hideki Takehara (Yokohama, JP)
Assignee: JVCKENWOOD Corporation
H04N19/105H04N19/137H04N19/176H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,284,334
App. No.
18/358,189
Filed
Jul 25, 2023
Granted
Apr 22, 2025
Kind
B2
Examiner
NOH, JAE NAM
Art Unit
2481
USPC
375/240.02
Abstract

A merge candidate list is generated, a merge candidate is selected from the merge candidate list as a merge candidate, a bitstream is decoded to derive a motion vector difference, and a corrected merge candidate is derived by adding the motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling.

Claims (32)

1. An image decoding device comprising:

a merge candidate list generation unit that generates a merge candidate list including, as a merge candidate, motion information on a plurality of blocks neighboring a block subject to prediction and motion information having a motion vector derived by scaling a motion vector of a block on a decoded image located at the same position as the block subject to prediction;

a merge candidate selection unit that selects, as a selected merge candidate, a merge candidate from the merge candidate list;

a bitstream decoding unit that decodes a bitstream to derive a motion vector difference; and

a merge candidate correction unit that derives a corrected merge candidate of bidirectional prediction by adding the motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling, when a reference picture of the selected merge candidate for a first prediction or a reference picture of the selected merge candidate for a second prediction is a long-term reference picture and the reference picture of the selected merge candidate for the first prediction and the reference picture of the selected merge candidate for the second prediction are located in opposite directions with respect to a picture subject to prediction including the block subject to prediction, and derives a corrected merge candidate of bidirectional prediction by subtracting the motion vector difference, which is scaled in accordance with an interval between a picture subject to prediction and the reference picture, from a motion vector of the selected merge candidate for a second prediction, when the reference picture of the selected merge candidate for the first prediction is not a long-term reference picture and the reference picture of the selected merge candidate for the second prediction is not a long-term reference picture.

2. An image decoding method comprising:

generating a merge candidate list including, as a merge candidate, motion information on a plurality of blocks neighboring a block subject to prediction and motion information having a motion vector derived by scaling a motion vector of a block on a decoded image located at the same position as the block subject to prediction;

selecting, as a selected merge candidate, a merge candidate from the merge candidate list;

decoding a bitstream to derive a motion vector difference; and

deriving a corrected merge candidate of bidirectional prediction by adding the motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling, when a reference picture of the selected merge candidate for a first prediction or a reference picture of the selected merge candidate for a second prediction is a long-term reference picture and the reference picture of the selected merge candidate for the first prediction and the reference picture of the selected merge candidate for the second prediction are located in opposite directions with respect to a picture subject to prediction including the block subject to prediction, and deriving a corrected merge candidate of bidirectional prediction by subtracting the motion vector difference, which is scaled in accordance with an interval between a picture subject to prediction and the reference picture, from a motion vector of the selected merge candidate for a second prediction, when the reference picture of the selected merge candidate for the first prediction is not a long-term reference picture and the reference picture of the selected merge candidate for the second prediction is not a long-term reference picture.

3. A recording medium encoded with an image decoding program, the program comprising computer-implemented modules including:

a module that generates a merge candidate list including, as a merge candidate, motion information on a plurality of blocks neighboring a block subject to prediction and motion information having a motion vector derived by scaling a motion vector of a block on a decoded image located at the same position as the block subject to prediction;

a module that selects, as a selected merge candidate, a merge candidate from the merge candidate list;

a module that decodes a bitstream to derive a motion vector difference; and

a module that derives a corrected merge candidate of bidirectional prediction by adding the motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling, when a reference picture of the selected merge candidate for a first prediction or a reference picture of the selected merge candidate for a second prediction is a long-term reference picture and the reference picture of the selected merge candidate for the first prediction and the reference picture of the selected merge candidate for the second prediction are located in opposite directions with respect to a picture subject to prediction including the block subject to prediction, and derives a corrected merge candidate of bidirectional prediction by subtracting the motion vector difference, which is scaled in accordance with an interval between a picture subject to prediction and the reference picture, from a motion vector of the selected merge candidate for a second prediction, when the reference picture of the selected merge candidate for the first prediction is not a long-term reference picture and the reference picture of the selected merge candidate for the second prediction is not a long-term reference picture.

4. An image coding device comprising:

a merge candidate list generation unit that generates a merge candidate list including, as a merge candidate, motion information on a plurality of blocks neighboring a block subject to prediction and motion information having a motion vector derived by scaling a motion vector of a block on a coded image located at the same position as the block subject to prediction;

a merge candidate selection unit that selects, as a selected merge candidate, a merge candidate from the merge candidate list;

a merge candidate correction unit that derives a corrected merge candidate of bidirectional prediction by adding a motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling, when a reference picture of the selected merge candidate for a first prediction or a reference picture of the selected merge candidate for a second prediction is a long-term reference picture and the reference picture of the selected merge candidate for the first prediction and the reference picture of the selected merge candidate for the second prediction are located in opposite directions with respect to a picture subject to prediction including the block subject to prediction, and derives a corrected merge candidate of bidirectional prediction by subtracting the motion vector difference, which is scaled in accordance with an interval between a picture subject to prediction and the reference picture, from a motion vector of the selected merge candidate for a second prediction, when the reference picture of the selected merge candidate for the first prediction is not a long-term reference picture and the reference picture of the selected merge candidate for the second prediction is not a long-term reference picture; and

a bitstream coding unit that codes the motion vector difference into a bitstream.

5. An image coding method comprising:

generating a merge candidate list including, as a merge candidate, motion information on a plurality of blocks neighboring a block subject to prediction and motion information having a motion vector derived by scaling a motion vector of a block on a coded image located at the same position as the block subject to prediction;

selecting, as a selected merge candidate, a merge candidate from the merge candidate list;

deriving a corrected merge candidate of bidirectional prediction by adding a motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling, when a reference picture of the selected merge candidate for a first prediction or a reference picture of the selected merge candidate for a second prediction is a long-term reference picture and the reference picture of the selected merge candidate for the first prediction and the reference picture of the selected merge candidate for the second prediction are located in opposite directions with respect to a picture subject to prediction including the block subject to prediction, and deriving a corrected merge candidate of bidirectional prediction by subtracting the motion vector difference, which is scaled in accordance with an interval between a picture subject to prediction and the reference picture, from a motion vector of the selected merge candidate for a second prediction, when the reference picture of the selected merge candidate for the first prediction is not a long-term reference picture and the reference picture of the selected merge candidate for the second prediction is not a long-term reference picture; and

coding the motion vector difference into a bitstream.

6. A recording medium encoded with an image coding program, the program comprising computer-implemented modules including:

a module that generates a merge candidate list including, as a merge candidate, motion information on a plurality of blocks neighboring a block subject to prediction and motion information having a motion vector derived by scaling a motion vector of a block on a coded image located at the same position as the block subject to prediction;

a module that selects, as a selected merge candidate, a merge candidate from the merge candidate list;

a module that derives a corrected merge candidate of bidirectional prediction by adding a motion vector difference to a motion vector of the selected merge candidate for a first prediction without scaling and subtracting the motion vector difference from a motion vector of the selected merge candidate for a second prediction without scaling, when a reference picture of the selected merge candidate for a first prediction or a reference picture of the selected merge candidate for a second prediction is a long-term reference picture and the reference picture of the selected merge candidate for the first prediction and the reference picture of the selected merge candidate for the second prediction are located in opposite directions with respect to a picture subject to prediction including the block subject to prediction, and derives a corrected merge candidate of bidirectional prediction by subtracting the motion vector difference, which is scaled in accordance with an interval between a picture subject to prediction and the reference picture, from a motion vector of the selected merge candidate for a second prediction, when the reference picture of the selected merge candidate for the first prediction is not a long-term reference picture and the reference picture of the selected merge candidate for the second prediction is not a long-term reference picture; and

a module that codes the motion vector difference into a bitstream.

7. A storing method adapted to store in a recoding medium a bitstream generated in accordance with the image coding method of claim 5 .

8. A transmission method adapted to transmit to a transmission medium a bitstream generated in accordance with the image coding method of claim 5 .

Priority Claims (2)
JP 2018-233432 · Dec 13, 2018 · national
JP 2019-171782 · Sep 20, 2019 · national
Continuity (4)
Continuation 18066030 · Dec 14, 2022
Continuation 17210629 · Mar 24, 2021
Continuation PCTJP2019048855 · Dec 13, 2019
Related Publication 20230370584A1 · Nov 16, 2023
References Cited (23)
US 11259044B2 · Jeong · 2022 [cited by examiner]
US 20130107965A1 · Wahadaniah et al. · 2013 [cited by applicant]
US 20140016701A1 · Chen · 2014 [cited by examiner]
US 20140105302A1 · Takehara et al. · 2014 [cited by applicant]
US 20160014432A1 · Park et al. · 2016 [cited by applicant]
US 20170078699A1 · Park et al. · 2017 [cited by applicant]
US 20200366902A1 · Jeong · 2020 [cited by examiner]
US 20220109870A1 · Jeong · 2022 [cited by examiner]
JP H10276439A · 1998 [cited by applicant]
JP 2013236367A · 2013 [cited by applicant]
JP 2015525547A · 2015 [cited by applicant]
WO 2018121506A1 · 2018 [cited by applicant]
B. Choi, et al., “CE4: Bilinear Motion Vector Prediction (Test 4.5.2., Test 4.5.3.)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, Doc. # J… [cited by applicant]
H. Chen, et al., “CE4: Symmetrical Mode For Bi-Prediction (Test 3.2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, Doc. #JVET-K0188-v… [cited by applicant]
H. Chen, et al., “CE4: Symmetrical MVD Mode (Test 4.5.1)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, Doc. # JVET-L0370-vl, 4 pages. [cited by applicant]
J. Chen, et al. “Algorithm Description for Versatile Video Coding and Test Model 7 (VTM 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, … [cited by applicant]
Extended European Search Report from EP Patent Application No. 19896609.5 mailed Mar. 23, 2022, 15 pages. [cited by applicant]
International Search Report from International Application No. PCT/JP2019/048855 mailed Feb. 18, 2020, 4 pages. [cited by applicant]
Bross, et al., Versatile Video Coding (Draft 3), Joint Video Expert (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 4 pages. [cited by applicant]
International Preliminary Examination Report on Patentability (II) and Written Opinion from International Application No. PCT/JP2019/048855 mailed Dec. 7, 2020, 9 pages. [cited by applicant]
Jeong, et al., Proposed WD for CE4 Ultimate Motion Vector Expression (Test) (4.5.4), Joint Video Expert (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN,Oct. 3-12, 2018, 12 pages. [cited by applicant]
Office Action issued for corresponding Canadian Patent Application No. 3,119,641 mailed Aug. 3, 2022, 6 pages. [cited by applicant]
Canadian Office Action from CA Application No. 3,119,641 mailed Jun. 5, 2023, 5 pages. [cited by applicant]