IP Library Granted Patent US 12,425,635
Granted Patent B2
US 12,425,635 · App. 18/643,099 · Granted Sep 23, 2025

Picture decoding device, picture decoding method, and picture decoding program with history-based candidate selection

Inventors: Hideki Takehara (Yokohama, JP); Hiroya Nakamura (Yokohama, JP); Satoru Sakazume (Yokohama, JP); Shigeru Fukushima (Yokohama, JP); Toru Kumakura (Yokohama, JP); Hiroyuki Kurashige (Yokohama, JP)
Assignee: Godo Kaisha IP Bridge 1
H04N19/513H04N19/105H04N19/159H04N19/176G06T9/004G06T9/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,425,635
App. No.
18/643,099
Granted
Sep 23, 2025
Kind
B2
Abstract

A picture decoding device includes a spatial candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a decoding target block and register the derived spatial candidate as a candidate to a first candidate list, a history-based candidate derivation unit configured to generate a second candidate list by adding a history-based candidate included in a history-based candidate list as a candidate to the first candidate list, a candidate selection unit configured to select a selection candidate from candidates included in the second candidate list, and an inter prediction unit configured to perform inter prediction using the selection candidate.

Claims (39)

1. A picture coding device for coding a moving picture using inter prediction in units of blocks and forming a bitstream, the picture coding device comprising:

a spatial motion vector predictor candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a coding target block and register the derived spatial candidate to a first motion vector predictor candidate list;

a history-based motion vector predictor candidate derivation unit configured to generate a second motion vector predictor candidate list by adding a history-based candidate to the first motion vector predictor candidate list regardless of whether or not a motion vector of the history-based candidate included in a history-based candidate list overlaps motion vectors of candidates included in the first motion vector candidate list;

a motion vector predictor candidate selection unit configured to select a first selection candidate from candidates included in the second motion vector predictor candidate list;

a spatial merge candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a coding target block and register the derived spatial candidate to a first merge candidate list;

a history-based merge candidate derivation unit configured to generate a second merge candidate list by adding a history-based candidate to the first merge candidate list when the history-based candidate included in the history-based candidates list does not overlap candidates included in the first merge candidate list; and

a merge candidate selection unit configured to select a second selection candidate from candidates included in the second merge candidate list;

a coding unit configured to code a merge flag being 1 in a merge mode and being 0 in a motion vector predictor mode, and code a merge index for selecting the second selection candidates when the merge flag is 1 and code a motion vector predictor index for selecting the first selection candidate when the merge flag is 0; and

an inter prediction unit configured to perform inter prediction using the first selection candidate or the second selection candidate.

2. A picture coding method for coding a moving picture using inter prediction in units of blocks and forming a bitstream, the picture coding method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and register the derived spatial candidate to a first motion vector predictor candidate list;

generating a second motion vector predictor candidate list by adding a history-based candidate to the first motion vector predictor candidate list regardless of whether or not a motion vector of the history-based candidate included in a history-based candidate list overlaps motion vectors of candidates included in the first motion vector candidate list;

selecting a first selection candidate from candidates included in the second motion vector predictor candidate list;

deriving a spatial candidate from inter prediction information of a block neighboring a coding target block and register the derived spatial candidate to a first merge candidate list;

generating a second merge candidate list by adding a history-based candidate to the first merge candidate list when the history-based candidate included in the history-based candidates list does not overlap candidates included in the first merge candidate list; and

selecting a second selection candidate from candidates included in the second merge candidate list;

coding a merge flag being 1 in a merge mode and being 0 in a motion vector predictor mode, and coding a merge index for selecting the second selection candidates when the merge flag is 1 and coding a motion vector predictor index for selecting the first selection candidate when the merge flag is 0; and

performing inter prediction using the first selection candidate or the second selection candidate.

3. A picture decoding device comprising:

a spatial motion vector predictor candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a decoding target block and register the derived spatial candidate to a first motion vector predictor candidate list;

a history-based motion vector predictor candidate derivation unit configured to generate a second motion vector predictor candidate list by adding a history-based candidate to the first motion vector predictor candidate list regardless of whether or not a motion vector of the history-based candidate included in a history-based candidate list overlaps motion vectors of candidates included in the first motion vector candidate list;

a motion vector predictor candidate selection unit configured to select a first selection candidate from candidates included in the second motion vector predictor candidate list;

a spatial merge candidate derivation unit configured to derive a spatial candidate from inter prediction information of a block neighboring a decoding target block and register the derived spatial candidate to a first merge candidate list;

a history-based merge candidate derivation unit configured to generate a second merge candidate list by adding a history-based candidate to the first merge candidate list when the history-based candidate included in the history-based candidates list does not overlap candidates included in the first merge candidate list; and

a merge candidate selection unit configured to select a second selection candidate from candidates included in the second merge candidate list;

a decoding unit configured to decode a merge flag being 1 in a merge mode and being 0 in a motion vector predictor mode, and decode a merge index for selecting the second selection candidates when the merge flag is 1 and decode a motion vector predictor index for selecting the first selection candidate when the merge flag is 0; and

an inter prediction unit configured to perform inter prediction using the first selection candidate or the second selection candidate.

4. A picture decoding method comprising:

deriving a spatial candidate from inter prediction information of a block neighboring a decoding target block and registering the derived spatial candidate to a first motion vector predictor candidate list;

generating a second motion vector predictor candidate list by adding a history-based candidate to the first motion vector predictor candidate list regardless of whether or not a motion vector of the history-based candidate included in a history-based candidate list overlaps motion vectors of candidates included in the first motion vector candidate list;

selecting a first selection candidate from candidates included in the second motion vector predictor candidate list;

deriving a spatial candidate from inter prediction information of a block neighboring a decoding target block and registering the derived spatial candidate to a first merge candidate list;

generating a second merge candidate list by adding a history-based candidate to the first merge candidate list when the history-based candidate included in the history-based candidates list does not overlap candidates included in the first merge candidate list; and

selecting a second selection candidate from candidates included in the second merge candidate list;

decoding a merge flag being 1 in a merge mode and being 0 in a motion vector predictor mode, and decoding a merge index for selecting the second selection candidates when the merge flag is 1 and decoding a motion vector predictor index for selecting the first selection candidate when the merge flag is 0; and

performing inter prediction using the first selection candidate or the second selection candidate.

5. A storing method for storing a bitstream formed by the picture coding method according to claim 2 in a recording medium.

6. A transmitting method for transmitting a bitstream formed by the picture coding method according to claim 2 .

7. A non-transitory computer readable medium storing a bitstream formed by the picture coding method according to claim 2 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: TAKEHARA, HIDEKI; NAKAMURA, HIROYA; SAKAZUME, SATORU; FUKUSHIMA, SHIGERU; KUMAKURA, TORU; KURASHIGE, HIROYUKI
To: JVCKENWOOD CORPORATION
Reel/Frame 067209/0448 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: JVCKENWOOD CORPORATION
To: GODO KAISHA IP BRIDGE 1
Reel/Frame 067209/0452 →
Priority Claims (2)
JP 2018-247402 · Dec 28, 2018 · national
JP 2019-171784 · Sep 20, 2019 · national
Continuity (3)
Continuation 18089374 · Dec 27, 2022
Continuation 17269962
Related Publication 20240276007A1 · Aug 15, 2024
References Cited (38)
US 10701389B2 · Takehara · 2020 [cited by examiner]
US 20050105624A1 · Kato et al. · 2005 [cited by applicant]
US 20110194608A1 · Rusert et al. · 2011 [cited by applicant]
US 20130336406A1 · Zhang et al. · 2013 [cited by applicant]
US 20180359483A1 · Chen et al. · 2018 [cited by applicant]
US 20200413045A1 · Zhang · 2020 [cited by examiner]
US 20210185342A1 · Zhang · 2021 [cited by examiner]
US 20210203922A1 · Zhang · 2021 [cited by examiner]
CN 103563386A · 2014 [cited by applicant]
CN 103609120A · 2014 [cited by applicant]
EP 2532160A1 · 2012 [cited by applicant]
JP H09172644A · 1997 [cited by applicant]
KR 1020180041579A · 2018 [cited by applicant]
RU 2628319C2 · 2017 [cited by applicant]
WO 2011095260A1 · 2011 [cited by applicant]
WO 2018070786A1 · 2018 [cited by applicant]
WO 2020003275A1 · 2020 [cited by applicant]
WO 2020113052A1 · 2020 [cited by applicant]
WO 2020122640A1 · 2020 [cited by applicant]
International Search Report for related PCT App No. PCT/JP2019/050093 dated Feb. 18, 2020, 6 pgs. [cited by applicant]
Lee, H., et al., Non-CE4: HMVP Unification Between the Merge and MVP List, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0373_v2, 14th Meeting: Geneva, CH, Mar. 2019, pp. 1-6. [cited by applicant]
Xu, W, et al., CE4-Related: Constraint of Pruning in History-Based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0448-v2, 12th Meeting: Macao, CN, Oct… [cited by applicant]
Zhang, L., et al., CE4-Related: History-Based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0104-v5, 11th Meeting: Ljubljana, SI, Jul. 2018, pp. 1-7. [cited by applicant]
Zhang, L., et al., CE4: History-based Motion Vector Prediction (Test 4.4.7), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0266-v2, 12th Meeting: Macao, CN, Oct. 2018, pp. 1-6. [cited by applicant]
Zhang, L., et al., History-based Motion Vector Prediction in Versatile Video Coding, 2019 Data Compression Conference (DCC), Mar. 2019, pp. 43-52. [cited by applicant]
Office Action dated Sep. 7, 2021 in counterpart India Patent Application No. 202117007091, 5 pages. [cited by applicant]
Office Action dated Nov. 8, 2021 in counterpart RU Patent Application No. 2021118254, 9 pages. [cited by applicant]
Xu W. et al., CE4-related: CTU-level Initialization of History-based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0575, 12th Meeting, Macao, Oct. 3-1… [cited by applicant]
Office Action dated Aug. 24, 2021 in counterpart JP Patent Application No. 2020-151410, 6 pages. [cited by applicant]
Office Action dated Oct. 22, 2021 in counterpart CN Patent Application No. 202110121842.2, 10 pages. [cited by applicant]
Office Action received in co-pending Canadian Application No. 3,124,076, mailed Sep. 13, 2022, in 7 pages. [cited by applicant]
Zhao, J. et al., “CE4-related: Simplification to History Based Motion Vector Prediction”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16… [cited by applicant]
European Search Report in Application No. 19905949.4, mailed Nov. 22, 2022, in 11 pages. [cited by applicant]
Yu (Ericsson) R et al: “CE4-related: On MVP candidate list generation for AMVP”, 13. JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16) No. … [cited by applicant]
Office Action received in corresponding CA Application No. 3124076, mailed Jul. 26, 2023, in 5 pages. [cited by applicant]
Zhang, L. et al., “CE4: History-based Motion Vector Prediction (Test 4.4.7)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-… [cited by applicant]
Office Action received in corresponding CN Application No. 201980044862.5, mailed Aug. 12, 2023, in 20 pages. [cited by applicant]
Li Zhang et al., “CE4: History-based Motion Vector Prediction (Test 4.4.7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, JVET-L0266-v1. [cited by applicant]