IP Library › Granted Patent US 12,212,737
Granted Patent B2
US 12,212,737 · App. 17/992,739 · Granted Jan 28, 2025

Moving image encoding device, moving image encoding method, moving image encoding program, moving image decoding device, moving image decoding method, and moving image decoding program

Inventors: Shigeru Fukushima (Yokohama, JP); Toru Kumakura (Yokohama, JP); Hiroya Nakamura (Yokohama, JP); Hideki Takehara (Yokohama, JP); Satoru Sakazume (Yokohama, JP); Hiroyuki Kurashige (Yokohama, JP)
Assignee: Godo Kaisha IP Bridge 1
H04N19/105H04N19/137H04N19/176H04N19/51H04N19/119
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,737
App. No.
17/992,739
Granted
Jan 28, 2025
Kind
B2
Abstract

In order to provide low-load, efficient coding technology, a moving-picture decoding device includes a spatial motion information candidate derivation unit configured to derive a spatial motion information candidate from motion information of a block neighboring a decoding target block in a space domain and a history-based motion information candidate derivation unit configured to derive a history-based motion information candidate from a memory where motion information of a decoded block is retained, wherein the history-based motion information candidate derivation unit preferentially derives old motion information without making a comparison of the motion information with the spatial motion information candidate.

Claims (47)

1. A moving-picture coding device comprising:

a spatial motion information candidate derivation unit configured to add a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring a coding target block in a space domain;

a history-based motion information candidate derivation unit configured to add a history-based, motion information candidate registered in a history-based motion information candidate list to the motion information candidate list; and

a coding unit configured to code inter prediction information including a flag which indicates whether a merge mode is applied or not to the coding target block,

wherein the history-based motion information candidate derivation unit adds the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the coding target block.

2. A moving-picture coding method comprising:

a first process of adding a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring a coding target block in a space domain;

a second process of adding a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list; and

a third process of coding inter prediction information including a flag which indicates whether a merge mode is applied or not to the coding target block,

wherein the second process includes adding the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the coding target block.

3. A non-transitory computer-readable medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to perform moving picture coding program for causing a computer to operate as:

a spatial motion information candidate derivation unit configured to add a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring a coding target block of a space domain;

a history-based motion information candidate derivation unit configured to add a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list; and

a coding unit configured to code inter prediction information including a flag which indicates whether a merge mode is applied or not to the coding target block,

wherein the history-based motion information candidate derivation unit adds the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the coding target block.

4. A moving-picture decoding device comprising:

a decoding unit configured to decode inter prediction information including a flag which indicates whether a merge mode is applied or not to a decoding target block;

a spatial motion information candidate derivation unit configured to add a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring the decoding target block in a space domain; and

a history-based motion information candidate derivation unit configured to add a history based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list,

wherein the history-based motion information candidate derivation unit adds the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the decoding target block.

5. A moving-picture decoding method comprising:

a first process of decoding inter prediction information including a flag which indicates whether a merge mode is applied or not to a decoding target block;

a second process of adding a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring the decoding target block in a space domain; and

a third process of adding a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list,

wherein the third process includes adding the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the decoding target block.

6. A non-transitory computer-readable medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to perform moving picture decoding program for causing a computer to operate as:

a decoding unit configured to decode inter prediction information including a flag which indicates whether a merge mode is applied or not to a decoding target block;

a spatial motion information candidate derivation unit configured to add a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring the decoding target block in a space domain; and

a history-based motion information candidate derivation unit configured to add a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list,

wherein the history-based motion information candidate derivation unit adds the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the decoding target block.

7. A non-transitory computer readable medium storing a bitstream that is generated by an encoding method, wherein the encoding method comprising:

a first process of adding a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring a coding target block in a space domain;

a second process of adding a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list; and

a third process of coding inter prediction information including a flag which indicates whether a merge mode is applied or not to the coding target block,

wherein the second process includes adding the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among no motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the coding target block.

8. A method of transmitting a bitstream generated by a picture encoding device, the method comprising:

a first process of adding a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring a coding target block in a space domain;

a second process of adding a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list,

a third process of coding inter prediction information including a flag which indicates whether a merge mode is applied or not to the coding target block and generating a bitstream, and

a fourth process of transmitting the bitstream;

wherein the second process includes adding the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the coding target block.

9. A method of storing a bitstream on a computer-readable recording medium, the method comprising:

a first process of adding a spatial motion information candidate to a motion information candidate list, the spatial motion information candidate derived from motion information of a block neighboring a coding target block in a space domain;

a second process of adding a history-based motion information candidate registered in a history-based motion information candidate list to the motion information candidate list,

a third process of coding inter prediction information including a flag which indicates whether a merge mode is applied or not to the coding target block and generating a bitstream, and

a fourth process of storing the bitstream on the computer-readable recording medium;

wherein the second process includes adding the history-based motion information candidate to the motion information candidate list in order from oldest motion information to newly added motion information among the motion information registered in the history-based motion information candidate list without making a comparison of the motion information in the history-based motion information candidate list with the motion information in the motion information candidate list, when the merge mode is not applied to the coding target block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2022
From: FUKUSHIMA, SHIGERU; KUMAKURA, TORU; NAKAMURA, HIROYA; TAKEHARA, HIDEKI; SAKAZUME, SATORU; KURASHIGE, HIROYUKI
To: JVCKENWOOD CORPORATION
Reel/Frame 062029/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: JVCKENWOOD CORPORATION
To: GODO KAISHA IP BRIDGE 1
Reel/Frame 061859/0092 →
Priority Claims (2)
JP 2018-247405 · Dec 28, 2018 · national
JP 2019-082763 · Apr 24, 2019 · national
Continuity (2)
Continuation 17269942
Related Publication 20230091579A1 · Mar 23, 2023
References Cited (57)
US 9538197B2 · Xu et al. · 2017 [cited by applicant]
US 20040190624A1 · Kondo et al. · 2004 [cited by applicant]
US 20100271484A1 · Fishwick et al. · 2010 [cited by applicant]
US 20130077691A1 · Zheng et al. · 2013 [cited by applicant]
US 20130114723A1 · Bici et al. · 2013 [cited by applicant]
US 20140133570A1 · Lee · 2014 [cited by applicant]
US 20140294308A1 · Nagaoka · 2014 [cited by applicant]
US 20140294320A1 · Kokaram et al. · 2014 [cited by applicant]
US 20150163508A1 · Bici et al. · 2015 [cited by applicant]
US 20150350664A1 · Kyakuno · 2015 [cited by applicant]
US 20170127082A1 · Chen et al. · 2017 [cited by applicant]
US 20200036997A1 · Li et al. · 2020 [cited by applicant]
US 20200154114A1 · Zhao et al. · 2020 [cited by applicant]
US 20200186819A1 · Xu · 2020 [cited by examiner]
US 20200186821A1 · Park et al. · 2020 [cited by applicant]
US 20200195959A1 · Zhang et al. · 2020 [cited by applicant]
US 20200359049A1 · Zhao et al. · 2020 [cited by applicant]
CN 103609118A · 2014 [cited by applicant]
CN 103999468A · 2014 [cited by applicant]
CN 104412587A · 2015 [cited by applicant]
CN 105122803A · 2015 [cited by applicant]
CN 105939475A · 2016 [cited by applicant]
CN 106471806A · 2017 [cited by applicant]
EP 3895427A1 · 2014 [cited by applicant]
EP 3310049A1 · 2018 [cited by applicant]
IN 104054350A · 2014 [cited by applicant]
JP 109172644A · 1997 [cited by applicant]
JP 2021530940A · 2021 [cited by applicant]
JP 2022502964A · 2022 [cited by applicant]
RU 2577207C2 · 2016 [cited by applicant]
WO 2020003284A1 · 2020 [cited by applicant]
WO 2020003275A1 · 2020 [cited by applicant]
WO 2020071793A1 · 2020 [cited by applicant]
WO 2020123223A1 · 2020 [cited by applicant]
International Search Report for related PCT App No. PCT/JP2019/050004 dated Feb. 18, 2020, 6 pgs. [cited by applicant]
Lee, H., et al., Non-CE4: HMVP unification between the Merge and MVP list, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0373_v2, 14th Meeting: Geneva, CH, Mar. 2019, pp. 1-6. [cited by applicant]
Xu, W., et al., CE4-related: Constraint of Pruning in History-based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0448-v2, 12th Meeting: Macao, CN, Oc… [cited by applicant]
Zhang, L., et al., CE4-related: History-based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0104-v5, 11th Meeting: Ljubljana, SI, Jul. 2018, pp. 1-7. [cited by applicant]
Zhang, L., et al., CE4: History-based Motion Vector Prediction (Test 4.4.7), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0266-v2, 12th Meeting: Macao, CN, Oct. 2018, pp. 1-6. [cited by applicant]
Zhang, L., et al., History-based Motion Vector Prediction in Versatile Video Coding, 2019 Data Compression Conference (DCC), Mar. 2019, pp. 43-52. [cited by applicant]
Notice of Allowance dated Jan. 18, 2022 from counterpart RU Patent Application No. 2021118523, 19 pages. [cited by applicant]
Office Action dated Jan. 21, 2022 from counterpart IN Patent Application No. 202117006677, 6 pages. [cited by applicant]
Yang, Haitao, et al., BoG report on CE4 related contributions, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018 Document: JVET-L0691-v1. [cited by applicant]
Solovyev, Timofey, et al., CE4-related: History-based MVP without using the last lookup table entry, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, … [cited by applicant]
Li Zhang et al., CE4-related: History-based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, Document: JVET-K010… [cited by applicant]
Chinese Office Action for CN application 202110118037.4, Mailed Sep. 10, 2021. (16 pages). [cited by applicant]
Chen J et al: “Algorithm description for Versatile Video Coding and Test Model 3 (VTM 3)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16… [cited by applicant]
European Search Report in Application No. 19904995.8, mailed Sep. 29, 2022, in 10 pages. [cited by applicant]
Office Action received in corresponding Japanese Application No. 2022-046098, mailed May 9, 2023, in 10 pages, with translation. [cited by applicant]
Office Action received in corresponding European Application No. 19904995.8, mailed Jul. 4, 2023, in 5 pages. [cited by applicant]
Han (Qualcomm) Y et al: “CE4: Modification on History-based Motion Vector Prediction”, 13. JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16… [cited by applicant]
Yu (Ericsson) R et al: “CE4-related: On MVP candidate list generation for AMVP”, 13. JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No.… [cited by applicant]
Office Action received in corresponding CN Application No. 201980044824.X, mailed Aug. 16, 2023, in 6 pages, with partial translation of Search Report. [cited by applicant]
Notice of Allowance received in corresponding CN Application No. 201980044824.X, mailed Jan. 6, 2024, in 8 pages, with translation. [cited by applicant]
Bross B et al: “Versatile Video Coding (Draft 3)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-L1001 Dec. 14, 2018 (Dec. 1… [cited by applicant]
Oral Proceedings received in related EP Application No. 19904995.8, dated Jun. 26, 2024 in 6 pages. [cited by applicant]
Y-W Chen (Kwai) et al: “CE4-related: Modified History-based MVP to support parallel processing”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T… [cited by applicant]