IP Library Granted Patent US 12,713,055
Granted Patent B2
US 12,713,055 · App. 18/920,543 · Granted Aug 18, 2026

Inter prediction method based on history-based motion vector, and device therefor

Inventors: Naeri Park (Seoul, KR); Junghak Nam (Seoul, KR); Hyeongmoon Jang (Seoul, KR)
Assignee: NOKIA TECHNOLOGIES OY
H04N19/513H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,713,055
App. No.
18/920,543
Filed
Oct 18, 2024
Granted
Aug 18, 2026
Kind
B2
Art Unit
2481
USPC
375/240.16
Abstract

An image decoding method according to the present disclosure includes deriving a history-based motion vector prediction (HMVP) buffer for a current block, deriving motion information of the current block based on an HMVP candidate included in the HMVP buffer, generating prediction samples for the current block based on the motion information, and generating reconstructed samples based on the prediction samples, and the HMVP buffer is initialized when processing a first-ordered CTU in a CTU row in which a current CTU is located, and the current block is included in the current CTU.

Claims (46)

1 . An image decoding method performed by a decoding apparatus, the method comprising:

deriving a history-based motion vector prediction (HMVP) candidate list for a current block;

configuring a motion vector predictor (MVP) candidate list for the current block based on an HMVP candidate comprised in the HMVP candidate list;

deriving motion information of the current block based on the MVP candidate list;

generating prediction samples for the current block based on the motion information; and

generating reconstructed samples based on the prediction samples,

wherein the current block corresponds to a coding unit (CU) which is split from a coding tree unit (CTU),

wherein the HMVP candidate list is initialized at a first-ordered CTU per each CTU row of a slice,

wherein the method further comprises determining whether the CTU is a first-ordered CTU in a CTU row of a current slice, and

wherein based on the result of the determining that the CTU is the first-ordered CTU in the CTU row of the current slice, the HMVP candidate list is initialized for the CTU.

2 . An image encoding method performed by an encoding apparatus, the method comprising:

deriving a history-based motion vector prediction (HMVP) candidate list for a current block;

configuring a motion vector predictor (MVP) candidate list for the current block based on an HMVP candidate comprised in the HMVP candidate list;

deriving motion information of the current block based on the MVP candidate list;

generating prediction samples for the current block based on the motion information;

deriving residual samples based on the prediction samples; and

encoding image information comprising information on the residual samples,

wherein the current block corresponds to a coding unit (CU) which is split from a coding tree unit (CTU),

wherein the HMVP candidate list is initialized at a first-ordered CTU per each CTU row of a slice,

wherein the method further comprises determining whether the CTU is a first-ordered CTU in a CTU row of a current slice, and

wherein based on the result of the determining that the CTU is the first-ordered CTU in the CTU row of the current slice, the HMVP candidate list is initialized for the CTU.

3 . A non-transitory computer readable digital storage medium storing a bitstream generated by a method, the method comprising:

deriving a history-based motion vector prediction (HMVP) candidate list for a current block;

configuring a motion vector predictor (MVP) candidate list for the current block based on an HMVP candidate comprised in the HMVP candidate list;

deriving motion information of the current block based on the MVP candidate list;

generating prediction samples for the current block based on the motion information;

deriving residual samples based on the prediction samples; and

encoding image information comprising information on the residual samples,

wherein the current block corresponds to a coding unit (CU) which is split from a coding tree unit (CTU),

wherein the HMVP candidate list is initialized at a first-ordered CTU per each CTU row of a slice,

wherein the method further comprises determining whether the CTU is a first-ordered CTU in a CTU row of a current slice, and

wherein based on the result of the determining that the CTU is the first-ordered CTU in the CTU row of the current slice, the HMVP candidate list is initialized for the CTU.

4 . The image decoding method of claim 1 , wherein deriving the HMVP) candidate list for the current block and configuring the MVP candidate list for the current block based on an HMVP candidate comprised in the HMVP candidate list comprise deriving a HMVP buffer for the current block and deriving merge candidates for configuring a merge candidate list for the current block, wherein the merge candidates include spatial candidates derived based on spatial candidate blocks and a temporal candidate derived based on a temporal candidate block, wherein an HMVP candidate comprised in the HMVP buffer is inserted as a merge candidate of the merge candidate list, wherein the HMVP candidate is inserted after the temporal candidate in the merge candidate list, wherein the HMVP buffer is initialized at a first-ordered CTU per each CTU row of a slice, wherein the method further comprises determining whether the CTU is a first-ordered CTU in the CTU row of the current slice, and wherein based on the result of the determining that the CTU is the first-ordered CTU in the CTU row of the current slice, the HMVP buffer is initialized for the CTU.

5 . The image decoding method of claim 4 , wherein based on the HMVP buffer being initialized, the number of HMVP candidates comprised in the HMVP buffer is set to zero.

6 . The image decoding method of claim 4 , wherein based on a determination that the current CTU is the first-ordered CTU in the CTU row of the slice, the HMVP buffer comprises an HMVP candidate derived based on motion information of a block decoded earlier than the current block in the current CTU, and wherein based on a determination that the current CTU is not the first-ordered CTU in the CTU row of the slice, the HMVP buffer comprises an HMVP candidate derived based on motion information of a block decoded earlier than the current block in the current CTU and an HMVP candidate derived based on motion information of a block previously decoded in a previous CTU in the CTU row.

7 . The image decoding method of claim 4 , wherein whether the current CTU is the first-ordered CTU in the CTU row of the slice is determined based on the following equation: ctu_jdx % Num where the ctu_idx refers to an index of the current CTU, the % refers to modulus operator, and the Num refers to the number of CTUs in the CTU row.

8 . The image decoding method of claim 1 , further comprising obtaining image information including merge index information from a bitstream.

9 . The image encoding method of claim 2 , wherein deriving the HMVP candidate list for the current block and configuring the MVP candidate list for the current block based on the HMVP candidate comprised in the HMVP candidate list comprise deriving a HMVP buffer for the current block; and deriving merge candidates for configuring a merge candidate list for the current block, wherein the merge candidates includes spatial candidates derived based on spatial candidate blocks and a temporal candidate derived based on a temporal candidate block, wherein an HMVP candidate comprised in the HMVP buffer is inserted as a merge candidate of the merge candidate list, wherein the HMVP candidate is inserted after the temporal candidate in the merge candidate, wherein the HMVP buffer is initialized at the first-ordered CTU per each CTU row of the slice, wherein the method further comprises determining whether the CTU is the first-ordered CTU in the CTU row of the current slice, and wherein based on the result of the determining that the CTU is the first-ordered CTU in the CTU row of the current slice, the HMVP buffer is initialized for the CTU list.

10 . The image encoding method of claim 9 , wherein based on the HMVP buffer being initialized, the number of HMVP candidates comprised in the HMVP buffer is set to zero.

11 . The image encoding method of claim 9 , wherein based on a determined that the current CTU is the first-ordered CTU in the CTU row of the slice, the HMVP buffer comprises an HMVP candidate derived based on motion information of a block encoded earlier than the current block in the current CTU, and wherein based on a determined that the current CTU is not the first-ordered CTU in the CTU row of the slice, the HMVP buffer comprises an HMVP candidate derived based on motion information of a block encoded earlier than the current block in the current CTU and an HMVP candidate derived based on motion information of a block previously encoded in a previous CTU in the CTU row.

12 . The image encoding method of claim 9 , whether the current CTU is the first-ordered CTU in the CTU row of the slice is determined based on the following equation: ctu_jdx % Num where the ctu_idx refers to an index of the current CTU, the % refers to modulus operator, and the Num refers to the number of CTUs in the CTU row.

13 . The non-transitory computer readable digital storage medium of claim 3 , wherein deriving a history-based motion vector prediction (HMVP) candidate list for a current block; and configuring the motion vector predictor (MVP) candidate list for the current block based on an HMVP candidate comprised in the HMVP candidate list comprise deriving a HMVP buffer for the current block; and deriving merge candidates for configuring a merge candidate list for the current block, wherein the merge candidates includes spatial candidates derived based on spatial candidate blocks and a temporal candidate derived based on a temporal candidate block, wherein an HMVP candidate comprised in the HMVP buffer is inserted as a merge candidate of the merge candidate list, wherein the HMVP candidate is inserted after the temporal candidate in the merge candidate list, the HMVP buffer is initialized at the first-ordered CTU per each CTU row of the slice, wherein the method further comprises determining whether the CTU is the first-ordered CTU in the CTU row of the current slice, and wherein based on the result of the determining that the CTU is the first-ordered CTU in the CTU row of the current slice, the HMVP buffer is initialized for the CTU.

14 . The non-transitory computer-readable storage medium of claim 13 , wherein based on the HMVP buffer being initialized, the number of HMVP candidates comprised in the HMVP buffer is set to zero.

15 . The non-transitory computer-readable storage medium of claim 13 , wherein based on a determination that the current CTU is the first-ordered CTU in the CTU row of the slice, the HMVP buffer comprises an HMVP candidate derived based on motion information of a block encoded earlier than the current block in the current CTU, and wherein based on a determination that the current CTU is not the first-ordered CTU in the CTU row of the slice, the HMVP buffer comprises an HMVP candidate derived based on motion information of a block encoded earlier than the current block in the current CTU and an HMVP candidate derived based on motion information of a block previously encoded in a previous CTU in the CTU row.

16 . The non-transitory computer-readable storage medium of claim 13 , wherein whether the current CTU is the first-ordered CTU in the CTU row of the slice is determined based on the following equation:

ctu_jdx % Num where the ctu_idx refers to an index of the current CTU, the % refers to modulus operator, and the Num refers to the number of CTUs in the CTU row.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2024
From: PARK, NAERI; NAM, JUNGHAK; JANG, HYEONGMOON
To: LG ELECTRONICS INC.
Reel/Frame 069011/0032 →
Priority Claims (1)
KR 10-2018-0094609 · Aug 13, 2018 · national
Continuity (6)
Continuation 18396416 · Dec 26, 2023
Continuation 17942655 · Sep 12, 2022
Continuation 17065822 · Oct 8, 2020
Continuation 16790089 · Feb 13, 2020
Continuation PCTKR2019010312 · Aug 13, 2019
Related Publication 20250047894A1 · Feb 6, 2025
References Cited (110)
US 10362330B1 · Li et al. · 2019 [cited by applicant]
US 10440378B1 · Xu et al. · 2019 [cited by applicant]
US 10511853B2 · Hojati · 2019 [cited by examiner]
US 10841607B2 · Park · 2020 [cited by examiner]
US 10911754B2 · Park et al. · 2021 [cited by applicant]
US 10979716B2 · Li et al. · 2021 [cited by applicant]
US 11025945B2 · Park et al. · 2021 [cited by applicant]
US 11070796B2 · Hung et al. · 2021 [cited by applicant]
US 11445209B2 · Park et al. · 2022 [cited by applicant]
US 11601640B2 · Park et al. · 2023 [cited by applicant]
US 11632564B2 · Park · 2023 [cited by examiner]
US 11729414B2 · Park et al. · 2023 [cited by applicant]
US 11895315B2 · Park · 2024 [cited by examiner]
US 12155857B2 · Park · 2024 [cited by examiner]
US 12556738B2 · Zhang · 2026 [cited by examiner]
US 20080043848A1 · Kuhn · 2008 [cited by applicant]
US 20140169474A1 · Kang et al. · 2014 [cited by applicant]
US 20140247866A1 · Lee et al. · 2014 [cited by applicant]
US 20150131740A1 · Li et al. · 2015 [cited by applicant]
US 20150264398A1 · Bang et al. · 2015 [cited by applicant]
US 20160134883A1 · Choi et al. · 2016 [cited by applicant]
US 20160173888A1 · Park et al. · 2016 [cited by applicant]
US 20170026641A1 · Lai et al. · 2017 [cited by applicant]
US 20170127086A1 · Lai et al. · 2017 [cited by applicant]
US 20170155914A1 · Jeon et al. · 2017 [cited by applicant]
US 20170310994A1 · Seo et al. · 2017 [cited by applicant]
US 20180234690A1 · Fu et al. · 2018 [cited by applicant]
US 20200014948A1 · Lai et al. · 2020 [cited by applicant]
US 20200021839A1 · Pham et al. · 2020 [cited by applicant]
US 20200036997A1 · Li et al. · 2020 [cited by applicant]
US 20200099951A1 · Hung et al. · 2020 [cited by applicant]
US 20200186820A1 · Park et al. · 2020 [cited by applicant]
US 20200186821A1 · Park et al. · 2020 [cited by applicant]
US 20200260072A1 · Park et al. · 2020 [cited by applicant]
US 20210218957A1 · Jang · 2021 [cited by applicant]
US 20250039433A1 · Pham et al. · 2025 [cited by applicant]
CN 1335021A · 2002 [cited by applicant]
CN 104853211A · 2015 [cited by applicant]
CN 105532004A · 2016 [cited by applicant]
CN 106162181A · 2016 [cited by applicant]
CN 106464869A · 2017 [cited by applicant]
CN 106576172A · 2017 [cited by applicant]
CN 107105244A · 2017 [cited by applicant]
CN 112585966B · 2023 [cited by applicant]
EP 3316581A1 · 2018 [cited by applicant]
JP 2017169022A · 2017 [cited by applicant]
JP 2021530904A · 2021 [cited by applicant]
KR 102541425B1 · 2023 [cited by applicant]
WO 2017197126A1 · 2017 [cited by applicant]
WO 2018002425A2 · 2018 [cited by applicant]
WO 2020014389A1 · 2020 [cited by applicant]
US 11,350,116 B2, 05/2022, Jizheng et al. (withdrawn) [cited by applicant]
History-based Motion Vector Prediction; Zhang et al.—Jul. 2018. (Year: 2018). [cited by examiner]
History-Based Motion Vector Prediction parallel processing; Park et al.—Oct. 2018. (Year: 2018). [cited by examiner]
Fixed sub-block size and restriction for ATMVP, Oct. 3-12, 2018; Lee; et al. (Year: 2018). [cited by applicant]
History-Based Motion Vector Prediction parallel processing, Oct. 2018; Park et al (Year: 2018). [cited by applicant]
Overview of High Efficiency Video Coding HEVC Standard, Dec. 2012, Sullivan; et al (Year: 2012). [cited by applicant]
A. Wieckowski et al., “Thread Parallel Encoding”, JVET-J0036, 10th JVET Meeting held on Apr. 10-20, 2018, San Diego, retrieved from URL: http://phenix.int-evry.fr/mpeg/doc_end_user/documents/122_San%20Diego/wg11/m42368-… [cited by applicant]
Advisory Action (PTOL-303) Mailed on May 10, 2022 for U.S. Appl. No. 17/065,822, 2 page(s). [cited by applicant]
Decision of Refusal for Japanese Application No. 2021-506710 dated Nov. 1, 2022, 6 pages. [cited by applicant]
Decision to Grant for European Application No. 19850303.9 dated Mar. 20, 2025, 3 pages. [cited by applicant]
Decision to Grant for Japanese Application No. 2021-506710 dated Apr. 18, 2023, 5 pages. [cited by applicant]
Extended European Search Report for European Application No. 19850303.9 dated Feb. 22, 2021, 8 pages. [cited by applicant]
Extended European Search Report for European Application No. 25169918.7 dated Jul. 23, 2025, 5 pages. [cited by applicant]
Final Rejection for Brazilian Application No. BR112021002604-5 dated Apr. 5, 2023, 10 pages. [cited by applicant]
Final Rejection for Brazilian Application No. BR122021008224-3 dated May 23, 2023, 10 pages. [cited by applicant]
Final Rejection for Brazilian Application No. BR122021008228-6 dated May 23, 2023, 10 pages. [cited by applicant]
Final Rejection Mailed on Mar. 2, 2022 for U.S. Appl. No. 17/065,822, 9 page(s). [cited by applicant]
First Examination Report for Indian Application No. 202117003883 dated Jan. 7, 2022, 5 pages. [cited by applicant]
First Examination Report for Indian Application No. 202218046829 dated Feb. 4, 2026, 7 pages. [cited by applicant]
History-Based Motion Vector Prediction considering parallel processing, Oct. 2018; Park et al (Year: 2018). [cited by applicant]
History-based Motion Vector Prediction; Jul. 2018; Zhang et al. (Year: 2018). [cited by applicant]
IPEA/409—International Preliminary Report on Patentability Mailed on Feb. 25, 2021 for WO Application No. PCT/ KR19/010312, 13 page(s). [cited by applicant]
L. Zhang et al., “CE4-related: History-based Motion Vector Prediction”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 10-18, 2018, JVET-K0104-v5. [cited by applicant]
Li Zhang et al., “CE4-related: History-based Motion Vector Prediction”, JVET-K0104-v1, 11th Jvet Meeting held on Jul. 10-18, 2018, Lubljana, retrieved from URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_L… [cited by applicant]
Li Zhang, et al., “CE4-related: History-based Motion Vector Prediction”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018. JVET-K0104-v5. [cited by applicant]
Li Zhang, et al., “CE4-related: History-based Motion Vector Prediction”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0104-v4. [cited by applicant]
Non-Final Rejection Mailed on Apr. 9, 2020 for U.S. Appl. No. 16/790,089, 9 page(s). [cited by applicant]
Non-Final Rejection Mailed on Jul. 18, 2023 for U.S. Appl. No. 17/942,655, 7 page(s). [cited by applicant]
Non-Final Rejection Mailed on Sep. 30, 2021 for U.S. Appl. No. 17/065,822, 10 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Jul. 15, 2020 for U.S. Appl. No. 16/790,089, 7 page (s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Jul. 22, 2024 for U.S. Appl. No. 18/396,416, 8 page (s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Jun. 16, 2022 for U.S. Appl. No. 17/065,822, 8 page (s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Sep. 27, 2023 for U.S. Appl. No. 17/942,655, 8 page (s). [cited by applicant]
Notice of Allowance for Chinese Application No. 201980053553.4 dated May 12, 2023, 6 pages. [cited by applicant]
Notice of Allowance for Vietnamese Application No. 1-2021-00440 dated Sep. 23, 2025, 2 pages. [cited by applicant]
Notice of Reasons for Refusal for Japanese Application No. 2021-506710 dated Mar. 29, 2022, 10 pages. [cited by applicant]
Office Action for European Application No. 19850303.9 dated Dec. 20, 2023, 3 pages. [cited by applicant]
Office Action for European Application No. 19850303.9 dated Dec. 21, 2022, 4 pages. [cited by applicant]
Office Action for European Application No. 19850303.9 dated Jan. 5, 2022, 7 pages. [cited by applicant]
Office Action for European Application No. 19850303.9 dated Jun. 17, 2022, 6 pages. [cited by applicant]
Office Action for European Application No. 19850303.9 dated Jun. 22, 2023, 5 pages. [cited by applicant]
Office Action for European Application No. 19850303.9 dated May 28, 2024, 5 pages. [cited by applicant]
Office Action for Korean Application No. 10-2021-7000858 dated Sep. 23, 2022, 8 pages. [cited by applicant]
Office Action for Korean Application No. 10-2023-7018724 dated Feb. 13, 2024, 6 pages. [cited by applicant]
Office Action for Vietnamese Application No. 1-2020-00440 dated Aug. 22, 2023, 3 pages. [cited by applicant]
Outgoing—ISA/210—International Search Report Mailed on Nov. 21, 2019 for WO Application No. PCT/KR19/010312, 5 page(s). [cited by applicant]
Outgoing Written Opinion of the ISA Mailed on Nov. 21, 2019 for WO Application No. PCT/KR19/010312, 10 page (s). [cited by applicant]
Rejection Decision for Brazilian Application No. BR112021002604-5 dated Mar. 8, 2022, 7 pages. [cited by applicant]
Rejection Decision for Brazilian Application No. BR122021008227-3 dated Mar. 8, 2022, 7 pages. [cited by applicant]
Written Decision on Registration for Korean Application No. 10-2021-7000858 dated Mar. 6, 2023, 10 pages. [cited by applicant]
Written Decision on Registration for Korean Application No. 10-2023-018724 dated Oct. 14, 2024, 10 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR112021002604-5 dated Sep. 21, 2021, 12 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR122021008224-3 dated Sep. 21, 2021, 13 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR122021008228-6 dated Mar. 8, 2022, 7 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR122021008228-6 dated Sep. 21, 2021, 12 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR122021008241-3 dated Mar. 8, 2022, 7 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR122021008241-3 dated May 23, 2023, 10 pages. [cited by applicant]
Written Opinion for Brazilian Application No. BR122021008241-3 dated Sep. 21, 2021, 11 pages. [cited by applicant]
Office Action for Chinese Application No. 202310931327.X dated Apr. 11, 2026, 10 pages. [cited by applicant]