IP Library Granted Patent US 12,713,010
Granted Patent B2
US 12,713,010 · App. 18/962,637 · Granted Aug 18, 2026

Video encoding/decoding method and device for deriving weight index for bidirectional prediction of merge candidate, and method for transmitting bitstream

Inventors: Nae Ri Park (Seoul, KR); Jung Hak Nam (Seoul, KR); Hyeong Moon Jang (Seoul, KR)
Assignee: NOKIA TECHNOLOGIES OY
H04N19/105H04N19/137H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,713,010
App. No.
18/962,637
Granted
Aug 18, 2026
Kind
B2
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure may comprise constructing an affine merge candidate list for a current block, based on an inter prediction mode of the current block being an affine merge mode, selecting one affine merge candidate from the affine merge candidate list, deriving motion information of the current block based on motion information of the selected affine merge candidate, generating a prediction block of the current block based on the motion information of the current block, and reconstructing the current block based on the prediction block of the current block. The constructing the affine merge candidate list may comprise deriving a constructed affine merge candidate, and the deriving the constructed affine merge candidate may comprise deriving a weight index for bi-prediction of the constructed affine merge candidate.

Claims (80)

1 . An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

obtaining information on a subblock merge candidate;

constructing a subblock merge candidate list for a current block;

selecting one subblock merge candidate from the subblock merge candidate list based on the information on the subblock merge candidate;

deriving motion information of the current block based on motion information of the selected subblock merge candidate; and

generating prediction samples of the current block based on the motion information of the current block,

wherein the constructing the subblock merge candidate list comprises deriving a constructed subblock merge candidate, and the deriving the constructed subblock merge candidate comprises deriving a weight index for bi-prediction of the constructed subblock merge candidate,

wherein the deriving the constructed subblock merge candidate is performed based on motion information of each candidate control point (CP) included in a combination of predefined candidate CPs among a plurality of candidate CPs for the current block,

wherein the predefined candidate CPs have a predetermined order in the combination,

wherein the weight index of the constructed subblock merge candidate is derived based on the order in the combination of the predefined candidate CPs, and

wherein the weight index of the constructed subblock merge candidate is derived as a weight index of the first candidate CP among the candidate CPs in the combination.

2 . The image decoding method of claim 1 ,

wherein the motion information of the candidate CP is derived based on motion information of a candidate block for the candidate CP, and

wherein the candidate block is an available candidate block among at least one candidate block for the candidate CP.

3 . The image decoding method of claim 1 , wherein the motion information of the candidate CP comprises a weight index for bi-prediction, and the weight index for bi-prediction is derived based on the candidate CP being a top-left candidate CP or top-right candidate CP for the current block.

4 . The image decoding method of claim 1 , wherein the motion information of the candidate CP comprises a weight index for bi-prediction, and the weight index for bi-prediction is not derived based on the candidate CP being a bottom-left candidate CP or bottom-right candidate CP for the current block.

5 . The image decoding method of claim 2 , wherein the candidate CP is determined to be unavailable based on an available candidate block among at least one candidate block for the candidate CP being not present.

6 . The image decoding method of claim 5 , wherein the deriving the constructed subblock merge candidate is performed based on all candidate CPs included in the combination of the predefined candidate CPs being available.

7 . The image decoding method of claim 1 ,

wherein the weight index of the constructed subblock merge candidate is derived based on whether a prediction direction for the combination is available, and

wherein whether the prediction direction for the combination is available is derived based on motion information of the candidate CPs included in the combination.

8 . The image decoding method of claim 7 , wherein, based on whether the prediction direction for the combination being available for both an L0 direction and an L1 direction, the weight index of the constructed subblock merge candidate is derived as the weight index of the first candidate CP.

9 . The image decoding method of claim 8 , wherein, based on whether the prediction direction for the combination being unavailable for at least one of the L0 direction or the L1 direction, the weight index of the constructed subblock merge candidate is derived as a predetermined weight index.

10 . An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

constructing a subblock merge candidate list for a current block;

generating prediction samples of the current block based on motion information of a subblock merge candidate included in the subblock merge candidate list; and

encoding information on the subblock merge candidate,

wherein the constructing the subblock merge candidate list comprises deriving a constructed subblock merge candidate, and the deriving the constructed subblock merge candidate comprises deriving a weight index for bi-prediction of the constructed subblock merge candidate,

wherein the deriving the constructed subblock merge candidate is performed based on motion information of each candidate control point (CP) included in a combination of predefined candidate CPs among a plurality of candidate CPs for the current block,

wherein the predefined candidate CPs have a predetermined order in the combination,

wherein the weight index of the constructed subblock merge candidate is derived based on the order in the combination of the predefined candidate CPs, and

wherein the weight index of the constructed subblock merge candidate is derived as a weight index of the first candidate CP among the candidate CPs in the combination.

11 . A method of transmitting a bitstream generated by an image encoding method, the image encoding method comprising:

constructing a subblock merge candidate list for a current block;

generating prediction samples of the current block based on motion information of a subblock merge candidate included in the subblock merge candidate list; and

encoding information on the subblock merge candidate,

wherein the constructing the subblock merge candidate list comprises deriving a constructed subblock merge candidate, and the deriving the constructed subblock merge candidate comprises deriving a weight index for bi-prediction of the constructed subblock merge candidate,

wherein the deriving the constructed subblock merge candidate is performed based on motion information of each candidate control point (CP) included in a combination of predefined candidate CPs among a plurality of candidate CPs for the current block,

wherein the predefined candidate CPs have a predetermined order in the combination,

wherein the weight index of the constructed subblock merge candidate is derived based on the order in the combination of the predefined candidate CPs, and

wherein the weight index of the constructed subblock merge candidate is derived as a weight index of the first candidate CP among the candidate CPs in the combination.

12 . An image decoding apparatus comprising a memory and at least one processor, wherein the at least one processor is configured to perform:

obtaining information on a subblock merge candidate;

constructing a subblock merge candidate list for a current block;

selecting one subblock merge candidate from the subblock merge candidate list based on the information on the subblock merge candidate;

deriving motion information of the current block based on motion information of the selected subblock merge candidate; and

generating prediction samples of the current block based on the motion information of the current block,

wherein the constructing the subblock merge candidate list comprises deriving a constructed subblock merge candidate, and the deriving the constructed subblock merge candidate comprises deriving a weight index for bi-prediction of the constructed subblock merge candidate,

wherein the deriving the constructed subblock merge candidate is performed based on motion information of each candidate control point (CP) included in a combination of predefined candidate CPs among a plurality of candidate CPs for the current block,

wherein the predefined candidate CPs have a predetermined order in the combination,

wherein the weight index of the constructed subblock merge candidate is derived based on the order in the combination of the predefined candidate CPs, and

wherein the weight index of the constructed subblock merge candidate is derived as a weight index of the first candidate CP among the candidate CPs in the combination.

13 . The image decoding apparatus of claim 12 ,

wherein the motion information of the candidate CP is derived based on motion information of a candidate block for the candidate CP, and

wherein the candidate block is an available candidate block among at least one candidate block for the candidate CP.

14 . The image decoding apparatus of claim 12 , wherein the motion information of the candidate CP comprises a weight index for bi-prediction, and the weight index for bi-prediction is derived based on the candidate CP being a top-left candidate CP or top-right candidate CP for the current block.

15 . The image decoding apparatus of claim 12 , wherein the motion information of the candidate CP comprises a weight index for bi-prediction, and the weight index for bi-prediction is not derived based on the candidate CP being a bottom-left candidate CP or bottom-right candidate CP for the current block.

16 . The image decoding apparatus of claim 13 , wherein the candidate CP is determined to be unavailable based on an available candidate block among at least one candidate block for the candidate CP being not present.

17 . The image decoding apparatus of claim 16 , wherein the deriving the constructed subblock merge candidate is performed based on all candidate CPs included in the combination of the predefined candidate CPs being available.

18 . The image decoding apparatus of claim 12 ,

wherein the weight index of the constructed subblock merge candidate is derived based on whether a prediction direction for the combination is available, and

wherein whether the prediction direction for the combination is available is derived based on motion information of the candidate CPs included in the combination.

19 . An image encoding apparatus comprising a memory and at least one processor, wherein the at least one processor is configured to perform:

constructing a subblock merge candidate list for a current block;

generating prediction samples of the current block based on motion information of a subblock merge candidate included in the subblock merge candidate list; and

encoding information on the subblock merge candidate,

wherein the constructing the subblock merge candidate list comprises deriving a constructed subblock merge candidate, and the deriving the constructed subblock merge candidate comprises deriving a weight index for bi-prediction of the constructed subblock merge candidate,

wherein the deriving the constructed subblock merge candidate is performed based on motion information of each candidate control point (CP) included in a combination of predefined candidate CPs among a plurality of candidate CPs for the current block,

wherein the predefined candidate CPs have a predetermined order in the combination,

wherein the weight index of the constructed subblock merge candidate is derived based on the order in the combination of the predefined candidate CPs, and

wherein the weight index of the constructed subblock merge candidate is derived as a weight index of the first candidate CP among the candidate CPs in the combination.

20 . An apparatus comprising a memory and at least one processor, wherein the apparatus is configured to transmit a bitstream generated by an image encoding method, the image encoding method comprising:

constructing a subblock merge candidate list for a current block;

generating prediction samples of the current block based on motion information of a subblock merge candidate included in the subblock merge candidate list; and

encoding information on the subblock merge candidate,

wherein the constructing the subblock merge candidate list comprises deriving a constructed subblock merge candidate, and the deriving the constructed subblock merge candidate comprises deriving a weight index for bi-prediction of the constructed subblock merge candidate,

wherein the deriving the constructed subblock merge candidate is performed based on motion information of each candidate control point (CP) included in a combination of predefined candidate CPs among a plurality of candidate CPs for the current block,

wherein the predefined candidate CPs have a predetermined order in the combination,

wherein the weight index of the constructed subblock merge candidate is derived based on the order in the combination of the predefined candidate CPs, and

wherein the weight index of the constructed subblock merge candidate is derived as a weight index of the first candidate CP among the candidate CPs in the combination.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 27, 2024
From: PARK, NAE RI; NAM, JUNG HAK; JANG, HYEONG MOON
To: LG ELECTRONICS INC.
Reel/Frame 069424/0978 →
Continuity (5)
Continuation 17564640 · Dec 29, 2021
Continuation PCTKR2020008798 · Jul 6, 2020
Provisional Application 62884658 · Aug 8, 2019
Provisional Application 62871067 · Jul 5, 2019
Related Publication 20250175590A1 · May 29, 2025
References Cited (49)
US 20180098063A1 · Chen et al. · 2018 [cited by applicant]
US 20180131943A1 · Park et al. · 2018 [cited by applicant]
US 20190058896A1 · Huang et al. · 2019 [cited by applicant]
US 20190158870A1 · Xu et al. · 2019 [cited by applicant]
US 20190230350A1 · Chen et al. · 2019 [cited by applicant]
US 20210337196A1 · Lee · 2021 [cited by examiner]
US 20220060718A1 · Zhang · 2022 [cited by examiner]
CN 108605137A · 2018 [cited by applicant]
GB 2578150A · 2020 [cited by applicant]
KR 1020090012926A · 2009 [cited by applicant]
KR 1020170124080A · 2017 [cited by applicant]
KR 1020190018624A · 2019 [cited by applicant]
WO 2016175549A1 · 2016 [cited by applicant]
WO 2017148345A1 · 2017 [cited by applicant]
WO 2018226066A1 · 2018 [cited by applicant]
A. Robert et al., “Non-CE4: BCW inheritance for pairwise”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3-12, 2019, JVET-O0516. [cited by applicant]
Advisory Action (PTOL-303) Mailed on Feb. 24, 2023 for U.S. Appl. No. 17/564,640, 3 page(s). [cited by applicant]
Advisory Action (PTOL-303) Mailed on Jul. 5, 2023 for U.S. Appl. No. 17/564,640, 3 page(s). [cited by applicant]
Advisory Action (PTOL-303) Mailed on Nov. 2, 2022 for U.S. Appl. No. 17/564,640, 3 page(s). [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Document JVET-N1001-v8, (Mar. 19-27, 2019), 400 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Document: JVET-N1001-v10, (Mar. 19-27, 2019), 406 pages. [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 5 (VTM 5)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Document: JVET-N1002-v2, (Mar. 1… [cited by applicant]
Chen, Jie et al. Non-CE2: Gbi inheritance for constructed affine merge candidate. JVET-N481. Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. 14th Meeting: Geneva, CH. Mar. 22, 2019. Se… [cited by applicant]
Decision to Grant for Chinese Application No. 202080062596.1 dated Jul. 19, 2024, 6 pages. [cited by applicant]
Decision to Grant for Japanese Application No. 2022-500060 dated May 9, 2023, 6 pages. [cited by applicant]
Decision to Grant for Japanese Application No. 2023-099756 dated Jul. 2, 2024, 6 pages. [cited by applicant]
Decision to Grant for Japanese Application No. 2024-122996 dated Apr. 30, 2025, 6 pages. [cited by applicant]
Decision to Grant for Japanese Application No. 2025-090698 dated Jan. 20, 2026, 6 pages. [cited by applicant]
Extended European Search Report for European Application No. 20836552.8 dated May 31, 2023, 10 pages. [cited by applicant]
Final Rejection Mailed on Apr. 13, 2023 for U.S. Appl. No. 17/564,640, 23 page(s). [cited by applicant]
Final Rejection Mailed on Dec. 8, 2022 for U.S. Appl. No. 17/564,640, 20 page(s). [cited by applicant]
Final Rejection Mailed on Sep. 1, 2022 for U.S. Appl. No. 17/564,640, 18 page(s). [cited by applicant]
First Examination Report for Indian Application No. 202217005686 dated Apr. 28, 2022, 6 pages. [cited by applicant]
Hearing Notice for Indian Application No. 202217005686 dated Apr. 23, 2024, 2 pages. [cited by applicant]
N. Park et al., “Non-CE4: Simplifications on BCW index derivation process”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3-12, 2019, JVET-O0366. [cited by applicant]
N. Park et al., “Non-CE4: The proposed BCW index derivation for pairwise candidate”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3-12, 2019, JVET-O0367. [cited by applicant]
Non-Final Rejection Mailed on May 26, 2022 for U.S. Appl. No. 17/564,640, 13 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Aug. 21, 2024 for U.S. Appl. No. 17/564,640, 8 page (s). [cited by applicant]
Notice of Reasons for Refusal for Japanese Application No. 2022-500060 dated Jan. 17, 2023, 11 pages. [cited by applicant]
Notice of Reasons for Refusal for Japanese Application No. 2023-099756 dated Mar. 26, 2024, 6 pages. [cited by applicant]
Office Action for Chinese Application No. 202080062596.1 dated Mar. 22, 2024, 22 pages. [cited by applicant]
Office Action for Indonesian Application No. P00202200920 dated Feb. 18, 2025, 6 pages. [cited by applicant]
Office Action for Korean Application No. 10-2021-7042567 dated Aug. 16, 2024, 10 pages. [cited by applicant]
Office Action for Vietnamese Application No. 1-2022-00626 dated Sep. 23, 2025, 4 pages. [cited by applicant]
Office Action for Vietnamese Application No. 1-2022-00626 dated Sep. 9, 2024, 4 pages. [cited by applicant]
Outgoing—ISA/210—International Search Report Mailed on Sep. 29, 2020 for WO Application No. PCT/KR20/008798, 5 page(s). [cited by applicant]
Outgoing Written Opinion of the ISA Mailed on Sep. 29, 2020 for WO Application No. PCT/KR20/008798, 9 page (s). [cited by applicant]
Written Decision on Registration for Korean Application No. 10-2021-7042567 dated Mar. 19, 2025, 6 pages. [cited by applicant]
First Examination Report for Indian Application No. 202218060556 dated Apr. 29, 2026, 6 pages. [cited by applicant]