IP Library Granted Patent US 12,284,335
Granted Patent B2
US 12,284,335 · App. 18/371,733 · Granted Apr 22, 2025

SBTMVP-based inter prediction method and apparatus

Inventors: Hyeongmoon Jang (Seoul, KR); Junghak Nam (Seoul, KR)
Assignee: VIVO MOBILE COMMUNICATION CO., LTD.
H04N19/105H04N19/132H04N19/159H04N19/176H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,284,335
App. No.
18/371,733
Granted
Apr 22, 2025
Kind
B2
Abstract

A method by which a decoding device performs image decoding, according to the present document, comprises the steps of: deriving a reference block on the basis of a motion shift; determining whether a subblock temporal motion vector predictor (sbTMVP) candidate is available, on the basis of whether the reference block is a current picture referencing (CPR) block; deriving motion information about a current block on the basis of the sbTMVP candidate when the sbTMVP candidate is available; generating prediction samples on the basis of the motion information; and generating a restored picture on the basis of the prediction samples, wherein the sbTMVP candidate is determined to be unavailable with respect to the reference block which is the CPR block.

Claims (58)

1. An image decoding apparatus, comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

derive a reference block based on a motion vector;

determine availability of a subblock-based temporal motion vector predictor (sbTMVP) candidate for a current block, based on a prediction mode of the reference block;

derive motion information for subblocks of the current block based on a case where the sbTMVP candidate is available;

generate predicted samples based on the motion information for the subblocks of the current block; and

generate a reconstructed picture based on the predicted samples and residual samples,

wherein the motion information for the subblocks of the current block is derived by performing:

deriving a reference subblock for a subblock among the subblocks in the current block based on the motion vector, in a reference picture including the reference block; and

deriving motion information for the subblock based on whether the reference subblock is available,

wherein whether the reference subblock is available is determined based on a prediction mode of the reference subblock,

wherein the reference subblock is determined as unavailable based on the prediction mode of the reference subblock being a current picture referencing (CPR) mode, and

wherein, based on the reference subblock being determined as unavailable, the motion information for the subblock corresponding to the unavailable reference subblock is derived as base motion information.

2. The image decoding apparatus of claim 1 , wherein based on a case where the prediction mode of the reference block is not an inter prediction mode or a first reference picture to which the reference block refers and a second reference picture in which the reference block is positioned are the same, it is determined that the sbTMVP candidate is not available.

3. The image decoding apparatus of claim 1 , wherein based on a case where the prediction mode of the reference block is an inter prediction mode and a first reference picture to which the reference block refers and a second reference picture in which the reference block is positioned are not the same, it is determined that the sbTMVP candidate is available.

4. The image decoding apparatus of claim 1 , the at least one processor further configured to construct a motion information candidate list for the current block,

wherein based on a case where the sbTMVP candidate is available, the sbTMVP candidate is included in the motion information candidate list, and

wherein based on a case where the sbTMVP candidate is not available, the sbTMVP candidate is excluded from the motion information candidate list.

5. The image decoding apparatus of claim 1 , wherein the reference block is derived by performing:

deriving a motion vector from a spatial neighboring block of the current block;

performing a motion shift to a position indicated by the motion vector of the spatial neighboring block based on a position of a center sample of the current block; and

deriving the reference block based on the motion-shifted position.

6. The image decoding apparatus of claim 5 , wherein the spatial neighboring block is a left neighboring block positioned at a left of the current block, and

wherein the motion vector of the spatial neighboring block is a motion vector derived from the left neighboring block based on whether the left neighboring block is available.

7. An image encoding apparatus, comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

derive a reference block based on a motion vector;

determine availability of a subblock-based temporal motion vector predictor (sbTMVP) candidate for a current block, based on a prediction mode of the reference block;

derive motion information for subblocks of the current block based on a case where the sbTMVP candidate is available;

generate predicted samples based on the motion information for the subblocks of the current block;

generate residual samples based on the predicted samples and samples of the current block; and

encode image information including information on the residual samples,

wherein the motion information for the subblocks of the current block is derived by performing:

deriving a reference subblock for a subblock among the subblocks in the current block based on the motion vector, in a reference picture including the reference block; and

deriving motion information for the subblock based on whether the reference subblock is available,

wherein whether the reference subblock is available is determined based on a prediction mode of the reference subblock,

wherein the reference subblock is determined as unavailable based on the prediction mode of the reference subblock being a current picture referencing (CPR) mode, and

wherein, based on the reference subblock being determined as unavailable, the motion information for the subblock corresponding to the unavailable reference subblock is derived as base motion information.

8. The image encoding apparatus of claim 7 , wherein based on a case where the prediction mode of the reference block is not an inter prediction mode or a first reference picture to which the reference block refers and a second reference picture in which the reference block is positioned are the same, it is determined that the sbTMVP candidate is not available.

9. The image encoding apparatus of claim 7 , wherein based on a case where the prediction mode of the reference block is an inter prediction mode and a first reference picture to which the reference block refers and a second reference picture in which the reference block is positioned are not the same, it is determined that the sbTMVP candidate is available.

10. An apparatus for transmitting data for image, the apparatus comprising:

at least one processor configured to obtain a bitstream generated by an image encoding method; and

a transmitter configured to transmit the data comprising the bitstream;

wherein the image encoding method comprising:

deriving a reference block based on a motion vector;

determining availability of a subblock-based temporal motion vector predictor (sbTMVP) candidate for a current block, based on a prediction mode of the reference block;

deriving motion information for subblocks of the current block based on a case where the sbTMVP candidate is available;

generating predicted samples based on the motion information for the subblocks of the current block;

generating residual samples based on the predicted samples and samples of the current block; and

encoding image information including information on the residual samples,

wherein the deriving the motion information for the subblocks of the current block comprises:

deriving a reference subblock for a subblock among the subblocks in the current block based on the motion vector, in a reference picture including the reference block; and

deriving motion information for the subblock based on whether the reference subblock is available,

wherein whether the reference subblock is available is determined based on a prediction mode of the reference subblock,

wherein the reference subblock is determined as unavailable based on the prediction mode of the reference subblock being a current picture referencing (CPR) mode, and

wherein, based on the reference subblock being determined as unavailable, the motion information for the subblock corresponding to the unavailable reference subblock is derived as base motion information.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2024
From: LG ELECTRONICS INC.
To: VIVO MOBILE COMMUNICATION CO., LTD.
Reel/Frame 069312/0813 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2024
From: JANG, HYEONGMOON; NAM, JUNGHAK
To: LG ELECTRONICS INC.
Reel/Frame 069065/0536 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2023
From: JANG, HYEONGMOON; NAM, JUNGHAK
To: LG ELECTRONICS INC.
Reel/Frame 064997/0051 →
Continuity (3)
Continuation 17414893
Provisional Application 62787754 · Jan 2, 2019
Related Publication 20240022713A1 · Jan 18, 2024
References Cited (32)
US 11012715B2 · Zhang · 2021 [cited by examiner]
US 11140412B2 · Liu · 2021 [cited by examiner]
US 11368713B2 · Chen · 2022 [cited by examiner]
US 11470346B2 · Choi · 2022 [cited by examiner]
US 11553176B2 · Jang · 2023 [cited by examiner]
US 20130336407A1 · Chen · 2013 [cited by examiner]
US 20150085929A1 · Chen · 2015 [cited by examiner]
US 20160057420A1 · Pang et al. · 2016 [cited by applicant]
US 20160219278A1 · Chen · 2016 [cited by examiner]
US 20160330467A1 · Park · 2016 [cited by examiner]
US 20160366435A1 · Chien · 2016 [cited by examiner]
US 20170289566A1 · He · 2017 [cited by examiner]
US 20170302951A1 · Joshi · 2017 [cited by examiner]
US 20180176596A1 · Jeong et al. · 2018 [cited by applicant]
US 20180255316A1 · Zhang · 2018 [cited by examiner]
US 20180288430A1 · Chen · 2018 [cited by examiner]
US 20200413082A1 · Li · 2020 [cited by examiner]
US 20210314586A1 · Li · 2021 [cited by examiner]
US 20210392367A1 · Zhang · 2021 [cited by examiner]
US 20230115768A1 · Liao · 2023 [cited by examiner]
US 20230134017A1 · Chen · 2023 [cited by examiner]
CN 108353166A · 2018 [cited by applicant]
KR 1020170021819A · 2017 [cited by applicant]
KR 1020170066457A · 2017 [cited by applicant]
KR 101747058B1 · 2017 [cited by applicant]
Jianle Chen, “Algorithm description for Versatile Video Coding and Test Model 3 (VTM 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018. [cited by applicant]
International Search Report dated Apr. 20, 2020 in International Application No. PCT/KR2020/000027. English translation attached. [cited by applicant]
Written Opinion of the ISA dated Apr. 20, 2020 in International Application No. PCT/KR2020/000027. English translation attached. [cited by applicant]
First Office Action dated Dec. 15, 2023 received in corresponding patent family application No. CN202080007626.9. English translation attached. CN202080007626.9. [cited by applicant]
Grant Notice dated Mar. 29, 2024 received in corresponding patent family application No. English translation attached. [cited by applicant]
Non-Final Rejection dated Dec. 6, 2022 received in corresponding patent family U.S. Appl. No. 17/414,893. [cited by applicant]
Notice of Allowance dated Jun. 23, 2023 received in corresponding patent family U.S. Appl. No. 17/414,893. [cited by applicant]