IP Library Granted Patent US 11,553,176
Granted Patent B2
US 11,553,176 · App. 17/547,151 · Granted Jan 10, 2023

Sbtmvp-based image or video coding

Inventors: Hyeongmoon Jang (Seoul, KR); Naeri Park (Seoul, KR); Junghak Nam (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/105H04N19/132H04N19/137H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,553,176
App. No.
17/547,151
Granted
Jan 10, 2023
Kind
B2
Abstract

According to the disclosure of this document, in subblock-based temporal motion vector prediction (sbTMVP), a subblock position for deriving a motion vector in units of a subblock can be efficiently calculated, and through this, video/image coding efficiency can be improved and hardware implementation can be simplified.

Claims (46)

1. An image decoding method performed by a decoding apparatus, the method comprising:

deriving a reference subblock on a collocated reference picture for a current subblock within a current block;

deriving a motion vector of the reference subblock;

deriving a subblock temporal motion vector predictor (sbTMVP) candidate based on the motion vector of the reference subblock;

generating prediction samples based on a motion vector of the current subblock derived based on the sbTMVP candidate;

generating residual samples for the current block; and

generating reconstruction samples based on the prediction samples and the residual samples,

wherein for the reference subblock that is not available, the motion vector of the reference subblock is set as a base motion vector,

wherein the base motion vector is derived on the collocated reference picture based on a position of the current block derived based on a position of a center lower-right sample among four samples positioned at a center within the current block, and

wherein the reference subblock that is available is derived on the collocated reference picture based on a position of the current subblock derived based on a position of a center lower-right sample among four samples positioned at a center within the current subblock.

2. The image decoding method of claim 1 , wherein for the current block being equal to a size of 8×8, the motion vector and base motion vector of the reference subblock are derived based on a center lower-right sample position of the current block.

3. The image decoding method of claim 1 , wherein for the current block being equal to a size of 16×8, 8×16, 16×16, or greater, the motion vector of the reference subblock is derived based on a center lower-right sample position of the subblock, and the base motion vector of the reference subblock is derived based on a center lower-right sample position of the current block.

4. The image decoding method of claim 1 , wherein the sbTMVP candidate is derived based on a motion vector of an available reference subblock,

wherein the motion vector of the available reference subblock is derived based on a motion vector of a block covering a modified location derived based on a top-left sample position of the reference subblock.

5. The image decoding method of claim 4 , wherein the modified location is derived by an equation ((xColSb >>3)<<3, (yColSb >>3)<<3),

wherein the xColSb and the yColSb represent x coordinate and y coordinate of the top-left sample position of the reference subblock, respectively, and >> represents an arithmetic right shift, and << represents an arithmetic left shift.

6. The image decoding method of claim 1 , wherein the unavailable reference subblock includes a reference subblock positioned outside the collocated reference picture or a reference subblock whose motion vector is not available.

7. The image decoding method of claim 6 , wherein for the reference subblock that is an intra mode, an IBC (intra block copy) mode, or a palette mode, it is derived that the motion vector is not available.

8. An image encoding method performed by an encoding apparatus, the method comprising:

deriving a reference subblock on a collocated reference picture for a current subblock within a current block;

deriving a motion vector of the reference subblock;

deriving a subblock temporal motion vector predictor (sbTMVP) candidate based on the motion vector of the reference subblock;

generating prediction samples based on a motion vector of the current subblock derived based on the sbTMVP candidate;

generating residual samples based on the prediction samples; and

encoding image information including information on the residual samples,

wherein for the reference subblock that is not available, the motion vector of the reference subblock is set as a base motion vector,

wherein the base motion vector is derived on the collocated reference picture based on a position of the current block derived based on a position of a center lower-right sample among four samples positioned at a center within the current block, and

wherein the reference subblock that is available is derived on the collocated reference picture based on a position of the current subblock derived based on a position of a center lower-right sample among four samples positioned at a center within the current subblock.

9. The image encoding method of claim 8 , wherein for the current block being equal to a size of 8×8, the motion vector and base motion vector of the reference subblock are derived based on a center lower-right sample position of the current block.

10. The image encoding method of claim 8 , wherein for the current block being equal to a size of 16×8, 8×16, 16×16, or greater, the motion vector of the reference subblock is derived based on a center lower-right sample position of the current subblock, and the base motion vector of the reference subblock is derived based on a center lower-right sample position of the current block.

11. The image encoding method of claim 8 , wherein the sbTMVP candidate is derived based on a motion vector of an available reference subblock,

wherein the motion vector of the available reference subblock is derived based on a motion vector of a block covering a modified location derived based on a top-left sample position of the reference subblock.

12. The image encoding method of claim 11 , wherein the modified location is derived by an equation ((xColSb >>3)<<3, (yColSb >>3)<<3),

wherein the xColSb and the yColSb represent x coordinate and y coordinate of the top-left sample position of the reference subblock, respectively, and >> represents an arithmetic right shift, and <<represents an arithmetic left shift.

13. The image encoding method of claim 8 , wherein the unavailable reference subblock includes a reference subblock positioned outside the collocated reference picture or a reference subblock whose motion vector is not available.

14. The image encoding method of claim 13 , wherein for the reference subblock that is an intra mode, an IBC (intra block copy) mode, or a palette mode, it is derived that the motion vector is not available.

15. A non-transitory computer-readable digital storage medium storing a bitstream generated by a method, the method comprising:

deriving a reference subblock on a collocated reference picture for a current subblock within a current block;

deriving a motion vector of the reference subblock;

deriving a subblock temporal motion vector predictor (sbTMVP) candidate based on the motion vector of the reference subblock;

generating prediction samples based on a motion vector of the current subblock derived based on the sbTMVP candidate;

generating residual samples based on the prediction samples; and

encoding image information including information on the residual samples to generate the bitstream,

wherein for the reference subblock that is not available, the motion vector of the reference subblock is set as a base motion vector,

wherein the base motion vector is derived on the collocated reference picture based on a position of the current block derived based on a position of a center lower-right sample among four samples positioned at a center within the current block, and

wherein the reference subblock that is available is derived on the collocated reference picture based on a position of the current subblock derived based on a position of a center lower-right sample among four samples positioned at a center within the current subblock.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2021
From: JANG, HYEONGMOON; PARK, NAERI; NAM, JUNGHAK
To: LG ELECTRONICS INC.
Reel/Frame 058353/0851 →
Continuity (3)
Continuation PCTKR2020007715 · Jun 15, 2020
Provisional Application 62861285 · Jun 13, 2019
Related Publication 20220103808A1 · Mar 31, 2022
Cited By (1)
US 12,284,335