IP Library Granted Patent US 11,589,053
Granted Patent B2
US 11,589,053 · App. 17/683,203 · Granted Feb 21, 2023

Image encoding/decoding method and device for performing PROF, and method for transmitting bitstream

Inventors: Nae Ri Park (Seoul, KR); Seung Hwan Kim (Seoul, KR); Jung Hak Nam (Seoul, KR); Hyeong Moon Jang (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/132H04N19/105H04N19/137H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,589,053
App. No.
17/683,203
Granted
Feb 21, 2023
Kind
B2
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method may comprise deriving a prediction sample of a current block based on motion information of the current block, determining whether prediction refinement with optical flow (PROF) applies to the current block, deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block, deriving a gradient for each sample position in the current block, deriving a PROF offset based on the difference motion vector and the gradient, and deriving a refined prediction sample for the current block based on the PROF offset.

Claims (51)

1. An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

deriving a prediction sample of a current block based on motion information of the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block;

deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block;

deriving a gradient for the each sample position in the current block;

deriving a PROF offset based on the difference motion vector and the gradient; and

deriving a refined prediction sample for the current block based on the PROF offset,

wherein the deriving the difference motion vector comprises rounding of the difference motion vector, and

wherein the rounding of the difference motion vector generates a rounded difference motion vector by right-shifting the difference motion vector by 8.

2. The image decoding method of claim 1 ,

wherein the deriving the difference motion vector comprises clipping the rounded difference motion vector in a predetermined range, and

wherein the predetermined range is set based on a fixed value dmvLimit derived regardless of a bit depth of the current block.

3. The image decoding method of claim 2 ,

wherein the predetermined range is specified by a minimum value and a maximum value derived based on the dmvLimit, and

wherein an absolute value of the minimum value and an absolute value of the maximum value are set to a same value.

4. The image decoding method of claim 3 ,

wherein the minimum value is (−dmvLimit+1) and the maximum value is (dmvLimit−1).

5. The image decoding method of claim 2 ,

wherein the dmvLimit is (1<<5).

6. The image decoding method of claim 1 ,

wherein the deriving the gradient comprises right-shifting a neighboring prediction sample value at the each sample position in the current block by a first shift, and

wherein the first shift is set to a fixed value regardless of a bit depth of the current block.

7. The image decoding method of claim 6 ,

wherein the first shift is 6.

8. The image decoding method of claim 1 ,

wherein a PROF offset derived in the deriving the PROF offset is clipped in a predetermined range.

9. The image decoding method of claim 8 ,

wherein the predetermined range in which the PROF offset is clipped is set based on a value dILimit derived based on a bit depth of the current block.

10. The image decoding method of claim 9 ,

wherein the predetermined range in which the PROF offset is clipped is [−dILimit, dILimit − 1 ].

11. The image decoding method of claim 9 ,

wherein the dILimit is (1<<max(13, Bitdepth+1)).

12. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

deriving a prediction sample of a current block based on motion information of the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block;

deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block;

deriving a gradient for the each sample position in the current block;

deriving a PROF offset based on the difference motion vector and the gradient; and

deriving a refined prediction sample for the current block based on the PROF offset,

wherein the deriving the difference motion vector comprises rounding of the difference motion vector, and

wherein the rounding of the difference motion vector generates a rounding difference motion vector by right-shifting the difference motion vector by 8.

13. A method of transmitting a bitstream generated by the image encoding method of claim 12 .

14. A non-transitory computer-readable medium storing a bitstream generated by an image encoding method, the image encoding method comprising:

deriving a prediction sample of a current block based on motion information of the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block;

deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block;

deriving a gradient for the each sample position in the current block;

deriving a PROF offset based on the difference motion vector and the gradient; and

deriving a refined prediction sample for the current block based on the PROF offset,

wherein the deriving the difference motion vector comprises rounding of the difference motion vector, and

wherein the rounding of the difference motion vector generates a rounded difference motion vector by right-shifting the difference motion vector by 8.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2022
From: PARK, NAE RI; KIM, SEUNG HWAN; NAM, JUNG HAK; JANG, HYEONG MOON
To: LG ELECTRONICS INC.
Reel/Frame 059124/0078 →
Continuity (4)
Continuation PCTKR2020011470 · Aug 27, 2020
Provisional Application 62904654 · Sep 23, 2019
Provisional Application 62894765 · Aug 31, 2019
Related Publication 20220256162A1 · Aug 11, 2022