IP Library Granted Patent US 11,949,874
Granted Patent B2
US 11,949,874 · App. 18/097,905 · Granted Apr 2, 2024

Image encoding/decoding method and device for performing prof, and method for transmitting bitstream

Inventors: Nae Ri Park (Seoul, KR); Seung Hwan Kim (Seoul, KR); Jung Hak Nam (Seoul, KR); Hyeong Moon Jang (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/132H04N19/105H04N19/137H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,949,874
App. No.
18/097,905
Granted
Apr 2, 2024
Kind
B2
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method may comprise deriving a prediction sample of a current block based on motion information of the current block, determining whether prediction refinement with optical flow (PROF) applies to the current block, deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block, deriving a gradient for each sample position in the current block, deriving a PROF offset based on the difference motion vector and the gradient, and deriving a refined prediction sample for the current block based on the PROF offset.

Claims (46)

1. An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

deriving a prediction sample of a current block based on motion information of the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block;

deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block;

deriving a gradient for each sample position in the current block;

deriving a PROF offset based on the difference motion vector and the gradient; and

deriving a refined prediction sample for the current block based on the PROF offset,

wherein the deriving the gradient comprises right-shifting a neighboring prediction sample value at each sample position in the current block by a first shift, and

wherein a value of the first shift is fixed as 6.

2. The image decoding method of claim 1 ,

wherein the deriving the difference motion vector comprises clipping the rounded difference motion vector in a predetermined range, and

wherein the predetermined range is set based on a fixed value dmvLimit derived regardless of a bit depth of the current block.

3. The image decoding method of claim 2 ,

wherein the predetermined range is specified by a minimum value and a maximum value derived based on dmvLimit, and

wherein an absolute value of the minimum value and an absolute value of the maximum value are set to the same value.

4. The image decoding method of claim 3 ,

wherein the minimum value is (−dmvLimit+1) and the maximum value is (dmvLimit−1).

5. The image decoding method of claim 2 ,

wherein dmvLimit is (1<<5).

6. The image decoding method of claim 1 ,

wherein a PROF offset derived in the deriving the PROF offset is clipped in a predetermined range.

7. The image decoding method of claim 6 ,

wherein the predetermined range in which the PROF offset is clipped is set based on a value dILimit derived based on a bit depth of the current block.

8. The image decoding method of claim 7 ,

wherein the predetermined range in which the PROF offset is clipped is [−dILimit, dILimit−1].

9. The image decoding method of claim 7 ,

wherein dILimit is (1<<max(13, Bitdepth+1)).

10. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

deriving a prediction sample of a current block based on motion information of the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block;

deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block;

deriving a gradient for each sample position in the current block;

deriving a PROF offset based on the difference motion vector and the gradient; and

deriving a refined prediction sample for the current block based on the PROF offset,

wherein the deriving the gradient comprises right-shifting a neighboring prediction sample value at each sample position in the current block by a first shift, and

wherein a value of the first shift is fixed as 6.

11. A method of transmitting a bitstream generated by an image encoding method, the image encoding method comprising:

deriving a prediction sample of a current block based on motion information of the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block;

deriving, based on that the PROF applies to the current block, a difference motion vector for each sample position in the current block;

deriving a gradient for each sample position in the current block;

deriving a PROF offset based on the difference motion vector and the gradient; and

deriving a refined prediction sample for the current block based on the PROF offset,

wherein the deriving the gradient comprises right-shifting a neighboring prediction sample value at each sample position in the current block by a first shift, and

wherein a value of the first shift is fixed as 6.

12. A non-transitory computer-readable medium storing a bitstream generated by the image encoding method of claim 10 .

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2023
From: PARK, NAE RI; KIM, SEUNG HWAN; NAM, JUNG HAK; JANG, HYEONG MOON
To: LG ELECTRONICS INC.
Reel/Frame 062398/0353 →
Continuity (5)
Continuation 17683203 · Feb 28, 2022
Continuation PCTKR2020011470 · Aug 27, 2020
Provisional Application 62904654 · Sep 23, 2019
Provisional Application 62894765 · Aug 31, 2019
Related Publication 20230156196A1 · May 18, 2023
Cited By (1)
US 12,395,635