IP Library Granted Patent US 12,316,849
Granted Patent B2
US 12,316,849 · App. 18/417,903 · Granted May 27, 2025

Image encoding/decoding method and device for performing prof, and method for transmitting bitstream

Inventors: Nae Ri Park (Seoul, KR); Jung Hak Nam (Seoul, KR); Hyeong Moon Jang (Seoul, KR)
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
H04N19/132H04N19/105H04N19/137H04N19/176H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,316,849
App. No.
18/417,903
Granted
May 27, 2025
Kind
B2
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method comprises deriving a prediction sample of a current block based on motion information of the current block, deriving a reference picture resampling (RPR) condition for the current block, determining whether prediction refinement with optical flow (PROF) applies to the current block based on the RPR condition, and deriving a refined prediction sample for the current block by applying PROF to the current block.

Claims (37)

1. An image decoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

derive a prediction sample of a current block based on motion information of the current block;

derive a reference picture resampling (RPR) condition for the current block;

determine whether prediction refinement with optical flow (PROF) applies to the current block based on the RPR condition; and

derive a refined prediction sample for the current block by applying PROF to the current block,

wherein the RPR condition is derived based on a width of the reference picture of the current block being different from that of the current picture or a height of the reference picture of the current block being different from that of the current picture.

2. The image decoding apparatus of claim 1 ,

wherein the RPR condition is derived as a first value, based on the width of the reference picture of the current block being different from that of the current picture or the height of the reference picture of the current block being different from that of the current picture, and

wherein the RPR condition is derived as a second value, based on the width of the reference picture of the current block being equal to that of the current picture and the height of the reference picture of the current block being equal to that of the current picture.

3. The image decoding apparatus of claim 2 , wherein it is determined that PROF does not apply to the current block, based on the RPR condition being the first value.

4. The image decoding apparatus of claim 1 , wherein whether PROF applies to the current block is determined based on a size of the current block.

5. The image decoding apparatus of claim 4 , wherein it is determined that PROF does not apply to the current block, based on a product of a width w of the current block and a height h of the current block being less than 128.

6. The image decoding apparatus of claim 1 , wherein information specifying whether the current block is an affine merge mode is parsed from a bitstream based on a size of the current block.

7. The image decoding apparatus of claim 6 , wherein the information specifying whether the current block is the affine merge mode is parsed from the bitstream, based on each of a width w of the current block and a height h of the current block being equal to or greater than 8 and w*h being equal to or greater than 128.

8. The image decoding apparatus of claim 1 , wherein information specifying whether the current block is an affine MVP mode is parsed from a bitstream based on a size of the current block.

9. The image decoding apparatus of claim 8 , wherein the information specifying whether the current block is the affine MVP mode is parsed from the bitstream, based on each of a width w of the current block and a height h of the current block being equal to or greater than 8 and w*h being equal to or greater than 128.

10. The image decoding apparatus of claim 1 , wherein whether PROF applies to the current block is determined based on whether BCW or WP applies to the current block.

11. The image decoding apparatus of claim 10 , wherein it is determined that PROF does not apply to the current block, based on BCW or WP applying to the current block.

12. An image encoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

derive a prediction sample of a current block based on motion information of the current block;

derive a reference picture resampling (RPR) condition for the current block;

determine whether prediction refinement with optical flow (PROF) applies to the current block based on the RPR condition; and

derive a refined prediction sample for the current block by applying PROF to the current block,

wherein the RPR condition is derived based on a width of the reference picture of the current block being different from that of the current picture or a height of the reference picture of the current block being different from that of the current picture.

13. An apparatus for transmitting a bitstream for an image, the apparatus comprising:

at least one processor configured to obtain the bitstream generated by an encoding apparatus; and

a transmitter configured to transmit the bitstream,

the bitstream is generated by:

deriving a prediction sample of a current block based on motion information of the current block;

deriving a reference picture resampling (RPR) condition for the current block;

determining whether prediction refinement with optical flow (PROF) applies to the current block based on the RPR condition; and

deriving a refined prediction sample for the current block by applying PROF to the current block,

wherein the RPR condition is derived based on a width of the reference picture of the current block being different from that of the current picture or a height of the reference picture of the current block being different from that of the current picture.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2024
From: PARK, NAE RI; NAM, JUNG HAK; JANG, HYEONG MOON
To: LG ELECTRONICS INC.
Reel/Frame 066219/0431 →
Continuity (6)
Continuation 17970124 · Oct 20, 2022
Continuation 17696619 · Mar 16, 2022
Continuation PCTKR2020012245 · Sep 10, 2020
Provisional Application 62909153 · Oct 1, 2019
Provisional Application 62902954 · Sep 19, 2019
Related Publication 20240244213A1 · Jul 18, 2024
References Cited (3)
US 11917157B2 · Park · 2024 [cited by examiner]
Xiu, X. et al. “CE4-related: Prediction sample padding unification for BDOF and PROF” Joint Video Experts Team (JVET) ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Jul. 2019, 4 pages. [cited by applicant]
Korean Patent Application No. 10-2022-7008627, Office Action dated Jan. 13, 2025, with English translation, 15 pages. [cited by applicant]