IP Library Granted Patent US 11,616,948
Granted Patent B2
US 11,616,948 · App. 17/703,291 · Granted Mar 28, 2023

Method and device for subpicture-based image encoding/decoding, and method for transmitting bitstream

Inventor: Hyeong Moon Jang (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/105H04N19/132H04N19/159H04N19/176H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,616,948
App. No.
17/703,291
Granted
Mar 28, 2023
Kind
B2
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method comprises determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) applies to a current block, based on BDOF or PROF applying to the current block, fetching a prediction sample of the current block from a reference picture of the current block based on motion information of the current block, and deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the fetched prediction sample.

Claims (50)

1. An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) is applied to a current block;

based on BDOF or PROF being applied to the current block, generating a prediction sample of the current block from a reference picture of the current block based on motion information of the current block; and

deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the generated prediction sample,

wherein the generating the prediction sample of the current block is performed based on whether a current subpicture including the current block is treated as a picture,

wherein the generating the prediction sample of the current block is performed based on a position inside the reference picture for generating the prediction sample,

wherein the position inside the reference picture is clipped in a predetermined range,

wherein, based on the current subpicture being treated as the picture, the predetermined range is specified by a boundary position of the current subpicture,

wherein the position inside the reference picture comprises an x-coordinate and a y-coordinate,

wherein the x-coordinate is clipped in a range of a left boundary position and right boundary position of the current subpicture,

wherein the y-coordinate is clipped in a range of a top boundary position and bottom boundary position of the current subpicture,

wherein the left boundary position of the current subpicture is derived as a product of position information of a predetermined unit specifying a left position of the current subpicture and a width of the predetermined unit,

wherein the right boundary position of the current subpicture is derived by performing “−1” operation on a product of position information of a predetermined unit specifying a right position of the current subpicture and a width of the predetermined unit,

wherein the top boundary position of the current subpicture is derived as a product of position information of a predetermined unit specifying a top position of the current subpicture and a height of the predetermined unit, and

wherein the bottom boundary position of the current subpicture is derived by performing “−1” operation on a product of position information of a predetermined unit specifying a bottom position of the current subpicture and a height of the predetermined unit.

2. The image decoding method of claim 1 , wherein whether the current subpicture is treated as the picture is determined based on flag information signaled through a bitstream.

3. The image decoding method of claim 2 , wherein the flag information is signaled through a sequence parameter set (SPS).

4. The image decoding method of claim 1 , wherein the predetermined unit is a grid or a CTU.

5. The image decoding method of claim 1 , wherein, based on the current subpicture being not treated as the picture, the predetermined range is a range of a current picture including the current block.

6. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) is applied to a current block;

based on BDOF or PROF being applied to the current block, generating a prediction sample of the current block from a reference picture of the current block based on motion information of the current block; and

deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the generated prediction sample,

wherein the generating the prediction sample of the current block is performed based on whether a current subpicture including the current block is treated as a picture,

wherein the generating the prediction sample of the current block is performed based on a position inside the reference picture for generating the prediction sample,

wherein the position inside the reference picture is clipped in a predetermined range,

wherein, based on the current subpicture being treated as the picture, the predetermined range is specified by a boundary position of the current subpicture,

wherein the position inside the reference picture comprises an x-coordinate and a y-coordinate,

wherein the x-coordinate is clipped in a range of a left boundary position and right boundary position of the current subpicture,

wherein the y-coordinate is clipped in a range of a top boundary position and bottom boundary position of the current subpicture,

wherein the left boundary position of the current subpicture is derived as a product of position information of a predetermined unit specifying a left position of the current subpicture and a width of the predetermined unit,

wherein the right boundary position of the current subpicture is derived by performing “−1” operation on a product of position information of a predetermined unit specifying a right position of the current subpicture and a width of the predetermined unit,

wherein the top boundary position of the current subpicture is derived as a product of position information of a predetermined unit specifying a top position of the current subpicture and a height of the predetermined unit, and

wherein the bottom boundary position of the current subpicture is derived by performing “−1” operation on a product of position information of a predetermined unit specifying a bottom position of the current subpicture and a height of the predetermined unit.

7. A method of transmitting a bitstream generated by the image encoding method of claim 6 .

8. A non-transitory computer readable recording medium storing a bitstream generated by an image encoding method, the image encoding method comprising;

determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) is applied to a current block;

based on BDOF or PROF being applied to the current block, generating a prediction sample of the current block from a reference picture of the current block based on motion information of the current block; and

deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the generated prediction sample,

wherein the generating the prediction sample of the current block is performed based on whether a current subpicture including the current block is treated as a picture,

wherein the generating the prediction sample of the current block is performed based on a position inside the reference picture for generating the prediction sample,

wherein the position inside the reference picture is clipped in a predetermined range,

wherein, based on the current subpicture being treated as the picture, the predetermined range is specified by a boundary position of the current subpicture,

wherein the position inside the reference picture comprises an x-coordinate and a y-coordinate,

wherein the x-coordinate is clipped in a range of a left boundary position and right boundary position of the current subpicture,

wherein the y-coordinate is clipped in a range of a top boundary position and bottom boundary position of the current subpicture,

wherein the left boundary position of the current subpicture is derived as a product of position information of a predetermined unit specifying a left position of the current subpicture and a width of the predetermined unit,

wherein the right boundary position of the current subpicture is derived by performing “−1” operation on a product of position information of a predetermined unit specifying a right position of the current subpicture and a width of the predetermined unit,

wherein the top boundary position of the current subpicture is derived as a product of position information of a predetermined unit specifying a top position of the current subpicture and a height of the predetermined unit, and

wherein the bottom boundary position of the current subpicture is derived by performing “−1” operation on a product of position information of a predetermined unit specifying a bottom position of the current subpicture and a height of the predetermined unit.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2024
From: LG ELECTRONICS INC.
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 066384/0462 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2022
From: JANG, HYEONG MOON
To: LG ELECTRONICS INC.
Reel/Frame 060241/0235 →
Continuity (4)
Continuation PCTKR2020012874 · Sep 23, 2020
Provisional Application 62905393 · Sep 25, 2019
Provisional Application 62905302 · Sep 24, 2019
Related Publication 20220279165A1 · Sep 1, 2022