IP Library Granted Patent US 12,231,644
Granted Patent B2
US 12,231,644 · App. 17/639,837 · Granted Feb 18, 2025

Image encoding/decoding method and device for performing BDOF, and method for transmitting bitstream

Inventors: Nae Ri Park (Seoul, KR); Jung Hak Nam (Seoul, KR); Hyeong Moon Jang (Seoul, KR); Seung Hwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/132H04N19/137H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,644
App. No.
17/639,837
Granted
Feb 18, 2025
Kind
B2
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method may comprise deriving a prediction sample of a current block based on motion information of the current block, determining whether bi-directional optical flow (BDOF) applies to the current block, based on that the BDOF applies to the current block, deriving a gradient for a current subblock in the current block, deriving motion refinement (v x , v y ) for the current subblock based on the gradient, deriving a BDOF offset based on the gradient and the motion refinement, and deriving a refined prediction sample for the current block based on the prediction sample of the current block and the BDOF offset.

Claims (72)

1. An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

deriving a L 0 prediction sample and a L 1 prediction sample of a current block by using motion information of the current block;

deriving a gradient for a predetermined area including a current subblock in the current block;

deriving motion offset (vx, vy) for the current subblock by using the gradient;

deriving a Bi-directional Optical Flow (BDOF) offset by using the gradient and the motion offset; and

deriving a prediction sample for the current block by using the L 0 prediction sample, the L 1 prediction sample of the current block and the BDOF offset,

wherein the gradient is derived by right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L 1 prediction sample of the current block from the L 0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

2. The image decoding method of claim 1 , wherein the first shift is 6.

3. The image decoding method of claim 1 , wherein the second shift is 4.

4. The image decoding method of claim 1 , wherein the third shift is 1.

5. The image decoding method of claim 1 , wherein the motion offset (vx, vy) is clipped in a predetermined range.

6. The image decoding method of claim 5 , wherein the predetermined range in which the motion offset (vx, vy) is clipped is set to a fixed range regardless of a bit depth of the current block.

7. The image decoding method of claim 1 ,

wherein the deriving the BDOF offset comprises right-shifting, by a predetermined shift, a value derived by using the gradient and the motion offset, and

wherein the predetermined shift is set to a fixed range regardless of a bit depth of the current block.

8. The image decoding method of claim 1 ,

wherein the deriving the prediction sample for the current block comprises clipping the BDOF offset in a predetermined range, and

wherein the predetermined range is set based on a bit depth of the current block.

9. An image decoding apparatus comprising:

a memory; and

at least one processor,

wherein the at least one processor is configured to:

derive a L 0 prediction sample and a L 1 prediction sample of a current block by using motion information of the current block;

derive a gradient for a predetermined area including a current subblock in the current block;

derive motion offset (vx, vy) for the current subblock by using the gradient;

derive a Bi-directional Optical Flow (BDOF) offset by using the gradient and the motion offset; and

derive a prediction sample for the current block by using the L 0 prediction sample, the L 1 prediction sample of the current block and the BDOF offset,

wherein the gradient is derived by right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L 1 prediction sample of the current block from the L 0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

10. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

deriving a L 0 prediction sample and a L 1 prediction sample of a current block by using motion information of the current block;

deriving a gradient for a predetermined area including a current subblock in the current block;

deriving motion offset (vx, vy) for the current subblock by using the gradient;

deriving a Bi-directional Optical Flow (BDOF) offset by using the gradient and the motion offset; and

deriving a prediction sample for the current block by using the L 0 prediction sample, the L 1 prediction sample of the current block and the BDOF offset,

wherein the gradient is derived by right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L 1 prediction sample of the current block from the L 0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

11. A method of transmitting a bitstream comprising:

transmitting a bitstream generated by an image encoding method,

wherein the image encoding method comprises,

deriving a L 0 prediction sample and a L 1 prediction sample of a current block by using motion information of the current block;

deriving a gradient for a predetermined area including a current subblock in the current block;

deriving motion offset (vx, vy) for the current subblock by using the gradient;

deriving a Bi-directional Optical Flow (BDOF) offset by using the gradient and the motion offset; and

deriving a prediction sample for the current block by using the L 0 prediction sample, the L 1 prediction sample of the current block and the BDOF offset,

wherein the gradient is derived by right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L 1 prediction sample of the current block from the L 0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the L 0 prediction sample and the L 1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2022
From: PARK, NAE RI; NAM, JUNG HAK; JANG, HYEONG MOON; KIM, SEUNG HWAN
To: LG ELECTRONICS INC.
Reel/Frame 060273/0614 →
Continuity (3)
Provisional Application 62898531 · Sep 10, 2019
Provisional Application 62904648 · Sep 23, 2019
Related Publication 20220337842A1 · Oct 20, 2022
References Cited (19)
US 20170094305A1 · Li · 2017 [cited by examiner]
US 20190068991A1 · Xu et al. · 2019 [cited by applicant]
US 20190089974A1 · Lee · 2019 [cited by applicant]
US 20190110061A1 · Park et al. · 2019 [cited by applicant]
US 20190141333A1 · Lee · 2019 [cited by applicant]
US 20190158843A1 · Xu et al. · 2019 [cited by applicant]
US 20210127133A1 · Chen · 2021 [cited by examiner]
CN 104137549A · 2014 [cited by applicant]
CN 110115032A · 2019 [cited by applicant]
KR 20180129860 · 2018 [cited by applicant]
KR 20190024553 · 2019 [cited by applicant]
WO WO2019045427 · 2019 [cited by applicant]
Bross et al. Versatile Video Coding (Draft 6). Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11. JVET-02001-vE. 15th Meeting: Gothenburg, SE. pp. 1-439, Jul. 31, 2019. Retrieved from <h… [cited by examiner]
Bross et al., “Versatile Video Coding (Draft 6),” JVET-O2001-vE, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Chujoh et al., “Non-CE9: A bug fix of BDOF specification,” JVET-O0207-v2, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 5 … [cited by applicant]
Japanese Office Action in Japanese Application No. 2022-515879, dated Mar. 7, 2023, 11 pages (with English translation). [cited by applicant]
Office Action in Korean Appln. No. 10-2022-7005733, mailed on Feb. 1, 2024, 19 pages (with Machine translation). [cited by applicant]
Xiu et al., “CE9-related: Improvements on bi-directional optical flow (BDOF),” JVET-N0325, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 7… [cited by applicant]
Office Action in Chinese Appln. No. 202080063601.0, mailed on Jul. 30, 2024, 19 pages (with English translation). [cited by applicant]