IP Library Granted Patent US 12,695,877
Granted Patent B2
US 12,695,877 · App. 18/821,525 · Granted Jul 28, 2026

Image encoding/decoding method and device for performing BDOF, and method for transmitting bitstream

Inventors: Nae Ri Park (Seoul, KR); Jung Hak Nam (Seoul, KR); Hyeong Moon Jang (Seoul, KR); Seung Hwan Kim (Seoul, KR)
Assignee: NOKIA TECHNOLOGIES OY
H04N19/132H04N19/137H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,695,877
App. No.
18/821,525
Filed
Aug 30, 2024
Granted
Jul 28, 2026
Kind
B2
Art Unit
2486
USPC
375/240.02
Abstract

An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method may comprise deriving a prediction sample of a current block based on motion information of the current block, determining whether bi-directional optical flow (BDOF) applies to the current block, based on that the BDOF applies to the current block, deriving a gradient for a current subblock in the current block, deriving motion refinement (v x , v y ) for the current subblock based on the gradient, deriving a BDOF offset based on the gradient and the motion refinement, and deriving a refined prediction sample for the current block based on the prediction sample of the current block and the BDOF offset.

Claims (58)

1 . An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

deriving a L0 prediction sample and a L1 prediction sample of a current block based on motion information of the current block;

deriving a gradient for a predetermined area including a current subblock in the current block;

deriving motion offset (vx, vy) for the current subblock based on the gradient;

deriving a BDOF (Bi-directional Optical Flow) offset based on the gradient and the motion offset; and

deriving a prediction sample for the current block based on the L0 prediction sample, the L1 prediction sample of the current block, the BDOF offset and a fourth shift,

wherein a value of the fourth shift is derived based on a bit depth of the current block,

wherein the gradient is derived by right-shifting the L0 prediction sample and the L1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L1 prediction sample of the current block from the L0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the L0 prediction sample and the L1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

2 . The image decoding method of claim 1 , wherein the first shift is 6.

3 . The image decoding method of claim 1 , wherein the second shift is 4.

4 . The image decoding method of claim 1 , wherein the third shift is 1.

5 . The image decoding method of claim 1 , wherein the motion offset (vx, vy) is clipped in a predetermined range.

6 . The image decoding method of claim 5 , wherein the predetermined range in which the motion offset (vx, vy) is clipped is set to a fixed range regardless of a bit depth of the current block.

7 . The image decoding method of claim 1 ,

wherein the deriving the BDOF offset comprises right-shifting, by a predetermined shift, a value derived based on the gradient and the motion offset, and

wherein the predetermined shift is set to a fixed range regardless of a bit depth of the current block.

8 . The image decoding method of claim 1 ,

wherein the deriving the prediction sample for the current block comprises clipping the BDOF offset in a predetermined range, and

wherein the predetermined range is set based on a bit depth of the current block.

9 . An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

deriving a L0 prediction sample and a L1 prediction sample of a current block based on motion information of the current block;

deriving a gradient for a predetermined area including a current subblock in the current block;

deriving motion offset (vx, vy) for the current subblock based on the gradient;

deriving a BDOF (Bi-directional Optical Flow) offset based on the gradient and the motion offset; and

deriving a prediction sample for the current block based on the L0 prediction sample, the L1 prediction sample of the current block, the BDOF offset and a fourth shift,

wherein a value of the fourth shift is derived based on a bit depth of the current block,

wherein the gradient is derived by right-shifting the L0 prediction sample and the L1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L1 prediction sample of the current block from the L0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the LO prediction sample and the L1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

10 . A method of transmitting a bitstream comprising:

deriving a L0 prediction sample and a L1 prediction sample of a current block based on motion information of the current block;

deriving a gradient for a predetermined area including a current subblock in the current block;

deriving motion offset (vx, vy) for the current subblock based on the gradient;

deriving a BDOF (Bi-directional Optical Flow) offset based on the gradient and the motion offset;

deriving a prediction sample for the current block based on the L0 prediction sample, the L1 prediction sample of the current block, the BDOF offset and a fourth shift;

encoding the current block based on the prediction sample to generate the bitstream; and

transmitting the bitstream,

wherein a value of the fourth shift is derived based on a bit depth of the current block,

wherein the gradient is derived by right-shifting the L0 prediction sample and the L1 prediction sample of the current block by a first shift,

wherein the deriving the motion offset (vx, vy) comprises:

deriving a first intermediate parameter diff by subtracting the L1 prediction sample of the current block from the L0 prediction sample of the current block; and

deriving second intermediate parameters tempH and tempV by right-shifting the gradient by a third shift,

wherein the deriving the first intermediate parameter diff comprises right-shifting the L0 prediction sample and the L1 prediction sample of the current block by a second shift,

wherein the first shift, the second shift and the third shift are set to a fixed value regardless of a bit depth of the current block,

wherein a value of the first shift is different from a value of the second shift and a value of the third shift, and

wherein a value of the second shift is different from a value of the third shift.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2024
From: PARK, NAE RI; NAM, JUNG HAK; JANG, HYEONG MOON; KIM, SEUNG HWAN
To: LG ELECTRONICS INC.
Reel/Frame 068583/0327 →
Continuity (4)
Continuation 17639837 · Sep 9, 2020
Provisional Application 62898531 · Sep 10, 2019
Provisional Application 62904648 · Sep 23, 2019
Related Publication 20240422323A1 · Dec 19, 2024
References Cited (82)
US 20110243219A1 · Hong · 2011 [cited by examiner]
US 20130243092A1 · Sugio et al. · 2013 [cited by applicant]
US 20150264402A1 · Zhang et al. · 2015 [cited by applicant]
US 20150271515A1 · Pang et al. · 2015 [cited by applicant]
US 20150358631A1 · Zhang et al. · 2015 [cited by applicant]
US 20150373357A1 · Pang et al. · 2015 [cited by applicant]
US 20160105657A1 · Zhang et al. · 2016 [cited by applicant]
US 20160255363A1 · Kim et al. · 2016 [cited by applicant]
US 20160295219A1 · Ye et al. · 2016 [cited by applicant]
US 20170094305A1 · Li et al. · 2017 [cited by applicant]
US 20170155914A1 · Jeon et al. · 2017 [cited by applicant]
US 20190068991A1 · Xu et al. · 2019 [cited by applicant]
US 20190089974A1 · Lee · 2019 [cited by applicant]
US 20190098335A1 · Li et al. · 2019 [cited by applicant]
US 20190110061A1 · Park et al. · 2019 [cited by applicant]
US 20190141333A1 · Lee · 2019 [cited by applicant]
US 20190158843A1 · Xu et al. · 2019 [cited by applicant]
US 20190191178A1 · Lee · 2019 [cited by applicant]
US 20190246103A1 · Jun et al. · 2019 [cited by applicant]
US 20210127133A1 · Chen et al. · 2021 [cited by applicant]
CN 104137549A · 2014 [cited by applicant]
CN 106464874A · 2017 [cited by applicant]
CN 109804626A · 2019 [cited by applicant]
CN 110115032A · 2019 [cited by applicant]
KR 20150145688A · 2015 [cited by applicant]
KR 20170057312A · 2017 [cited by applicant]
KR 1020180129860A · 2018 [cited by applicant]
KR 1020190024553A · 2019 [cited by applicant]
KR 102028186B1 · 2019 [cited by applicant]
KR 102032603B1 · 2019 [cited by applicant]
WO 2018166357A1 · 2018 [cited by applicant]
WO 2019045427A1 · 2019 [cited by applicant]
WO 2019066523A1 · 2019 [cited by applicant]
WO 2020150080A1 · 2020 [cited by applicant]
Office Action in Japanese Appln. No. 2024-106620, mailed on Jun. 24, 2025, 6 pages (with English translation). [cited by applicant]
Office Action in Indian Appln. No. 202318008544, mailed on Feb. 7, 2025, 6 pages. [cited by applicant]
Alshin et al., “Bi-Directional Optical Flow for Improving Motion Compensation,” Paper, Presented at the Proceedings of the 28th Picture Coding Symposium (PCS2010), Nagoya, Japan, Dec. 8-10, 2010, pp. 422-425. [cited by applicant]
Extended European Search Report in European Appln. No. 25187728.8, mailed on Oct. 9, 2025, 7 pages. [cited by applicant]
Park et al., “Non-CE4: Corrections on parameter calculation for PROF and BDOF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, Switzerland, JVET-P0281, Oct. 2019… [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6)”, int Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O2001 v14, 15th Meeting, (Jul. 3-12, 2019), 455 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O2001-v5, 15th Meeting, (Jul. 3-12, 2019), 423 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6),” JVET-O2001-vE, Presented at Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Chujoh et al., “Non-CE9: A bug fix ofBDOF specification,” JVET-O0207-v2, Presented at Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 5 pa… [cited by applicant]
Decision of Refusal for Japanese Application No. 2022-515879 dated Mar. 12, 2024, 3 pages. [cited by applicant]
Decision on Acceptance for Vietnamese Application No. 1-2022-01941 dated May 27, 2022, 2 pages. [cited by applicant]
Decision to Grant for European Application No. 20863214.1 dated Nov. 14, 2024, 2 pages. [cited by applicant]
Decision to Grant for Japanese Application No. 2024-106620 dated Nov. 4, 2025, 5 pages. [cited by applicant]
Examination Report for Australian Application No. 2020347025 dated Feb. 16, 2023, 4 pages. [cited by applicant]
Examination Report for Australian Application No. 2020347025 dated Jan. 22, 2024, 4 pages. [cited by applicant]
Examination Report for Australian Application No. 2020347025 dated Oct. 17, 2023, 3 pages. [cited by applicant]
Examination Report for Australian Application No. 2024203549 dated Jan. 31, 2025, 4 pages. [cited by applicant]
Examination Report for Indian Application No. 202217018990 dated Aug. 12, 2022, 6 pages. [cited by applicant]
Examination Report for Indian Application No. 202217038105 dated Apr. 9, 2024, 8 pages. [cited by applicant]
Extended European Search Report for European Application No. 20863214.1 dated Aug. 8, 2023, 11 pages. [cited by applicant]
Extended European Search Report for European Application No. 24210102.0 dated Jan. 8, 2025, 7 pages. [cited by applicant]
Final Rejection for Korean Application No. 10-2022-7005733 dated Sep. 13, 2024, 8 pages. [cited by applicant]
First Examination Report for Indian Application No. 202117038563 dated Aug. 3, 2023, 6 pages. [cited by applicant]
Hearing Notice for Indian Application No. 202217018990 dated Mar. 1, 2024, 3 pages. [cited by applicant]
Intention to Grant for European Application No. 20863214.1 dated Jul. 4, 2024, 81 pages. [cited by applicant]
Intimation of Grant for Indian Application No. 202217018990 dated May 15, 2025, 1 page. [cited by applicant]
IPEA/409 - International Preliminary Report on Patentability Mailed on Mar. 24, 2022 for WO Application No. PCT/KR20/012153, 13 page(s). [cited by applicant]
Japanese Office Action in Japanese Application No. 2022-515879, dated Mar. 7, 2023, 11 pages (with English translation). [cited by applicant]
Non-Final Rejection Mailed on Dec. 21, 2023 for U.S. Appl. No. 17/639,837, 14 page(s). [cited by applicant]
Notice of Acceptance for Australian Application No. 2020347025 dated Feb. 15, 2024, 4 pages. [cited by applicant]
Notice of Acceptance for Australian Application No. 2024203549 dated Dec. 4, 2025, 3 pages. [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on May 31, 2024 for U.S. Appl. No. 17/639,837, 8 page (s). [cited by applicant]
Notice of Grant for Chinese Application No. 202080063601.0 dated Jan. 7, 2026, 9 pages. [cited by applicant]
Notice of Reasons for Refusal for Japanese Application No. 2022-515879 dated Sep. 19, 2023, 13 pages. [cited by applicant]
Office Action for Chinese Application No. 202080063601.0 dated Jun. 19, 2025, 18 pages. [cited by applicant]
Office Action for Chinese Application No. 202080063601.0 dated Dec. 17, 2024, 19 pages. [cited by applicant]
Office Action for Chinese Application No. 202080063601.0 dated Mar. 31, 2025, 19 pages. [cited by applicant]
Office Action for European Application No. 20863214.1 dated Mar. 25, 2024, 5 pages. [cited by applicant]
Office Action for Korean Application No. 10-2022-7005733 dated Sep. 19, 2023, 10 pages. [cited by applicant]
Office Action for Vietnamese Application No. 1-2022-01941 dated Aug. 30, 2024, 3 pages. [cited by applicant]
Office Action in Chinese Appln. No. 202080063601.0, mailed on Jul. 30, 2024, 19 pages (with English translation). [cited by applicant]
Office Action in Korean Appln. No. 10-2022-7005733, mailed on Feb. 1, 2024, 19 pages (with Machine translation). [cited by applicant]
Outgoing—ISA/210—International Search Report Mailed on Dec. 17, 2020 for WO Application No. PCT/KR20/012153, 5 page(s). [cited by applicant]
Outgoing Written Opinion of the ISA Mailed on Dec. 17, 2020 for WO Application No. PCT/KR20/012153, 10 page(s). [cited by applicant]
Pettersson et al., “AHG17: On selectively signal slice header parameters in PPS”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0368-v2, 16th Meeting, (Oct. 1-11, 201… [cited by applicant]
Xiu et al., “CE9-related: Improvements on bi-directional optical flow (BDOF),” JVET-N0325, Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and ISO/IEC JTC I/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 7 … [cited by applicant]
Xiu et al., “Non-CE4: On BDOF and PROF parameter derivation”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0653, 16th Meeting, (Oct. 1-11, 2019), 5 pages. [cited by applicant]
First Examination Report for Indian Application No. 202318008545 dated May 26, 2026, 8 pages. [cited by applicant]