IP Library › Granted Patent US 12,732,630
Granted Patent B2
US 12,732,630 · App. 19/008,139 · Granted Sep 8, 2026

Image encoding method and device, and image decoding method and device

Inventors: Minsoo Park (Suwon-si, KR); Minwoo Park (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/46G06Q10/06312G06Q10/0637G06Q10/0639H04N19/117H04N19/159H04N19/176H04N19/18H04N19/186H04N19/619H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,732,630
App. No.
19/008,139
Granted
Sep 8, 2026
Kind
B2
Abstract

An image decoding method may include obtaining a first coded block flag, when the first coded block flag of the current coding unit indicates that the current coding unit comprises the one or more non-zero significant transform coefficients, identifying whether at least one of a height and a width of the current coding unit is greater than a predetermined size, based on whether the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining at least one transform unit, when the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining a second coded block flag, obtaining a residual signal of the block of the luma component based on the second coded block flag, and reconstructing the current coding unit based on the residual signal.

Claims (52)

1 . An image decoding method comprising:

obtaining one or more coding units comprising a current coding unit, by hierarchically splitting at least one largest coding unit, based on a split shape mode;

when a prediction mode of the current coding unit is an inter mode, obtaining, from a bitstream, a first coded block flag indicating whether the current coding unit comprises one or more non-zero significant transform coefficients;

when the first coded block flag indicates that the current coding unit comprises one or more non-zero significant transform coefficients, identifying whether at least one of a height and a width of the current coding unit is greater than a predetermined size;

based on an intra sub partition mode is not used for the current coding unit and whether the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining at least one transform unit included in the current coding unit;

when a tree type of the current coding unit is a dual-tree chroma type, obtaining, from the bitstream, a second coded block flag indicating whether a block of at least one chroma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

when the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining, from the bitstream, a third coded block flag indicating whether a block of a luma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

obtaining a residual signal of the block of the luma component included in the at least one transform unit, based on the third coded block flag;

reconstructing the current coding unit based on the residual signal; and

reconstructing a current image comprising the current coding unit, based on the reconstructed current coding unit,

wherein the split shape mode indicates at least one of whether to perform splitting, a split direction, or a split type, and

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting,

wherein the current coding unit has a square shape or a rectangular shape.

2 . An image decoding apparatus comprising:

at least one processor configured to:

obtain one or more coding units comprising a current coding unit, by hierarchically splitting at least one largest coding unit, based on a split shape mode;

when a prediction mode of the current coding unit is an inter mode, obtain, from a bitstream, a first coded block flag indicating whether the current coding unit comprises one or more non-zero significant transform coefficients;

when the first coded block flag indicates that the current coding unit comprises one or more non-zero significant transform coefficients, identify whether at least one of a height and a width of the current coding unit is greater than a predetermined size;

based on an intra sub partition mode is not used for the current coding unit and whether the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtain at least one transform unit included in the current coding unit;

when a tree type of the current coding unit is a dual-tree chroma type, obtain, from the bitstream, a second coded block flag indicating whether a block of at least one chroma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

when the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtain, from the bitstream, a third coded block flag indicating whether a block of a luma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

obtain a residual signal of the block of the luma component included in the at least one transform unit, based on the third coded block flag;

reconstruct the current coding unit based on the residual signal; and

reconstruct a current image comprising the current coding unit, based on the reconstructed current coding unit,

wherein the split shape mode indicates at least one of whether to perform splitting, a split direction, or a split type, and

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting,

wherein the current coding unit has a square shape or a rectangular shape.

3 . An image encoding method comprising:

obtaining one or more coding units comprising a current coding unit, by hierarchically splitting at least one largest coding unit, based on a split shape mode;

when a prediction mode of the current coding unit is an inter mode, generating a first coded block flag indicating whether the current coding unit comprises one or more non-zero significant transform coefficients;

based on determining that the current coding unit comprises one or more non-zero significant transform coefficients, identifying whether at least one of a height and a width of the current coding unit is greater than a predetermined size;

based on an intra sub partition mode is not used for the current coding unit and whether the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining at least one transform unit included in the current coding unit;

encoding residual signal of a block of luma component and a block of at least one chroma component included in the at least one transform unit;

when a tree type of the current coding unit is a dual-tree chroma type, generating a second coded block flag indicating whether a block of at least one chroma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

when the at least one of the height and the width of the current coding unit is greater than the predetermined size, generating a third coded block flag indicating whether a block of a luma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients; and

generating a bitstream including the encoded residual signal, the first coded block flag, the second coded block flag, and the third coded block flag;

wherein the split shape mode indicates at least one of whether to perform splitting, a split direction, or a split type, and

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting,

wherein the current coding unit has a square shape or a rectangular shape.

4 . A method of transmitting a bitstream, the method comprising:

obtaining one or more coding units comprising a current coding unit, by hierarchically splitting at least one largest coding unit, based on a split shape mode;

when a prediction mode of the current coding unit is an inter mode, generating a first coded block flag indicating whether the current coding unit comprises one or more non-zero significant transform coefficients;

based on determining that the current coding unit comprises one or more non-zero significant transform coefficients, identifying whether at least one of a height and a width of the current coding unit is greater than a predetermined size;

based on an intra sub partition mode is not used for the current coding unit and whether the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining at least one transform unit included in the current coding unit;

encoding residual signal of a block of luma component and at least one chroma component included in the at least one transform unit;

when a tree type of the current coding unit is a dual-tree chroma type, generating a second coded block flag indicating whether a block of at least one chroma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

when the at least one of the height and the width of the current coding unit is greater than the predetermined size, generating a third coded block flag indicating whether a block of a luma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;

generating the bitstream including the encoded residual signal, the first coded block flag, the second coded block flag, and the third coded block flag; and

transmitting the bitstream from an image encoding apparatus to an image decoding apparatus,

wherein the split shape mode indicates at least one of whether to perform splitting, a split direction, or a split type, and

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting,

wherein the current coding unit has a square shape or a rectangular shape.

Continuity (6)
Continuation 18680233 · May 31, 2024
Continuation 17946749 · Sep 16, 2022
Continuation 17475832 · Sep 15, 2021
Continuation PCTKR2020003545 · Mar 13, 2020
Provisional Application 62818859 · Mar 15, 2019
Related Publication 20250142104A1 · May 1, 2025
References Cited (96)
US 9100661B2 · Alshina et al. · 2015 [cited by applicant]
US 9185405B2 · Guo et al. · 2015 [cited by applicant]
US 9648329B2 · Lim et al. · 2017 [cited by applicant]
US 10116942B2 · Lim et al. · 2018 [cited by applicant]
US 10284878B2 · Min et al. · 2019 [cited by applicant]
US 11303883B2 · Lee et al. · 2022 [cited by applicant]
US 20110170610A1 · Min et al. · 2011 [cited by applicant]
US 20120114034A1 · Huang · 2012 [cited by examiner]
US 20130003824A1 · Guo · 2013 [cited by examiner]
US 20130251026A1 · Guo · 2013 [cited by examiner]
US 20130301705A1 · Seregin et al. · 2013 [cited by applicant]
US 20140092965A1 · Joshi et al. · 2014 [cited by applicant]
US 20140105284A1 · Lim et al. · 2014 [cited by applicant]
US 20140254686A1 · Lim et al. · 2014 [cited by applicant]
US 20150030067A1 · Zhao · 2015 [cited by examiner]
US 20150092862A1 · Yu · 2015 [cited by examiner]
US 20150117546A1 · Kim · 2015 [cited by examiner]
US 20150264356A1 · Zhang · 2015 [cited by examiner]
US 20150365680A1 · Chuang · 2015 [cited by examiner]
US 20160100175A1 · Laroche · 2016 [cited by examiner]
US 20170006309A1 · Liu · 2017 [cited by examiner]
US 20180124397A1 · Yoo · 2018 [cited by examiner]
US 20180192076A1 · Ikai · 2018 [cited by examiner]
US 20180262763A1 · Seregin · 2018 [cited by examiner]
US 20180302631A1 · Chiang · 2018 [cited by examiner]
US 20180324417A1 · Karczewicz · 2018 [cited by examiner]
US 20190174128A1 · Jang · 2019 [cited by examiner]
US 20190246142A1 · Zhao · 2019 [cited by examiner]
US 20190342568A1 · Zhao · 2019 [cited by examiner]
US 20200053359A1 · Lee et al. · 2020 [cited by applicant]
US 20200154100A1 · Zhao · 2020 [cited by examiner]
US 20200221099A1 · Pham Van · 2020 [cited by examiner]
US 20200228798A1 · Zhao · 2020 [cited by examiner]
US 20200244980A1 · Zhao · 2020 [cited by examiner]
US 20200252608A1 · Ramasubramonian · 2020 [cited by examiner]
US 20200260115A1 · Pham Van · 2020 [cited by examiner]
US 20200280742A1 · Ramasubramonian · 2020 [cited by examiner]
US 20200288131A1 · Zhao · 2020 [cited by examiner]
US 20200366895A1 · De Luxán Hernández · 2020 [cited by examiner]
US 20210120269A1 · Chen · 2021 [cited by examiner]
US 20210168369A1 · Li · 2021 [cited by examiner]
US 20210195188A1 · Lee et al. · 2021 [cited by applicant]
US 20210289204A1 · Piao et al. · 2021 [cited by applicant]
US 20210321099A1 · Park et al. · 2021 [cited by applicant]
US 20220078432A1 · Choi · 2022 [cited by examiner]
US 20220109886A1 · Xiu · 2022 [cited by examiner]
US 20220141491A1 · Koo · 2022 [cited by examiner]
US 20220182669A1 · Zhu · 2022 [cited by examiner]
US 20220191530A1 · Sim · 2022 [cited by examiner]
US 20220264098A1 · Zhao · 2022 [cited by examiner]
US 20220286678A1 · Zhao · 2022 [cited by examiner]
US 20250039412A1 · Chernyak et al. · 2025 [cited by applicant]
CN 102804782A · 2012 [cited by applicant]
CN 104205837A · 2014 [cited by applicant]
EP 3477949A1 · 2019 [cited by applicant]
JP 2022522083A · 2022 [cited by applicant]
KR 1020110112165A · 2011 [cited by applicant]
KR 1020130057949A · 2013 [cited by applicant]
KR 1020140142191A · 2014 [cited by applicant]
KR 1020180046875A · 2018 [cited by applicant]
KR 1020180098159A · 2018 [cited by applicant]
KR 1020190009408A · 2019 [cited by applicant]
KR 1020190019925A · 2019 [cited by applicant]
KR 102314651B1 · 2021 [cited by applicant]
WO 2018012893A1 · 2018 [cited by applicant]
WO 2018080122A1 · 2018 [cited by applicant]
WO 2018155984A1 · 2018 [cited by applicant]
Communication dated Apr. 1, 2025, issued by the Japanese Patent Office in Japanese Application No. 2024-043492. [cited by applicant]
Communication dated Jan. 21, 2025, issued by the Intellectual Property Corporation of Malaysia in Malaysian Application No. PI2022002624. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 4)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3, ISO/IEC JTC 1/SC 29/WG 11, JVET-M1001-v6, pp. 2-16/E. [cited by applicant]
Communication dated Apr. 14, 2022 issued by the State Intellectual Property Office of the P.R.China in application No. 202080021599.0. [cited by applicant]
Communication (Notification of Reexamination) dated Aug. 26, 2024, issued by the National Intellectual Property Administration, PRC in counterpart Chinese Application No. 202080021599.0. [cited by applicant]
Communication dated Jan. 13, 2023 issued by the State Intellectual Property Office of the P.R.China in application No. 202080021599.0. [cited by applicant]
Communication dated Jan. 19, 2023 issued by the Korean Patent Office in application No. 10-2021-0004244. [cited by applicant]
Communication dated Jan. 19, 2023 issued by the Korean Patent Office in application No. 10-2021-0004245. [cited by applicant]
Communication dated Mar. 10, 2023 issued by the Intellectual Property India Patent Office in application No. 202228049501. [cited by applicant]
Communication dated Mar. 31, 2022 issue by the Intellectual Property India Patent Office in application No. 202127046674. [cited by applicant]
Communication dated Mar. 31, 2024, issued by the Egyptian Patent and Trademark Office in Egyptian Patent Application No. 2021091433 (PCT1433/2021). [cited by applicant]
Communication dated May 2, 2024, issued by the European Patent Office in European Application No. 20 774 720.5. [cited by applicant]
Communication dated May 24, 2022 issued by the Japanese Patent Office in application No. 2021-555472. [cited by applicant]
Communication (Decision of Reexamination) dated Oct. 23, 2024, issued by the National Intellectual Property Administration, PRC in counterpart Chinese Application No. 202080021599.0. [cited by applicant]
Communication dated Oct. 4, 2024, issued by the European Patent Office in counterpart European Application No. 24186451.1. [cited by applicant]
Communication issue in Korean Application No. 10-2020-0031317 dated Jul. 20, 2020. [cited by applicant]
Communication issued Dec. 26, 2023 by United Arab Emirates Ministry of Economy in United Arab Emirates Application No. P6001642/2021. [cited by applicant]
Communication issued Dec. 5, 2022 by the European Patent Office in counterpart European Patent Application No. 20774720.5. [cited by applicant]
Communication issued Nov. 22, 2022 by the Japanese Patent Office in counterpart Japanese Patent Application No. 2021-555472. [cited by applicant]
Communication issued Oct. 12, 2020 by the Korean Intellectual Property Office in counterpart Korean Patent Application No. 10-2020-0031317. [cited by applicant]
Communication issued on Mar. 1, 2024 by Indian Intellectual Property Office in Indian Application No. 202127046674. [cited by applicant]
Communication issued Sep. 20, 2022 by the State Intellectual Property Office of the P.R. China in counterpart Chinese Patent Application No. 202080021599.0. [cited by applicant]
International Search Report (PCT/ISA/210) and Written Opinion (PCT/ISA/237) issued Jul. 2, 2020 by the International Searching Authority in counterpart International Patent Application No. PCT/KR2020/003545. [cited by applicant]
R. Chernyak et al., “CBF flags signalling in VVC”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,14th Meeting: Geneva, CH, 19-27, JVET-N0492-v1, Mar. 2019, (7 pages total). [cited by applicant]
Zhao, Yin et al., “CBF flags signalling in VVC”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, Document: JVET- N0492-v1. (6 pages total). [cited by applicant]
Office Action issued on Apr. 22, 2026 by the Brazilian Patent Office in corresponding BR Patent Application No. BR122025014642-0. [cited by applicant]
Office Action issued on Apr. 22, 2026 by the Brazilian Patent Office in corresponding BR Patent Application No. BR122025014643-9. [cited by applicant]
Office Action issued on Apr. 22, 2026 by the Brazilian Patent Office in corresponding BR Patent Application No. BR122025014646-3. [cited by applicant]
Office Action issued on Apr. 22, 2026 by the Brazilian Patent Office in corresponding BR Patent Application No. BR122025014647-1. [cited by applicant]