IP Library Granted Patent US 12,695,912
Granted Patent B2
US 12,695,912 · App. 19/012,239 · Granted Jul 28, 2026

Video encoding method and device, and video decoding method and device

Inventors: Kiho Choi (Suwon-si, KR); Minsoo Park (Suwon-si, KR); Minwoo Park (Suwon-si, KR); Woongil Choi (Suwon-si, KR); Yinji Piao (Suwon-si, KR); Seungsoo Jeong (Suwon-si, KR); Narae Choi (Suwon-si, KR); Anish Tamse (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/625H04N19/105H04N19/136H04N19/176H04N19/186H04N19/503H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,695,912
App. No.
19/012,239
Granted
Jul 28, 2026
Kind
B2
Abstract

Provided is an image decoding method including: obtaining, from a bitstream, a syntax element regarding multiple transform selection (MTS) with respect to a current coding unit or a current transform unit included in the current coding unit; determining a horizontal transform kernel or a vertical transform kernel with respect to the current transform unit based on the obtained syntax element; obtaining a residual signal by performing inverse transformation on the current transform unit, based on the determined horizontal transform kernel or vertical transform kernel with respect to the current transform unit; and generating a reconstruction block including the current coding unit or the current transform unit based on the residual signal with respect to the current transform unit.

Claims (37)

1 . An image decoding method comprising:

obtaining one or more coding units comprising a current coding unit by splitting a current image based on a split type;

obtaining a sub-block transform flag, from a bitstream, indicating whether or not a sub-block transform is used for the current coding unit;

obtaining, from a coding unit syntax structure in the bitstream, a syntax element regarding multiple transform selection (MTS) based on the sub-block transform flag indicating that the sub-block transform is not used for the current coding unit, with respect to the current coding unit, wherein the current coding unit includes a plurality of transform units and the syntax element regarding the MTS is index information indicating a type of a horizontal transform kernel and a type of a vertical transform kernel with respect to the plurality of transform units included in the current coding unit;

determining the horizontal transform kernel and the vertical transform kernel with respect to the plurality of transform units included in the current coding unit based on the obtained syntax element regarding the MTS;

obtaining a residual block with respect to a current transform unit among the plurality of transform units by applying the determined horizontal transform kernel and vertical transform kernel to the current transform unit; and

generating a reconstruction block for the current coding unit based on the residual block with respect to the current transform unit,

wherein a same horizontal transform kernel is applied to the plurality of transform units included in the current coding unit and a same vertical transform kernel is applied to the plurality of transform units included in the current coding unit,

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting.

2 . An image decoding apparatus comprising at least one processor configured to:

obtain one or more coding units comprising a current coding unit by splitting a current image based on a split type;

obtain a sub-block transform flag from a bitstream indicating whether or not a sub-block transform is used for the current coding unit;

obtain, from a coding unit syntax structure in the bitstream, a syntax element regarding multiple transform selection (MTS) based on the sub-block transform flag indicating that the sub-block transform is not used for the current coding unit, with respect to the current coding unit, wherein the current coding unit includes a plurality of transform units and the syntax element regarding the MTS is index information indicating a type of a horizontal transform kernel and a type of a vertical transform kernel with respect to the plurality of transform units included in the current coding unit;

determine the horizontal transform kernel and the vertical transform kernel with respect to the plurality of transform units included in the current coding unit based on the obtained syntax element regarding the MTS;

obtain a residual block with respect to a current transform unit among the plurality of transform units by applying the determined horizontal transform kernel and vertical transform kernel to the current transform unit; and

generate a reconstruction block for the current coding unit based on the residual block with respect to the current transform unit,

wherein a same horizontal transform kernel is applied to the plurality of transform units included in the current coding unit and a same vertical transform kernel is applied to the plurality of transform units included in the current coding unit,

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting.

3 . An image encoding method comprising:

obtaining one or more coding units comprising a current coding unit by splitting a current image based on a split type;

determining a horizontal transform kernel and a vertical transform kernel with respect to a plurality of transform units included in the current coding unit by performing transformation on the plurality of transform units included in the current coding unit; and

generating a syntax element regarding multiple transform selection (MTS) with respect to the current coding unit based on the horizontal transform kernel and the vertical transform kernel with respect to the plurality of transform units included in the current coding unit, wherein the syntax element regarding the MTS is index information indicating a type of a horizontal transform kernel and a type of a vertical transform kernel with respect to the plurality of transform units included in the current coding unit and the syntax element regarding the MTS is included in a coding unit syntax structure;

generating a sub-block transform flag indicating whether or not a sub-block transform is used for the current coding unit;

encoding a transform coefficient generated by performing transformation on a current transform unit among the plurality of transform units; and

generating a bitstream including the encoded transform coefficient with respect to the current transform unit, the sub-block transform flag and the syntax element regarding the MTS based on the sub-block transform flag indicating that the sub-block transform is not used for the current coding unit,

wherein a same horizontal transform kernel is applied to the plurality of transform units included in the current coding unit and a same vertical transform kernel is applied to the plurality of transform units included in the current coding unit,

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting.

4 . A method for transmitting a bitstream comprising:

obtaining one or more coding units comprising a current coding unit by splitting a current image based on a split type;

determining a horizontal transform kernel and a vertical transform kernel with respect to a plurality of transform units included in the current coding unit by performing transformation on the plurality of transform units included in the current coding unit; and

generating a syntax element regarding multiple transform selection (MTS) with respect to the current coding unit based on the horizontal transform kernel and the vertical transform kernel with respect to the plurality of transform units included in the current coding unit, wherein the syntax element regarding the MTS is index information indicating a type of a horizontal transform kernel and a type of a vertical transform kernel with respect to the plurality of transform units included in the current coding unit and the syntax element regarding the MTS is included in a coding unit syntax structure;

generating sub-block transform flag indicating whether or not a sub-block transform is used for the current coding unit;

encoding a transform coefficient generated by performing transformation on a current transform unit among the plurality of transform units;

generating the bitstream including the encoded transform coefficient with respect to the current transform unit, the sub-block transform flag and the syntax element regarding the MTS based on the sub-block transform flag indicating that the sub-block transform is not used for the current coding unit; and

transmitting the bitstream to a non-transitory computer-readable recording medium,

wherein a same horizontal transform kernel is applied to the plurality of transform units included in the current coding unit and a same vertical transform kernel is applied to the plurality of transform units included in the current coding unit,

wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting.

Continuity (6)
Continuation 17416987 · Dec 20, 2019
Provisional Application 62864845 · Jun 21, 2019
Provisional Application 62811774 · Feb 28, 2019
Provisional Application 62792261 · Jan 14, 2019
Provisional Application 62783670 · Dec 21, 2018
Related Publication 20250150630A1 · May 8, 2025
References Cited (53)
US 9628799B2 · Kim et al. · 2017 [cited by applicant]
US 9635363B2 · Kim et al. · 2017 [cited by applicant]
US 10645399B2 · Jeon et al. · 2020 [cited by applicant]
US 11265578B2 · Choi et al. · 2022 [cited by applicant]
US 20180020218A1 · Zhao et al. · 2018 [cited by applicant]
US 20180103252A1 · Hsieh et al. · 2018 [cited by applicant]
US 20180249179A1 · Han · 2018 [cited by examiner]
US 20200092555A1 · Zhao et al. · 2020 [cited by applicant]
US 20200099924A1 · Seregin · 2020 [cited by examiner]
US 20200112734A1 · Zhao · 2020 [cited by examiner]
US 20200177901A1 · Choi et al. · 2020 [cited by applicant]
US 20210120269A1 · Chen · 2021 [cited by examiner]
US 20210203969A1 · Salehifar · 2021 [cited by examiner]
US 20210235072A1 · Ko · 2021 [cited by examiner]
US 20220007022A1 · Kang · 2022 [cited by examiner]
US 20220109877A1 · Choi et al. · 2022 [cited by applicant]
US 20220353511A1 · Lim · 2022 [cited by examiner]
US 20220394300A1 · Koo · 2022 [cited by examiner]
CN 108605135A · 2018 [cited by applicant]
CN 108632611A · 2018 [cited by applicant]
CN 108712649A · 2018 [cited by applicant]
KR 102366765B1 · 2022 [cited by applicant]
WO 2015012600A1 · 2015 [cited by applicant]
WO 2017111648A1 · 2017 [cited by applicant]
WO 2018160231A1 · 2018 [cited by applicant]
WO 2019009584A1 · 2019 [cited by applicant]
WO WO2020050651A1 · 2020 [cited by examiner]
“Joint Separable and Non-Separable Transforms for Next-Generation Video Coding”—Zhao et al., IEEE Transactions on Image Processing, vol. 27, No. 5, May 2018 (Year: 2018). [cited by examiner]
“Improvement of HEVC Inter-coding Mode Using Multiple Transforms”—Philippe et al., 2017 25th European Signal Processing Conference (EUSIPCO) (Year: 2017). [cited by examiner]
Benjamin Bross, et al., “Versatile Video Coding (Draft 2)”, Joint Videdo Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K1001 version 6, Jul. 10-18, 2018, 141 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11, jvet-p2001-v8, 2019, pp. 1-455 (473 pages total). [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 3 (VTM 3),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-L1002-v1, 2018, Total 37 pages,… [cited by applicant]
Choi, et al., “CE6-related: Simplification on MTS kernel derivation”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Sep. 2018, pp. 1-5. [cited by applicant]
Communication dated Feb. 3, 2024, issued by the National Intellectual Property Administration, PRC in Chinese Application No. 201980092531.9. [cited by applicant]
Communication dated Jul. 13, 2021 issued by the Korean Intellectual Property Office in application No. 10-2021-7005950. [cited by applicant]
Communication dated Oct. 6, 2022, issued by the European Patent Office in counterpart European Application No. 19899921.1. [cited by applicant]
Extended European Search Report dated Oct. 25, 2024, issued by the European Patent Office in European Application No. 24196671.2. [cited by applicant]
International Preliminary Report on Patentability (PCT/IPEA/409) dated May 24, 2021 issued by the International Searching Authority in application No. PCT/KR2019/018244. [cited by applicant]
International Search Report (PCT/ISA/210) dated Apr. 1, 2020 issued by the International Searching Authority in International Application No. PCT/KR2019/018244. [cited by applicant]
Office Action issue on Dec. 3, 2024 by the Vietnamese Patent Office in corresponding VN Patent Application No. 1-2021-03748. [cited by applicant]
Office Action issued Apr. 24, 2024 by the Korean Patent Office for KR Patent Application No. 10-2022-7005673. [cited by applicant]
Office Action issued Mar. 13, 2023 by the India Intellectual Property Office in corresponding IN Patent Application No. 202147031180. [cited by applicant]
Office Action issued May 2, 2024 by the European Patent Office for EP Patent Application No. 19899921.1. [cited by applicant]
Zhao, et al., “CE6: Sub-block transform for inter blocks (CE6.4.1)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Jan. 9-18, 2019, Document: JVET-M0140 v1v3, pp. 1-19. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting, Oct. 3-12, 2018, Document: JVET-L1001 v6v7v11, pp. 1-226. [cited by applicant]
Chen et al., “AHG17: adding control of transform skip coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O0783-v1, 2019, Total 6 pages, XP030220361. [cited by applicant]
Zhao, Y., et al., “CE6: Sub-block transform for inter blocks (CE6.1.2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29/WG 11, 12th Meeting: Oct. 3-12, 2018, Document: JVET-L0358-v1v2, pp. 1-… [cited by applicant]
U.S. Appl. No. 17/416,987, filed Jun. 21, 2021. [cited by applicant]
Application No. PCT/KR2019/018244, filed Dec. 20, 2019. [cited by applicant]
U.S. Appl. No. 62/864,845, filed Jun. 21, 2019. [cited by applicant]
U.S. Appl. No. 62/811,774, filed Feb. 28, 2019. [cited by applicant]
U.S. Appl. No. 62/792,261, filed Jan. 14, 2019. [cited by applicant]
U.S. Appl. No. 62/783,670, filed Dec. 21, 2018. [cited by applicant]