IP Library › Granted Patent US 12,273,520
Granted Patent B2
US 12,273,520 · App. 18/468,667 · Granted Apr 8, 2025

Method and an apparatus for encoding/decoding residual coefficient

Inventors: Dong Gyu Sim (Seoul, KR); Sea Nae Park (Seoul, KR)
Assignee: HANWHA VISION CO., LTD.
H04N19/129H04N19/12H04N19/124H04N19/13H04N19/176H04N19/44H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,273,520
App. No.
18/468,667
Granted
Apr 8, 2025
Kind
B2
Abstract

The encoding/decoding method and apparatus according to the present invention derives a residual coefficient of a residual block, calculates a quantization parameter for a residual block, performs dequantization on a residual coefficient using a quantization parameter, and performs inverse transform on a dequantized residual coefficient to reconstruct a residual sample of a residual block.

Claims (39)

1. A method for decoding an image, comprising:

decoding, based on a predetermined scan order, a residual coefficient of a current block in the image from a bitstream, the current block being obtained by dividing a current picture using a tree-based division method;

performing inverse-quantization on the residual coefficient by using a quantization parameter; and

reconstructing a residual sample of the current block by performing inverse-transform on the inverse-quantized residual coefficient,

wherein the inverse-transform is adaptively performed on the inverse-quantized residual coefficient based on a transform skip flag indicating whether the inverse-transform is skipped on the current block,

wherein the inverse-transform is performed based on a transform candidate set determined from among a plurality of transform candidate sets including a first transform candidate set and a second transform candidate set,

wherein each of the transform candidate sets includes at least one transform type being available for the inverse-transform of the current block, and

wherein the transform candidate set of the current block is determined, based on a size of the current block, among the plurality of transform candidate sets.

2. The method of claim 1 ,

wherein, in response to the size of the current block being less than or equal to a threshold value, the first transform candidate set among the plurality of the transform candidate sets is determined as the transform candidate set, and

wherein, in response to the size of the current block being greater than the threshold value, the second transform candidate set among the plurality of the transform candidate sets is determined as the transform candidate set.

3. The method of claim 2 ,

wherein the threshold value is 32.

4. The method of claim 3 ,

wherein a number of transform types included in the first transform candidate set is different from a number of transform types included in the second transform candidate set.

5. The method of claim 4 ,

wherein the first transform candidate set includes DCT-VIII and DST-VII, and

wherein the second transform candidate set includes DCT-II, DCT-VIII, and DST-VII.

6. The method of claim 1 ,

wherein the transform candidate set of the current block is determined, based on first information signaled from the bitstream, among the plurality of transform candidate sets.

7. A method for encoding an image, comprising:

obtaining a residual coefficient of a current block in the image by performing at least one of transform or quantization on a residual sample of the current block, the current block being obtained by dividing a current picture using a tree-based division method; and

encoding, based on a predetermined scan order, the residual coefficient of the current block,

wherein the quantization is performed based on a quantization parameter,

wherein the transform is adaptively performed based on whether the transform is skipped on the current block,

wherein a transform skip flag indicates whether the transform is skipped on the current block,

wherein the transform is performed based on a transform candidate set determined from among a plurality of transform candidate sets including a first transform candidate set and a second transform candidate set,

wherein each of the transform candidate sets includes at least one transform type being available for the transform of the current block, and

wherein the transform candidate set of the current block is determined, based on a size of the current block, among the plurality of transform candidate sets.

8. A non-transitory computer-readable medium storing a bitstream generated by

an encoding method, the method comprising:

obtaining a residual coefficient of a current block in an image by performing at least one of transform or quantization on a residual sample of the current block, the current block being obtained by dividing a current picture using a tree-based division method; and

encoding, based on a predetermined scan order, the residual coefficient of the current block,

wherein the quantization is performed based on a quantization parameter,

wherein the transform is adaptively performed based on whether the transform is skipped on the current block,

wherein a transform skip flag indicates whether the transform is skipped on the current block,

wherein the transform is performed based on a transform candidate set determined from among a plurality of transform candidate sets including a first transform candidate set and a second transform candidate set,

wherein each of the transform candidate sets includes at least one transform type being available for the transform of the current block, and

wherein the transform candidate set of the current block is determined, based on a size of the current block, among the plurality of transform candidate sets.

Priority Claims (1)
KR 10-2018-0070161 · Jun 19, 2018 · national
Continuity (5)
Continuation 17666412 · Feb 7, 2022
Continuation 16937468 · Jul 23, 2020
Continuation 16431562 · Jun 4, 2019
Continuation 16184581 · Nov 8, 2018
Related Publication 20240007634A1 · Jan 4, 2024
References Cited (90)
US 9432696B2 · Chong et al. · 2016 [cited by applicant]
US 9866829B2 · Joshi et al. · 2018 [cited by applicant]
US 10356413B1 · Sim · 2019 [cited by examiner]
US 10477205B1 · Sim et al. · 2019 [cited by applicant]
US 10587894B2 · Yoo et al. · 2020 [cited by applicant]
US 10764584B2 · Sim · 2020 [cited by examiner]
US 11277613B2 · Sim · 2022 [cited by examiner]
US 11818354B2 · Sim · 2023 [cited by examiner]
US 11962762B2 · Lee · 2024 [cited by examiner]
US 20090266103A1 · Groeneveld · 2009 [cited by applicant]
US 20120099646A1 · Coban et al. · 2012 [cited by applicant]
US 20130128966A1 · Gao et al. · 2013 [cited by applicant]
US 20130188699A1 · Joshi et al. · 2013 [cited by applicant]
US 20150264403A1 · Chong et al. · 2015 [cited by applicant]
US 20150358621A1 · He et al. · 2015 [cited by applicant]
US 20170150186A1 · Zhang et al. · 2017 [cited by applicant]
US 20180184131A1 · Yoo · 2018 [cited by examiner]
US 20180359491A1 · Kang et al. · 2018 [cited by applicant]
US 20190045226A1 · Xu et al. · 2019 [cited by applicant]
US 20190110061A1 · Park et al. · 2019 [cited by applicant]
US 20190191164A1 · Han et al. · 2019 [cited by applicant]
US 20190226103A1 · Kuhl et al. · 2019 [cited by applicant]
US 20190230356A1 · Chao et al. · 2019 [cited by applicant]
US 20190289306A1 · Zhao et al. · 2019 [cited by applicant]
US 20200236362A1 · Lee et al. · 2020 [cited by applicant]
US 20200288134A1 · Lim et al. · 2020 [cited by applicant]
US 20200413040A1 · Lim et al. · 2020 [cited by applicant]
US 20210076041A1 · Lee · 2021 [cited by applicant]
US 20210120269A1 · Chen et al. · 2021 [cited by applicant]
AU 2012326895B2 · 2015 [cited by applicant]
CN 106105206A · 2016 [cited by applicant]
KR 1020090097013A · 2009 [cited by applicant]
KR 20120033218A · 2012 [cited by applicant]
KR 1020140071429A · 2014 [cited by applicant]
KR 1020140074349A · 2014 [cited by applicant]
KR 1020160134702A · 2016 [cited by applicant]
KR 1020160145561A · 2016 [cited by applicant]
KR 1020170023893A · 2017 [cited by applicant]
KR 1020170106592A · 2017 [cited by applicant]
KR 1020170142870A · 2017 [cited by applicant]
KR 20170134196A · 2017 [cited by applicant]
KR 1020180001485A · 2018 [cited by applicant]
KR 1020180007680A · 2018 [cited by applicant]
KR 1020180025285A · 2018 [cited by applicant]
RU 2593991C2 · 2016 [cited by applicant]
WO WO2012074772A1 · 2012 [cited by applicant]
WO WO2015194913A1 · 2015 [cited by applicant]
WO WO2016137166A1 · 2016 [cited by applicant]
WO WO2016200234A1 · 2016 [cited by applicant]
WO WO2017155334A1 · 2017 [cited by applicant]
WO WO2017209455A2 · 2017 [cited by applicant]
Hanwha Vision Co., Ltd., Chinese Office Action, CN Patent Application No. 201980038897.8, Jan. 21, 2024, 13 pgs. [cited by applicant]
Hanwha Vision Co., Ltd., Korean Office Action, KR Patent Application No. 10-2023-0159486, Mar. 5, 2024, 8 pgs. [cited by applicant]
Marta Mrak et al., “Transform Skip Mode”, Document: JCTVC-F077_r1, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting: Torino, IT, Jul. 14-22, 2011, 9 pgs. [cited by applicant]
Bross et al., “High Efficiency Video Coding (HEVC) Text Specification Draft 10 (for FDIS & Last Call)”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-L1003, V… [cited by applicant]
Chen et al., “Algorithm Description for Versatile Video Coding and Test Model 1 (VTM 1)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J1002-v2, Ver. 2, Jun. 16, 2018, 9 pgs. [cited by applicant]
Kwangwoon University Industry—Academy Collaboration Foundation, Request for the Submission of an Opinion, KR10-2018-0070161, Dec. 13, 2018, 12 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 16/184,581, Mar. 5, 2019, 8 pgs. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 16/431,562, Jan. 8, 2020, 10 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 16/431,562, Apr. 29, 2020, 6 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 16/937,468, Jan. 5, 2022, 7 pgs. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 16/937,468, Jul. 12, 2021, 7 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Office Action, KR 2019-0121923, Jul. 1, 2021, 14 pgs. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”, JVET of ITU-T and ISO/IEC. JVET-G1001 Ver. 1, Aug. 19, 2017, pp. 1-48. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 16/972,444, Jul. 16, 2021, 11 pgs. [cited by applicant]
Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard”, IEEE Transactions on Circuits and Systems for Video Technology, Dec. 2012, 20 pgs. [cited by applicant]
Li et al., “Description of SDR Video Coding Technology Proposal by Tencent”, JVET of ITU-T and ISO/IEC. JVET-J0029 Ver.2. Apr. 6, 2018, pp. 1-34. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Request for Preferential Examination and Report of Prior Art Search, KR10-2018-0066706, Aug. 3, 2018, 5 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Request for the Submission of an Opinion, KR10-2018-0066706, Dec. 3, 2018, 12 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Decision to Grant, KR10-2018-0066706, Apr. 1, 2019, 5 pgs. [cited by applicant]
Chuang et al., “AhG Quantization: Sub-LCU Delta QP”, JCTVC-E051. Mar. 11, 2011, 6 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Written Decision on Registration. KR10-2018-0070161, Jul. 2, 2019, 4 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, International Search Report and Written Opinion, PCT/KR2019/006962, Oct. 11, 2019, 10 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, RU2020143564, Office Action, Oct. 10, 2022, 12 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, IN202117000989, Office Action, Oct. 31, 2022, 6 pgs. [cited by applicant]
Sim et al., Non-Final Office Action, U.S. Appl. No. 17/666,412, Nov. 10, 2022, 9 pgs. [cited by applicant]
Sim et al., Final Office Action, U.S. Appl. No. 17/666,412, Apr. 20, 2023, 11 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 17/666,412, Jul. 12, 2023, 7 pgs. [cited by applicant]
Sim et al., Notice of Allowance, U.S. Appl. No. 16/972,444, Feb. 2, 2022, 8 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Written Opinion, KR 2018-0066706, Jan. 29, 2019, 13 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Written Opinion, KR 2018-0070161, Feb. 13, 2019, 13 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Final Office Action, KR 2018-0070161, Apr. 26, 2019, 9 pgs. [cited by applicant]
Kwangwoon University Industry—Academic Collaboration Foundation, Written Opinion, KR 2019-0121923, Aug. 20, 2021, 16 pgs. [cited by applicant]
Hanwha Techwin Corporation, Office Action, KR 2022-0049379, Jul. 15, 2022, 7 pgs. [cited by applicant]
Sole et al., “Unified Scans for the Significance Map and Coefficient Level Coding in High Coding Efficiency”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29 /WG11, 5th Meeting:… [cited by applicant]
Mrak et al., “Transform Skip Mode”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29 /WG11, 6th Meeting: Torino, IT, Document: JCTVC-E335, Jul. 2011, 9 pgs. [cited by applicant]
Hanwha Techwin Corporation, Written Opinion, KR 2022-0049379, Aug. 11, 2022, 10 pgs. [cited by applicant]
Hanwha Vision Co., Ltd., Office Action, KR 2023-0034289, May 9, 2023, 7 pgs. [cited by applicant]
Hanwha Vision Co., Ltd., Written Opinion, KR 2023-0034289, Jul. 5, 2023, 4 pgs. [cited by applicant]
Hanwha Vision Co., Ltd., Chinese Office Action, CN Patent Application No. 201980038897.8, Sep. 11, 2024, 17 pgs. [cited by applicant]