IP Library › Granted Patent US 12,225,296
Granted Patent B2
US 12,225,296 · App. 18/524,452 · Granted Feb 11, 2025

Image data encoding/decoding method and apparatus

Inventor: Ki Baek Kim (Seoul, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N23/698G06T3/40H04N13/161H04N19/103H04N19/105H04N19/11H04N19/119H04N19/124H04N19/129H04N19/13H04N19/134H04N19/159H04N19/167H04N19/172H04N19/176H04N19/597H04N19/625H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,296
App. No.
18/524,452
Granted
Feb 11, 2025
Kind
B2
Abstract

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Claims (54)

1. A method of decoding a current image with a decoding apparatus, comprising:

obtaining coding information for the current image from a bitstream;

dividing a coding block in the current image to obtain one or more sub-blocks based on the coding information,

wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain one or more sub-blocks or a second flag indicating whether to divide the coding block asymmetrically, and

wherein, in case the coding block is divided asymmetrically, a first sub-block having a ¼ size of the coding block is obtained, the first sub-block belonging to the one or more sub-blocks;

obtaining inverse-quantized coefficients of the first sub-block by performing inverse-quantization on the first sub-block;

reconstructing a residual signal of the first sub-block by performing inverse-transform on the inverse-quantized coefficients; and

reconstructing the coding block based on the residual signal, and

wherein obtaining the inverse-quantized coefficients of the first sub-block comprises:

selecting one of a plurality of weight set candidates pre-defined in the decoding apparatus; and

performing the inverse-quantization on the first sub-block based on the selected weight set candidate.

2. The method of claim 1 , wherein each of the weight set candidates includes a plurality of weight components, and

wherein at least one of the weight components belonging to the one of the weight set candidates is different from the weight components belonging to the other of the weight set candidates.

3. The method of claim 1 , wherein a transform type for the inverse-transform of the inverse-quantized coefficients is determined by considering whether or not a size of the first sub-block is greater than a threshold size pre-defined in the decoding apparatus.

4. The method of claim 3 , wherein a number of transform types available for the first sub-block when the size of the first sub-block is greater than the threshold size is different from the number of the transform types available for the first sub-block when the size of the first sub-block is less than or equal to the threshold size.

5. The method of claim 4 , wherein a transform type for the inverse-transform of the quantized coefficients is determined by further considering at least one of the first flag or the second flag.

6. A method of encoding a current image with an encoding apparatus, comprising:

dividing a coding block in the current image to obtain one or more sub-blocks;

obtaining transform coefficients of a first sub-block by performing transform on a residual signal of the first sub-block, the first sub-block belonging to the one or more sub-blocks;

obtaining quantized transform coefficients of the first sub-block by performing quantization on the transform coefficients of the first sub-block; and

generating a bitstream by encoding the quantized transform coefficients of the first sub-block,

wherein coding information for dividing the coding block is encoded into the bitstream,

wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain the one or more sub-blocks or a second flag indicating whether to divide the coding block asymmetrically,

wherein, in case the coding block is divided asymmetrically, the first sub-block having a ¼ size of the coding block is obtained, and

wherein obtaining the quantized transform coefficients of the first sub-block comprises:

selecting one of a plurality of weight set candidates pre-defined in the encoding apparatus; and

performing the quantization on the transform coefficients of the first sub-block based on the selected weight set candidate.

7. A non-transitory computer-readable medium for storing data associated with an image signal, comprising:

a data stream encoded by an encoding method,

wherein the encoding method comprises:

dividing a coding block in the current image to obtain one or more sub-blocks;

obtaining transform coefficients of a first sub-block by performing transform on a residual signal of the first sub-block, the first sub-block belonging to the one or more sub-blocks;

obtaining quantized transform coefficients of the first sub-block by performing quantization on the transform coefficients of the first sub-block; and

generating a bitstream by encoding the quantized transform coefficients of the first sub-block,

wherein coding information for dividing the coding block is encoded into the bitstream,

wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain the one or more sub-blocks or a second flag indicating whether to divide the coding block asymmetrically,

wherein, in case the coding block is divided asymmetrically, the first sub-block having a ¼ size of the coding block is obtained, and

wherein obtaining the quantized transform coefficients of the first sub-block comprises:

selecting one of a plurality of weight set candidates pre-defined in the encoding apparatus; and

performing the quantization on the transform coefficients of the first sub-block based on the selected weight set candidate.

8. A method for transmitting data associated with an image signal, the method comprising:

obtaining a data stream encoded by an encoding method; and

transmitting the data stream,

wherein the encoding method comprises:

dividing a coding block in the current image to obtain one or more sub-blocks;

obtaining transform coefficients of a first sub-block by performing transform on a residual signal of the first sub-block, the first sub-block belonging to the one or more sub-blocks;

obtaining quantized transform coefficients of the first sub-block by performing quantization on the transform coefficients of the first sub-block; and

generating a bitstream by encoding the quantized transform coefficients of the first sub-block,

wherein coding information for dividing the coding block is encoded into the bitstream,

wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain the one or more sub-blocks or a second flag indicating whether to divide the coding block asymmetrically,

wherein, in case the coding block is divided asymmetrically, the first sub-block having a ¼ size of the coding block is obtained, and

wherein obtaining the quantized transform coefficients of the first sub-block comprises:

selecting one of a plurality of weight set candidates pre-defined in the encoding apparatus; and

performing the quantization on the transform coefficients of the first sub-block based on the selected weight set candidate.

Priority Claims (3)
KR 10-2016-0127887 · Oct 4, 2016 · national
KR 10-2016-0129386 · Oct 6, 2016 · national
KR 10-2017-0090616 · Jul 17, 2017 · national
Continuity (6)
Continuation 18314965 · May 10, 2023
Continuation 17579225 · Jan 19, 2022
Continuation 17027154 · Sep 21, 2020
Continuation 16372287 · Apr 1, 2019
Continuation PCTKR2017011138 · Oct 10, 2017
Related Publication 20240098372A1 · Mar 21, 2024
References Cited (76)
US 5440346A · Alattar et al. · 1995 [cited by applicant]
US 5448297A · Alattar et al. · 1995 [cited by applicant]
US 6314209B1 · Kweon et al. · 2001 [cited by applicant]
US 7623682B2 · Park et al. · 2009 [cited by applicant]
US 9554138B2 · Lee et al. · 2017 [cited by applicant]
US 9721393B1 · Dunn et al. · 2017 [cited by applicant]
US 10115031B1 · Pashintsev et al. · 2018 [cited by applicant]
US 10225577B2 · Chen · 2019 [cited by applicant]
US 20020122488A1 · Takahashi · 2002 [cited by examiner]
US 20050185461A1 · Silverbrook et al. · 2005 [cited by applicant]
US 20060034529A1 · Park et al. · 2006 [cited by applicant]
US 20070223582A1 · Borer · 2007 [cited by applicant]
US 20070230803A1 · Ueno et al. · 2007 [cited by applicant]
US 20070280348A1 · Tokumitsu et al. · 2007 [cited by applicant]
US 20090265748A1 · Dotchevski et al. · 2009 [cited by applicant]
US 20120046716A1 · Dougal · 2012 [cited by applicant]
US 20120243608A1 · Yu et al. · 2012 [cited by applicant]
US 20120243797A1 · Di Venuto Dayer et al. · 2012 [cited by applicant]
US 20130051452A1 · Li et al. · 2013 [cited by applicant]
US 20130077884A1 · Ikai et al. · 2013 [cited by applicant]
US 20130215960A1 · Song · 2013 [cited by examiner]
US 20130259193A1 · Packard et al. · 2013 [cited by applicant]
US 20130266064A1 · Zhang et al. · 2013 [cited by applicant]
US 20140079332A1 · Zheng · 2014 [cited by applicant]
US 20140133581A1 · Naito · 2014 [cited by applicant]
US 20140177720A1 · Zhang et al. · 2014 [cited by applicant]
US 20150124867A1 · Jaeger et al. · 2015 [cited by applicant]
US 20150201217A1 · Lu et al. · 2015 [cited by applicant]
US 20150222897A1 · Park · 2015 [cited by applicant]
US 20150264348A1 · Zou et al. · 2015 [cited by applicant]
US 20150301777A1 · Jang · 2015 [cited by applicant]
US 20150302665A1 · Miller · 2015 [cited by applicant]
US 20160112721A1 · An et al. · 2016 [cited by applicant]
US 20160219241A1 · Korneliussen et al. · 2016 [cited by applicant]
US 20160219280A1 · Korneliussen et al. · 2016 [cited by applicant]
US 20160316221A1 · Ikai · 2016 [cited by examiner]
US 20160323561A1 · Jin et al. · 2016 [cited by applicant]
US 20160328824A1 · Kim et al. · 2016 [cited by applicant]
US 20170013261A1 · Lin et al. · 2017 [cited by applicant]
US 20170069369A1 · Kim et al. · 2017 [cited by applicant]
US 20170076429A1 · Russell · 2017 [cited by applicant]
US 20170085917A1 · Hannuksela · 2017 [cited by applicant]
US 20170208336A1 · Li et al. · 2017 [cited by applicant]
US 20170230668A1 · Lin et al. · 2017 [cited by applicant]
US 20170251204A1 · Gupte et al. · 2017 [cited by applicant]
US 20170280126A1 · Van der Auwera et al. · 2017 [cited by applicant]
US 20170318287A1 · Lee et al. · 2017 [cited by applicant]
US 20180020202A1 · Xu et al. · 2018 [cited by applicant]
US 20180070110A1 · Chuang et al. · 2018 [cited by applicant]
US 20180160113A1 · Jeong et al. · 2018 [cited by applicant]
US 20180176596A1 · Jeong et al. · 2018 [cited by applicant]
US 20180184082A1 · Yoo et al. · 2018 [cited by applicant]
US 20180288410A1 · Park et al. · 2018 [cited by applicant]
US 20190082184A1 · Hannuksela · 2019 [cited by applicant]
US 20190141318A1 · Li et al. · 2019 [cited by applicant]
US 20190208200A1 · Galpin et al. · 2019 [cited by applicant]
US 20190215532A1 · He et al. · 2019 [cited by applicant]
US 20190222862A1 · Shin et al. · 2019 [cited by applicant]
US 20190297350A1 · Lin et al. · 2019 [cited by applicant]
US 20190387229A1 · Oh et al. · 2019 [cited by applicant]
US 20200007862A1 · Lin et al. · 2020 [cited by applicant]
US 20200029092A1 · Rath et al. · 2020 [cited by applicant]
US 20200288136A1 · Fang et al. · 2020 [cited by applicant]
US 20200288158A1 · Rusanovskyy · 2020 [cited by examiner]
US 20230137884A1 · Koo · 2023 [cited by examiner]
KR 1020060050350A · 2006 [cited by applicant]
KR 1020070103347A · 2007 [cited by applicant]
KR 1020130027975 · 2013 [cited by applicant]
KR 1020140008503A · 2014 [cited by applicant]
KR 1020150068299A · 2015 [cited by applicant]
KR 1020160032909A · 2016 [cited by applicant]
WO WO2017123980A1 · 2017 [cited by applicant]
International Search Report, PCT/KR2017/011138, dated Feb. 6, 2018, 10pgs. [cited by applicant]
Kim, Non-Final Office Action, U.S. Appl. No. 16/372,287, Apr. 1, 2019, 6pgs. [cited by applicant]
Francois et al., CE6b: Mode ranking for remaining mode coding with 2 or 3 MPMs' Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-G242, Nov. 21-30, 2011, 5 pgs. [cited by applicant]
Kim, Notice of Action, KR-10-2019-7011757, Jun. 30, 2020, 5pgs. [cited by applicant]