IP Library Granted Patent US 12,206,829
Granted Patent B2
US 12,206,829 · App. 18/664,650 · Granted Jan 21, 2025

Image data encoding/decoding method and apparatus

Inventor: Ki Baek Kim (Seoul, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N13/161G06T3/40H04N19/103H04N19/105H04N19/11H04N19/119H04N19/124H04N19/129H04N19/13H04N19/134H04N19/159H04N19/167H04N19/172H04N19/176H04N19/597H04N19/625H04N19/70H04N23/698
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,206,829
App. No.
18/664,650
Granted
Jan 21, 2025
Kind
B2
Abstract

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Claims (21)

1. A method for decoding a 360-degree image, the method comprising:

receiving a bitstream in which the 360-degree image is encoded, the bitstream including data of an extended 2-dimensional image, the extended 2-dimensional image including a 2-dimensional image and a predetermined extension region, and the 2-dimensional image being projected from an image with a 3-dimensional projection structure and including at least one face; and

reconstructing the extended 2-dimensional image by adding a residual image for the extended 2-dimensional image to a predicted image for the extended 2-dimensional image, the predicted image being obtained by intra prediction and the residual image being obtained by performing inverse quantization for residual information,

wherein a size of the extension region to be padded is determined based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being obtained from the bitstream, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

2. The method of claim 1 , wherein the padding method is selected from the plurality of padding methods based on selection information obtained from the bitstream.

3. The method of claim 1 , wherein the plurality of padding methods includes at least a first padding method which copies sample values of the face for the sample values of the extension region.

4. The method of claim 2 , wherein the first padding method horizontally copies the sample values of the face to the sample values of the extension region.

5. The method of claim 1 , wherein the plurality of padding methods includes at least a second padding method which changes sample values of the face for the sample values of the extension region.

6. A method for encoding a 360-degree image, the method comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region; and

encoding a residual image for the extended 2-dimensional image into a bitstream in which the 360-degree image is encoded, the residual image being obtained by subtracting a predicted image for the extended 2-dimensional image from the extended 2-dimensional image, the predicted image being obtained by intra prediction and the residual image being encoded by performing quantization for the residual image,

wherein a size of the extension region to be padded is encoded based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

7. A non-transitory computer-readable recording medium storing a bitstream that is generated by a method for encoding a 360-degree image, the method comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region; and

encoding a residual image for the extended 2-dimensional image into a bitstream in which the 360-degree image is encoded, the residual image being obtained by subtracting a predicted image for the extended 2-dimensional image from the extended 2-dimensional image, the predicted image being obtained by intra prediction and the residual image being encoded by performing quantization for the residual image,

wherein a size of the extension region to be padded is encoded based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

Priority Claims (3)
KR 10-2016-0127887 · Oct 4, 2016 · national
KR 10-2016-0129386 · Oct 6, 2016 · national
KR 10-2017-0090616 · Jul 17, 2017 · national
Continuity (7)
Continuation 18498597 · Oct 31, 2023
Continuation 18314965 · May 10, 2023
Continuation 17579225 · Jan 19, 2022
Continuation 17027154 · Sep 21, 2020
Continuation 16372287 · Apr 1, 2019
Continuation PCTKR2017011138 · Oct 10, 2017
Related Publication 20240297969A1 · Sep 5, 2024
References Cited (88)
US 5440346A · Alattar et al. · 1995 [cited by applicant]
US 5448297A · Alattar et al. · 1995 [cited by applicant]
US 5724451A · Shin et al. · 1998 [cited by applicant]
US 6314209B1 · Kweon et al. · 2001 [cited by applicant]
US 7623682B2 · Park et al. · 2009 [cited by applicant]
US 9554138B2 · Lee et al. · 2017 [cited by applicant]
US 9721393B1 · Dunn et al. · 2017 [cited by applicant]
US 10015512B2 · Song et al. · 2018 [cited by applicant]
US 10115031B1 · Pashintsev et al. · 2018 [cited by applicant]
US 10225577B2 · Chen · 2019 [cited by applicant]
US 10306258B2 · Bankoski et al. · 2019 [cited by applicant]
US 10694210B2 · Chou · 2020 [cited by examiner]
US 10779004B2 · Huang · 2020 [cited by applicant]
US 20050185461A1 · Silverbrook et al. · 2005 [cited by applicant]
US 20060034529A1 · Park et al. · 2006 [cited by applicant]
US 20070223582A1 · Borer · 2007 [cited by applicant]
US 20070230803A1 · Ueno et al. · 2007 [cited by applicant]
US 20070280348A1 · Tokumitsu et al. · 2007 [cited by applicant]
US 20090028245A1 · Vieron et al. · 2009 [cited by applicant]
US 20090265748A1 · Dotchevski et al. · 2009 [cited by applicant]
US 20120046716A1 · Dougal · 2012 [cited by applicant]
US 20120243608A1 · Yu et al. · 2012 [cited by applicant]
US 20120243797A1 · Di Venuto Dayer et al. · 2012 [cited by applicant]
US 20130051452A1 · Li et al. · 2013 [cited by applicant]
US 20130077884A1 · Ikai et al. · 2013 [cited by applicant]
US 20130128971A1 · Guo et al. · 2013 [cited by applicant]
US 20130136184A1 · Suzuki et al. · 2013 [cited by applicant]
US 20130182775A1 · Wang et al. · 2013 [cited by applicant]
US 20130259193A1 · Packard et al. · 2013 [cited by applicant]
US 20130266064A1 · Zhang et al. · 2013 [cited by applicant]
US 20140079332A1 · Zheng · 2014 [cited by applicant]
US 20140126645A1 · Lim et al. · 2014 [cited by applicant]
US 20140133581A1 · Naito · 2014 [cited by applicant]
US 20140177720A1 · Zhang et al. · 2014 [cited by applicant]
US 20150124867A1 · Jaeger et al. · 2015 [cited by applicant]
US 20150201217A1 · Lu et al. · 2015 [cited by applicant]
US 20150222897A1 · Park · 2015 [cited by applicant]
US 20150264348A1 · Zou et al. · 2015 [cited by applicant]
US 20150301777A1 · Jang · 2015 [cited by applicant]
US 20150302665A1 · Miller · 2015 [cited by examiner]
US 20160112721A1 · An et al. · 2016 [cited by applicant]
US 20160219241A1 · Korneliussen et al. · 2016 [cited by applicant]
US 20160219280A1 · Korneliussen et al. · 2016 [cited by applicant]
US 20160227214A1 · Rapaka et al. · 2016 [cited by applicant]
US 20160277739A1 · Puri et al. · 2016 [cited by applicant]
US 20160323561A1 · Jin et al. · 2016 [cited by applicant]
US 20160328824A1 · Kim et al. · 2016 [cited by applicant]
US 20160360235A1 · Ramasubramonian · 2016 [cited by examiner]
US 20170013261A1 · Lin · 2017 [cited by applicant]
US 20170069369A1 · Kim et al. · 2017 [cited by applicant]
US 20170076429A1 · Russell · 2017 [cited by applicant]
US 20170085917A1 · Hannuksela · 2017 [cited by examiner]
US 20170208336A1 · Li et al. · 2017 [cited by applicant]
US 20170230668A1 · Lin et al. · 2017 [cited by applicant]
US 20170251204A1 · Gupte · 2017 [cited by examiner]
US 20170280126A1 · Van der Auwera · 2017 [cited by examiner]
US 20170280143A1 · Xu et al. · 2017 [cited by applicant]
US 20170318287A1 · Lee et al. · 2017 [cited by applicant]
US 20180020202A1 · Xu et al. · 2018 [cited by applicant]
US 20180070106A1 · Han · 2018 [cited by applicant]
US 20180070110A1 · Chuang · 2018 [cited by applicant]
US 20180160113A1 · Jeong et al. · 2018 [cited by applicant]
US 20180176596A1 · Jeong et al. · 2018 [cited by applicant]
US 20180176601A1 · Jeong et al. · 2018 [cited by applicant]
US 20180184082A1 · Yoo et al. · 2018 [cited by applicant]
US 20180213264A1 · Zhang et al. · 2018 [cited by applicant]
US 20180288410A1 · Park et al. · 2018 [cited by applicant]
US 20190082184A1 · Hannuksela · 2019 [cited by applicant]
US 20190141318A1 · Li et al. · 2019 [cited by applicant]
US 20190208200A1 · Galpin et al. · 2019 [cited by applicant]
US 20190215532A1 · He et al. · 2019 [cited by applicant]
US 20190222862A1 · Shin et al. · 2019 [cited by applicant]
US 20190297350A1 · Lin et al. · 2019 [cited by applicant]
US 20190387229A1 · Oh et al. · 2019 [cited by applicant]
US 20200007862A1 · Lin et al. · 2020 [cited by applicant]
US 20200029092A1 · Rath et al. · 2020 [cited by applicant]
US 20200288136A1 · Fang et al. · 2020 [cited by applicant]
KR 1020060050350A · 2006 [cited by applicant]
KR 1020070103347A · 2007 [cited by applicant]
KR 1020130027975 · 2013 [cited by applicant]
KR 1020140008503A · 2014 [cited by applicant]
KR 1020150068299A · 2015 [cited by applicant]
KR 1020160032909A · 2016 [cited by applicant]
WO WO2017123980A1 · 2017 [cited by applicant]
International Search Report, PCT/KR2017/011138, dated Feb. 6, 2018, 10pgs. [cited by applicant]
Kim, Non-Final Office Action, U.S. Appl. No. 16/372,287, filed Apr. 1, 2019, 6pgs. [cited by applicant]
Francois et al., CE6b: Mode ranking for remaining mode coding with 2 or 3 MPMs' Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-G242, Nov. 21-30, 2011, 5 pgs. [cited by applicant]
Kim, Notice of Action, KR-10-2019-7011757, Jun. 30, 2020, 5pgs. [cited by applicant]