IP Library › Granted Patent US 12,744,905
Granted Patent B2
US 12,744,905 · App. 18/808,837 · Granted Sep 22, 2026

Image data encoding/decoding method and apparatus

Inventor: Ki Baek Kim (Seoul, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N19/124G06T3/40H04N13/161H04N19/103H04N19/105H04N19/11H04N19/119H04N19/129H04N19/13H04N19/134H04N19/159H04N19/167H04N19/172H04N19/176H04N19/597H04N19/625H04N19/70H04N23/698
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,744,905
App. No.
18/808,837
Granted
Sep 22, 2026
Kind
B2
Abstract

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Claims (28)

1 . A method for decoding a 360-degree image, the method comprising:

receiving a bitstream in which the 360-degree image is encoded, the bitstream including data of an extended 2-dimensional image, the extended 2-dimensional image including a 2-dimensional image and a predetermined extension region, and the 2-dimensional image being projected from an image with a 3-dimensional projection structure and including at least one face; and

reconstructing the extended 2-dimensional image based on a residual image and a predicted image generated by performing prediction the residual image being obtained by parsing syntax elements included in the bitstream,

wherein a size of the extension region to be padded is determined based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being obtained from the bitstream,

wherein the first width information and the second width information are restricted to indicate an even number of luma samples according to a color format of the 2-dimensional image, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

2 . A method for encoding a 360-degree image, the method comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region; and

encoding data of the extended 2-dimensional image into a bitstream in which the 360-degree image is encoded by encoding syntax elements for a residual image into a bitstream, the residual image being generated based on a predicted image generated by performing prediction,

wherein a size of the extension region to be padded is encoded based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream,

wherein the first width information and the second width information are restricted to indicate an even number of luma samples according to a color format of the 2-dimensional image, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

3 . A method of transmitting a bitstream that is generated by encoding a 360-degree image, the method comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region;

encoding data of the extended 2-dimensional image into the bitstream in which the 360-degree image is encoded by encoding syntax elements for a residual image into the bitstream, the residual image being generated based on a predicted image generated by performing prediction; and

transmitting the bitstream,

wherein a size of the extension region to be padded is encoded based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream,

wherein the first width information and the second width information are restricted to indicate an even number of luma samples according to a color format of the 2-dimensional image, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

4 . A non-transitory computer-readable recording medium storing a bitstream that is generated by a method for encoding a 360-degree image, the method comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region; and

encoding data of the extended 2-dimensional image into a bitstream in which the 360-degree image is encoded by encoding syntax elements for a residual image into the bitstream, the residual image being generated based on a predicted image generated by performing prediction,

wherein a size of the extension region to be padded is encoded based on first width information of the extension region on a left side of the face and second width information of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream,

wherein the first width information and the second width information are restricted to indicate an even number of luma samples according to a color format of the 2-dimensional image, and

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

Priority Claims (2)
KR 10-2016-0129386 · Oct 6, 2016 · national
KR 10-2017-0090616 · Jul 17, 2017 · national
Continuity (7)
Continuation 18498597 · Oct 31, 2023
Continuation 18314965 · May 10, 2023
Continuation 17579225 · Jan 19, 2022
Continuation 17027154 · Sep 21, 2020
Continuation 16372287 · Apr 1, 2019
Continuation PCTKR2017011138 · Oct 10, 2017
Related Publication 20250030825A1 · Jan 23, 2025
References Cited (208)
US 5440346A · Alattar et al. · 1995 [cited by applicant]
US 5448297A · Alattar et al. · 1995 [cited by applicant]
US 5724451A · Shin et al. · 1998 [cited by applicant]
US 6314209B1 · Kweon et al. · 2001 [cited by applicant]
US 6581170B1 · Kondo et al. · 2003 [cited by applicant]
US 6611625B1 · Son et al. · 2003 [cited by applicant]
US 6618117B2 · Silverbrook · 2003 [cited by applicant]
US 7097263B2 · Silverbrook · 2006 [cited by examiner]
US 7234645B2 · Silverbrook · 2007 [cited by examiner]
US 7605940B2 · Silverbrook et al. · 2009 [cited by applicant]
US 7623682B2 · Park · 2009 [cited by examiner]
US 8364136B2 · Hoffberg · 2013 [cited by examiner]
US 8582645B2 · Mathew et al. · 2013 [cited by applicant]
US 8804816B2 · Li et al. · 2014 [cited by applicant]
US 8902981B2 · Sagata et al. · 2014 [cited by applicant]
US 9123422B2 · Yu et al. · 2015 [cited by applicant]
US 9208394B2 · Di Venuto Dayer · 2015 [cited by examiner]
US 9215461B2 · Kim et al. · 2015 [cited by applicant]
US 9348488B1 · Renema · 2016 [cited by examiner]
US 9349072B2 · Sun et al. · 2016 [cited by applicant]
US 9462298B2 · Chong et al. · 2016 [cited by applicant]
US 9554138B2 · Lee et al. · 2017 [cited by applicant]
US 9584819B2 · Wang et al. · 2017 [cited by applicant]
US 9686555B2 · Song et al. · 2017 [cited by applicant]
US 9721393B1 · Dunn et al. · 2017 [cited by applicant]
US 9800872B2 · Lee et al. · 2017 [cited by applicant]
US 9843804B2 · An et al. · 2017 [cited by applicant]
US 9971473B2 · Otsuka · 2018 [cited by examiner]
US 10015512B2 · Song et al. · 2018 [cited by applicant]
US 10021384B2 · Seregin et al. · 2018 [cited by applicant]
US 10110891B2 · Yamamoto et al. · 2018 [cited by applicant]
US 10115031B1 · Pashintsev et al. · 2018 [cited by applicant]
US 10154271B2 · Park et al. · 2018 [cited by applicant]
US 10171821B2 · Alshina · 2019 [cited by examiner]
US 10225567B2 · Yamamoto · 2019 [cited by examiner]
US 10225577B2 · Chen · 2019 [cited by applicant]
US 10306258B2 · Bankoski et al. · 2019 [cited by applicant]
US 10554969B2 · Lee et al. · 2020 [cited by applicant]
US 10567799B2 · Liu et al. · 2020 [cited by applicant]
US 10779004B2 · Huang et al. · 2020 [cited by applicant]
US 11109036B2 · Li · 2021 [cited by applicant]
US 11477477B2 · Chen et al. · 2022 [cited by applicant]
US 11778331B2 · Kim · 2023 [cited by applicant]
US 11792523B2 · Kim · 2023 [cited by applicant]
US 11792524B2 · Kim · 2023 [cited by applicant]
US 11838639B2 · Kim · 2023 [cited by applicant]
US 11838640B2 · Kim · 2023 [cited by applicant]
US 20030035482A1 · Klompenhouwer · 2003 [cited by examiner]
US 20030156652A1 · Wise et al. · 2003 [cited by applicant]
US 20050185461A1 · Silverbrook et al. · 2005 [cited by applicant]
US 20060034529A1 · Park et al. · 2006 [cited by applicant]
US 20060268982A1 · Lee et al. · 2006 [cited by applicant]
US 20070036222A1 · Srinivasan · 2007 [cited by examiner]
US 20070174804A1 · Sasao et al. · 2007 [cited by applicant]
US 20070211798A1 · Boyce et al. · 2007 [cited by applicant]
US 20070223582A1 · Borer · 2007 [cited by applicant]
US 20070230803A1 · Ueno et al. · 2007 [cited by applicant]
US 20070280348A1 · Tokumitsu et al. · 2007 [cited by applicant]
US 20080198935A1 · Srinivasan · 2008 [cited by examiner]
US 20090028245A1 · Vieron et al. · 2009 [cited by applicant]
US 20090091654A1 · Nakamura et al. · 2009 [cited by applicant]
US 20090161795A1 · Oh et al. · 2009 [cited by applicant]
US 20090265748A1 · Dotchevski et al. · 2009 [cited by applicant]
US 20100118945A1 · Wada et al. · 2010 [cited by applicant]
US 20100266218A1 · Tezaur · 2010 [cited by applicant]
US 20100310186A1 · Liu et al. · 2010 [cited by applicant]
US 20100315557A1 · Mathew et al. · 2010 [cited by applicant]
US 20110292994A1 · Lim · 2011 [cited by applicant]
US 20120046716A1 · Dougal · 2012 [cited by applicant]
US 20120082224A1 · Van Der Auwera · 2012 [cited by applicant]
US 20120163469A1 · Kim et al. · 2012 [cited by applicant]
US 20120243608A1 · Yu et al. · 2012 [cited by applicant]
US 20120243797A1 · Di Venuto Dayer et al. · 2012 [cited by applicant]
US 20120269274A1 · Kim et al. · 2012 [cited by applicant]
US 20130051452A1 · Li et al. · 2013 [cited by applicant]
US 20130077884A1 · Ikai et al. · 2013 [cited by applicant]
US 20130101016A1 · Chong et al. · 2013 [cited by applicant]
US 20130101035A1 · Wang et al. · 2013 [cited by applicant]
US 20130107973A1 · Wang et al. · 2013 [cited by applicant]
US 20130127869A1 · Winnemoeller et al. · 2013 [cited by applicant]
US 20130128971A1 · Guo et al. · 2013 [cited by applicant]
US 20130128986A1 · Tsai et al. · 2013 [cited by applicant]
US 20130136179A1 · Lim et al. · 2013 [cited by applicant]
US 20130136184A1 · Suzuki et al. · 2013 [cited by applicant]
US 20130182775A1 · Wang et al. · 2013 [cited by applicant]
US 20130202051A1 · Zhou · 2013 [cited by applicant]
US 20130208799A1 · Srinivasamurthy et al. · 2013 [cited by applicant]
US 20130215223A1 · Mochizuki · 2013 [cited by applicant]
US 20130215224A1 · Mockizuki · 2013 [cited by applicant]
US 20130251036A1 · Lee et al. · 2013 [cited by applicant]
US 20130259128A1 · Song et al. · 2013 [cited by applicant]
US 20130259193A1 · Packard et al. · 2013 [cited by applicant]
US 20130266064A1 · Zhang et al. · 2013 [cited by applicant]
US 20130279577A1 · Schwarz et al. · 2013 [cited by applicant]
US 20130287116A1 · Helle et al. · 2013 [cited by applicant]
US 20130322523A1 · Huang et al. · 2013 [cited by applicant]
US 20130322746A1 · Cote · 2013 [cited by examiner]
US 20140079332A1 · Zheng · 2014 [cited by applicant]
US 20140092980A1 · Guo et al. · 2014 [cited by applicant]
US 20140126645A1 · Lim et al. · 2014 [cited by applicant]
US 20140133581A1 · Naito · 2014 [cited by applicant]
US 20140146873A1 · Lee et al. · 2014 [cited by applicant]
US 20140161180A1 · Kumakura · 2014 [cited by applicant]
US 20140177720A1 · Zhang et al. · 2014 [cited by applicant]
US 20140185950A1 · Saint Macary et al. · 2014 [cited by applicant]
US 20140198855A1 · Sole Rojals et al. · 2014 [cited by applicant]
US 20140254686A1 · Lim et al. · 2014 [cited by applicant]
US 20140307787A1 · Zheng et al. · 2014 [cited by applicant]
US 20140328403A1 · Lim et al. · 2014 [cited by applicant]
US 20140334543A1 · Lee et al. · 2014 [cited by applicant]
US 20140362906A1 · Kim et al. · 2014 [cited by applicant]
US 20150072793A1 · Okabayashi · 2015 [cited by examiner]
US 20150124867A1 · Jaeger et al. · 2015 [cited by applicant]
US 20150172714A1 · Wu et al. · 2015 [cited by applicant]
US 20150195520A1 · Li et al. · 2015 [cited by applicant]
US 20150201217A1 · Lu et al. · 2015 [cited by applicant]
US 20150208077A1 · Kim et al. · 2015 [cited by applicant]
US 20150222897A1 · Park · 2015 [cited by applicant]
US 20150229939A1 · Song et al. · 2015 [cited by applicant]
US 20150249840A1 · Kim et al. · 2015 [cited by applicant]
US 20150262332A1 · Park · 2015 [cited by applicant]
US 20150264348A1 · Zou et al. · 2015 [cited by applicant]
US 20150271503A1 · Jeon et al. · 2015 [cited by applicant]
US 20150296197A1 · Paark et al. · 2015 [cited by applicant]
US 20150301777A1 · Jang · 2015 [cited by applicant]
US 20150302665A1 · Miller · 2015 [cited by applicant]
US 20150326866A1 · Ikai et al. · 2015 [cited by applicant]
US 20150341636A1 · Tsai et al. · 2015 [cited by applicant]
US 20150350657A1 · Heo et al. · 2015 [cited by applicant]
US 20150350673A1 · Hu et al. · 2015 [cited by applicant]
US 20150363664A1 · Chang et al. · 2015 [cited by applicant]
US 20160050422A1 · Rosewarne et al. · 2016 [cited by applicant]
US 20160112721A1 · An et al. · 2016 [cited by applicant]
US 20160142726A1 · Han et al. · 2016 [cited by applicant]
US 20160219241A1 · Korneliussen et al. · 2016 [cited by applicant]
US 20160219261A1 · Chen et al. · 2016 [cited by applicant]
US 20160219276A1 · Li et al. · 2016 [cited by applicant]
US 20160219278A1 · Chen et al. · 2016 [cited by applicant]
US 20160219280A1 · Korneliussen et al. · 2016 [cited by applicant]
US 20160227214A1 · Rapaka et al. · 2016 [cited by applicant]
US 20160240010A1 · Rosenthal · 2016 [cited by examiner]
US 20160267056A1 · Hertzog · 2016 [cited by applicant]
US 20160277739A1 · Puri et al. · 2016 [cited by applicant]
US 20160322492A1 · Kang · 2016 [cited by examiner]
US 20160323561A1 · Jin et al. · 2016 [cited by applicant]
US 20160328824A1 · Kim et al. · 2016 [cited by applicant]
US 20160330445A1 · Ugur et al. · 2016 [cited by applicant]
US 20160330455A1 · Lin et al. · 2016 [cited by applicant]
US 20160373756A1 · Yu et al. · 2016 [cited by applicant]
US 20170013261A1 · Lin et al. · 2017 [cited by applicant]
US 20170069369A1 · Kim et al. · 2017 [cited by applicant]
US 20170076429A1 · Russell · 2017 [cited by applicant]
US 20170085917A1 · Hannuksela · 2017 [cited by applicant]
US 20170180738A1 · Park · 2017 [cited by applicant]
US 20170208336A1 · Li et al. · 2017 [cited by applicant]
US 20170230668A1 · Lin et al. · 2017 [cited by applicant]
US 20170251204A1 · Gupte et al. · 2017 [cited by applicant]
US 20170272750A1 · An et al. · 2017 [cited by applicant]
US 20170280126A1 · Van der Auwera et al. · 2017 [cited by applicant]
US 20170280143A1 · Xu et al. · 2017 [cited by applicant]
US 20170289566A1 · He et al. · 2017 [cited by applicant]
US 20170318287A1 · Lee et al. · 2017 [cited by applicant]
US 20170347094A1 · Su et al. · 2017 [cited by applicant]
US 20180020202A1 · Xu et al. · 2018 [cited by applicant]
US 20180020214A1 · Wang et al. · 2018 [cited by applicant]
US 20180020233A1 · Shimazaki et al. · 2018 [cited by applicant]
US 20180039864A1 · Yao et al. · 2018 [cited by applicant]
US 20180070106A1 · Han · 2018 [cited by applicant]
US 20180070110A1 · Chuang et al. · 2018 [cited by applicant]
US 20180124397A1 · Yoo et al. · 2018 [cited by applicant]
US 20180131962A1 · Chen et al. · 2018 [cited by applicant]
US 20180160113A1 · Jeong et al. · 2018 [cited by applicant]
US 20180176596A1 · Jeong et al. · 2018 [cited by applicant]
US 20180176601A1 · Jeong · 2018 [cited by examiner]
US 20180184082A1 · Yoo et al. · 2018 [cited by applicant]
US 20180199034A1 · Nam et al. · 2018 [cited by applicant]
US 20180213264A1 · Zhang et al. · 2018 [cited by applicant]
US 20180241995A1 · Son et al. · 2018 [cited by applicant]
US 20180255295A1 · Lee et al. · 2018 [cited by applicant]
US 20180255299A1 · Lee et al. · 2018 [cited by applicant]
US 20180255304A1 · Jeon et al. · 2018 [cited by applicant]
US 20180288410A1 · Park et al. · 2018 [cited by applicant]
US 20180295384A1 · Son et al. · 2018 [cited by applicant]
US 20190082184A1 · Hannuksela · 2019 [cited by applicant]
US 20190104312A1 · Lim et al. · 2019 [cited by applicant]
US 20190141318A1 · Li et al. · 2019 [cited by applicant]
US 20190191156A1 · Yoo et al. · 2019 [cited by applicant]
US 20190208200A1 · Galpin et al. · 2019 [cited by applicant]
US 20190215532A1 · He et al. · 2019 [cited by applicant]
US 20190222862A1 · Shin et al. · 2019 [cited by applicant]
US 20190297350A1 · Lin et al. · 2019 [cited by applicant]
US 20190387229A1 · Oh et al. · 2019 [cited by applicant]
US 20200007862A1 · Lin et al. · 2020 [cited by applicant]
US 20200029092A1 · Rath et al. · 2020 [cited by applicant]
US 20200288136A1 · Fang et al. · 2020 [cited by applicant]
GB 2548358A · 2017 [cited by examiner]
KR 1020060050350A · 2006 [cited by applicant]
KR 1020070103347A · 2007 [cited by applicant]
KR 1020130027975 · 2013 [cited by applicant]
KR 1020140008503A · 2014 [cited by applicant]
KR 1020150068299A · 2015 [cited by applicant]
KR 1020160032909A · 2016 [cited by applicant]
WO WO2016064862A1 · 2016 [cited by examiner]
WO WO2017123980A1 · 2017 [cited by applicant]
International Search Report, PCT/KR2017/011138, dated Feb. 6, 2018, 10pgs. [cited by applicant]
Kim, Non-Final Office Action, U.S. Appl. No. 16/372,287, Apr. 1, 2019, 6pgs. [cited by applicant]
Francois et al., CE6b: Mode ranking for remaining mode coding with 2 or 3 MPMs' Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-G242, Nov. 21-30, 2011, 5 pgs. [cited by applicant]
Kim, Notice of Action, KR-10-2019-7011757, Jun. 30, 2020, 5pgs. [cited by applicant]