IP Library › Granted Patent US 12,513,405
Granted Patent B2
US 12,513,405 · App. 18/733,854 · Granted Dec 30, 2025

Image data encoding/decoding method and apparatus

Inventor: Ki Baek Kim (Daejeon, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N23/698G06T3/40H04N19/103H04N19/11H04N19/119H04N19/124H04N19/129H04N19/13H04N19/134H04N19/159H04N19/176H04N19/51H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,405
App. No.
18/733,854
Granted
Dec 30, 2025
Kind
B2
Abstract

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

Claims (34)

1 . A method for decoding a 360-degree image, the method comprising:

receiving a bitstream in which the 360-degree image is encoded, the bitstream including data of an extended 2-dimensional image, the extended 2-dimensional image including a 2-dimensional image and a predetermined extension region, and the 2-dimensional image being projected from an image with a 3-dimensional projection structure and including at least one face; and

reconstructing the extended 2-dimensional image by decoding the data of an extended 2-dimensional image,

wherein, based on a projection format for the 3-dimensional projection structure is a first projection format, a size of the extension region is determined based on first width information for specifying a width of the extension region on a left side of the face and second width information for specifying a width of the extension region on a right side of the face, both the first width information and the second width information being obtained from the bitstream,

wherein, based on a projection format for the 3-dimensional projection structure is a second projection format, a size of the extension region is determined based on first width information for specifying a width of the extension region on a left side of the face, second width information for specifying a width of the extension region on a right side of the face, third height information for specifying a height of the extension region on a top side of the face and fourth height information for specifying a height of the extension region on a bottom side of the face, all of the first width information, the second width information, the third height information and the fourth height information being obtained from the bitstream,

wherein the first projection format and the second projection format are selected from a plurality of projection formats including an ERP format in which the 360-degree image is projected in a two-dimensional plane and a CMP format in which the 360-degree image is projected in a cube,

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods,

wherein, in case of the second projection format, the padding method for the left side of the face, the padding method for the right side of the face, the padding method for the top side of the face and the padding method for the bottom side of the face are selected independently from each other,

wherein the reconstructing the extended 2-dimensional image comprises generating a prediction image and a residual image, and

wherein the residual image is generated by performing inverse-quantization on information on the residual image.

2 . The method of claim 1 , wherein the padding method is selected from the plurality of padding methods based on selection information obtained from the bitstream.

3 . A method for encoding a 360-degree image, the method comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region; and

encoding data of the extended 2-dimensional image into a bitstream in which the 360-degree image is encoded,

wherein, based on a projection format for the 3-dimensional projection structure is a first projection format, a size of the extension region is encoded based on first width information for specifying a width of the extension region on a left side of the face and second width information for specifying a width of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream,

wherein, based on a projection format for the 3-dimensional projection structure is a second projection format, a size of the extension region is encoded based on first width information for specifying a width of the extension region on a left side of the face, second width information for specifying a width of the extension region on a right side of the face, third height information for specifying a height of the extension region on a top side of the face and fourth height information for specifying a height of the extension region on a bottom side of the face, all of the first width information, the second width information, the third height information and the fourth height information being encoded into the bitstream,

wherein the first projection format and the second projection format are selected from a plurality of projection formats including an ERP format in which the 360-degree image is projected in a two-dimensional plane and a CMP format in which the 360-degree image is projected in a cube,

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods,

wherein, in case of the second projection format, the padding method for the left side of the face, the padding method for the right side of the face, the padding method for the top side of the face and the padding method for the bottom side of the face are selected independently from each other,

wherein the encoding data of the extended 2-dimensional image comprises generating a prediction image and a residual image, and

wherein the residual image is encoded by performing quantization on information on the residual image.

4 . A method for transmitting a bitstream comprising:

obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;

obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region;

encoding data of the extended 2-dimensional image into the bitstream in which a 360-degree image is encoded; and

transmitting the bitstream,

wherein, based on a projection format for the 3-dimensional projection structure is a first projection format, a size of the extension region is encoded based on first width information for specifying a width of the extension region on a left side of the face and second width information for specifying a width of the extension region on a right side of the face, both the first width information and the second width information being encoded into the bitstream,

wherein, based on a projection format for the 3-dimensional projection structure is a second projection format, a size of the extension region is encoded based on first width information for specifying a width of the extension region on a left side of the face, second width information for specifying a width of the extension region on a right side of the face, third height information for specifying a height of the extension region on a top side of the face and fourth height information for specifying a height of the extension region on a bottom side of the face, all of the first width information, the second width information, the third height information and the fourth height information being encoded into the bitstream,

wherein the first projection format and the second projection format are selected from a plurality of projection formats including an ERP format in which the 360-degree image is projected in a two-dimensional plane and a CMP format in which the 360-degree image is projected in a cube,

wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods,

wherein, in case of the second projection format, the padding method for the left side of the face, the padding method for the right side of the face, the padding method for the top side of the face and the padding method for the bottom side of the face are selected independently from each other,

wherein the encoding data of the extended 2-dimensional image comprises generating a prediction image and a residual image, and

wherein the residual image is encoded by performing quantization on information on the residual image.

Priority Claims (3)
KR 10-2016-0127893 · Oct 4, 2016 · national
KR 10-2016-0129391 · Oct 6, 2016 · national
KR 10-2017-0090621 · Jul 17, 2017 · national
Continuity (6)
Continuation 17512996 · Oct 28, 2021
Continuation 17211575 · Mar 24, 2021
Continuation 17085935 · Oct 30, 2020
Continuation 16372270 · Apr 1, 2019
Continuation PCTKR2017011149 · Oct 10, 2017
Related Publication 20240340539A1 · Oct 10, 2024
References Cited (80)
US 20060034374A1 · Park et al. · 2006 [cited by applicant]
US 20060268991A1 · Segall et al. · 2006 [cited by applicant]
US 20080225945A1 · Wu et al. · 2008 [cited by applicant]
US 20110134998A1 · Lee et al. · 2011 [cited by applicant]
US 20120082216A1 · Wang et al. · 2012 [cited by applicant]
US 20120320970A1 · Drugeon · 2012 [cited by examiner]
US 20130108182A1 · Yie et al. · 2013 [cited by applicant]
US 20130188704A1 · Zhou · 2013 [cited by applicant]
US 20130315300A1 · Lee et al. · 2013 [cited by applicant]
US 20140168362A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20140355666A1 · Zhang et al. · 2014 [cited by applicant]
US 20150017268A1 · Patil · 2015 [cited by applicant]
US 20150172688A1 · Maeda et al. · 2015 [cited by applicant]
US 20150201204A1 · Chen et al. · 2015 [cited by applicant]
US 20160012855A1 · Krishnan · 2016 [cited by applicant]
US 20160142697A1 · Budagavi et al. · 2016 [cited by applicant]
US 20160249056A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20170078665A1 · Zheng et al. · 2017 [cited by applicant]
US 20170208336A1 · Li · 2017 [cited by examiner]
US 20170214937A1 · Lin et al. · 2017 [cited by applicant]
US 20190215532A1 · He · 2019 [cited by examiner]
CN 1870748A · 2006 [cited by applicant]
CN 101002479A · 2007 [cited by applicant]
CN 102239694A · 2011 [cited by applicant]
CN 103004197A · 2013 [cited by applicant]
CN 104685872A · 2015 [cited by applicant]
CN 104718756A · 2015 [cited by applicant]
CN 104885470A · 2015 [cited by applicant]
CN 105554506A · 2016 [cited by applicant]
EP 2991356A1 · 2016 [cited by applicant]
EP 3434018B1 · 2019 [cited by applicant]
FR 2811112A1 · 2002 [cited by applicant]
JP 2009100041A · 2009 [cited by examiner]
JP 2013098711A · 2013 [cited by applicant]
JP 2013118424A · 2013 [cited by applicant]
JP 2014535221A · 2014 [cited by applicant]
JP 2015035641A · 2015 [cited by applicant]
JP 2015521442A · 2015 [cited by applicant]
JP 2019525563A · 2019 [cited by applicant]
JP 2019536314A · 2019 [cited by applicant]
JP 7224280B2 · 2023 [cited by applicant]
JP 202340182A · 2023 [cited by applicant]
JP 2023040179A · 2023 [cited by applicant]
JP 7269455B2 · 2023 [cited by applicant]
JP 7269456B2 · 2023 [cited by applicant]
JP 2023066544A · 2023 [cited by applicant]
JP 7353522B2 · 2023 [cited by applicant]
JP 2023181932A · 2023 [cited by applicant]
JP 2023181961A · 2023 [cited by applicant]
JP 202426707A · 2024 [cited by applicant]
JP 2024042822A · 2024 [cited by applicant]
JP 2024042827A · 2024 [cited by applicant]
JP 2024069559A · 2024 [cited by applicant]
JP 2024069560A · 2024 [cited by applicant]
KR 1020150083444A · 2015 [cited by applicant]
KR 20150083444A · 2015 [cited by applicant]
WO 2013047805A1 · 2013 [cited by applicant]
WO 2014203805A1 · 2014 [cited by applicant]
WO 2015100732A1 · 2015 [cited by applicant]
WO 2015199478A1 · 2015 [cited by applicant]
WO 2016026457A1 · 2016 [cited by applicant]
WO 2016053494A1 · 2016 [cited by applicant]
WO 2016090568A1 · 2016 [cited by applicant]
WO 2017123980A1 · 2017 [cited by applicant]
WO 2017165375A1 · 2017 [cited by applicant]
WO 2018009746A1 · 2018 [cited by applicant]
WO 2018066988A1 · 2018 [cited by applicant]
WO 2018066991A1 · 2018 [cited by applicant]
WO 2019026807A1 · 2019 [cited by applicant]
WO 2019059679A1 · 2019 [cited by applicant]
Multi-Type-Tree, Xiang Li, et al. Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016. [cited by applicant]
Quadtree Based Nonsquare Block Structure for Inter Frame Coding in High Efficiency Video Coding, Yuan Yuan, et al. IEEE Transactions On Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012. [cited by applicant]
Madhukar Budagavi, et al. “OMAF: Metadata for guard margin at polygon boundaries in 360 degrees video to prevent boundary artifacts,” ISO/IEC JTC1/SC29/WG11 MPEG2016/m39280, Oct. 2016, Chengdu, China. [cited by applicant]
Yuwen He, et al. “AHG8: Geometry padding for 360 video coding,” JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting, Chengdu, China, Oct. 15-21, 2016. [cited by applicant]
Yuwen He, et al. “AHG8: Geometry padding for 360 video coding,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016. [cited by applicant]
Zhichu He et al., “AVS2-video coding standard—An application-oriented and high performance video coding standard,” IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Jul. 14, 2014. [cited by applicant]
Yoav Cohen, et al. “Hierarchical Coding of Binary Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-7, No. 3, May 1985. [cited by applicant]
Yuwen He, et al. “AHG8: Geometry padding for 360 video coding,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-D0075, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016. [cited by applicant]
Zhichu He, et al. “AVS2-video coding standard—An application-oriented and high performance video coding standard,” 2014 IEEE International Conference on Multimedia and Expo Workshop (ICMEW), Jul. 14-18, 2014. [cited by applicant]
Huang, et al., “EE2.1 Quadtree plus binary tree structure integration with JEM tools,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, … [cited by applicant]