IP Library Granted Patent US 12,581,064
Granted Patent B2
US 12,581,064 · App. 18/971,895 · Granted Mar 17, 2026

Method and apparatus for reconstructing 360-degree image according to projection format

Inventor: Ki Baek Kim (Daejeon, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N19/82G06T3/40H04N11/28H04N19/103H04N19/11H04N19/117H04N19/119H04N19/124H04N19/129H04N19/13H04N19/134H04N19/159H04N19/174H04N19/176H04N19/186H04N19/30H04N19/31H04N19/33H04N19/44H04N19/503H04N19/51H04N19/625H04N19/80H04N19/85H04N19/86H04N23/698H04N19/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,581,064
App. No.
18/971,895
Granted
Mar 17, 2026
Kind
B2
Abstract

Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Claims (30)

1 . A method of decoding an image with a decoding apparatus, comprising:

receiving encoding data for a current block included in the image;

parsing syntax elements for a residual block of the current block from the encoding data;

obtaining the residual block based on the syntax elements for the residual block;

reconstructing the current block based on the residual block to reconstruct the image;

performing one or more in-loop filtering for the reconstructed image; and

performing a post processing on the in-loop filtered reconstructed image based on post processing information included in the encoding data,

wherein the post processing comprises padding at least one region to the in-loop filtered reconstructed image,

wherein the post processing information is included in a Supplemental Enhancement Information (SEI) message,

wherein the padding is performed using a predetermined same sample value for the region to be padded, and

wherein the region to be padded has no samples before the padding and has samples all having the predetermined same sample value after the padding.

2 . A method of encoding an image with an encoding apparatus, comprising:

obtaining a residual block of a current block included in the image;

encoding syntax elements for the residual block into encoding data for the current block; and

encoding post processing information into the encoding data,

wherein the post processing information is used for performing a post processing on an in-loop filtered reconstructed image, a reconstructed image being obtained based on the residual block of the current block and the in-loop filtered reconstructed image being obtained by performing one or more in-loop filtering for the reconstructed image, and

wherein the post processing comprises padding at least one region to the in-loop filtered reconstructed image,

wherein the post processing information is included in a Supplemental Enhancement Information (SEI) message,

wherein the padding is performed using a predetermined same sample value for the region to be padded, and

wherein the region to be padded has no samples before the padding and has samples all having the predetermined same sample value after the padding.

3 . A method of transmitting encoding data which is generated by a method of encoding an image, the method of encoding comprises:

obtaining a residual block of a current block included in the image;

encoding syntax elements for the residual block into the encoding data for the current block;

encoding post processing information into the encoding data; and

transmitting the encoding data,

wherein the post processing information is used for performing a post processing on an in-loop filtered reconstructed image, a reconstructed image being obtained based on the residual block of the current block and the in-loop filtered reconstructed image being obtained by performing one or more in-loop filtering for the reconstructed image, and

wherein the post processing comprises padding at least one region to the in-loop filtered reconstructed image,

wherein the post processing information is included in a Supplemental Enhancement Information (SEI) message,

wherein the padding is performed using a predetermined same sample value for the region to be padded, and

wherein the region to be padded has no samples before the padding and has samples all having the predetermined same sample value after the padding.

Priority Claims (3)
KR 10-2016-0127878 · Oct 4, 2016 · national
KR 10-2016-0129382 · Oct 6, 2016 · national
KR 10-2017-0090612 · Jul 17, 2017 · national
Continuity (6)
Continuation 18672265 · May 23, 2024
Continuation 18466442 · Sep 13, 2023
Continuation 17487277 · Sep 28, 2021
Continuation 16372237 · Apr 1, 2019
Continuation PCTKR2017011143 · Oct 10, 2017
Related Publication 20250106518A1 · Mar 27, 2025
References Cited (140)
US 6141034A · McCutchen · 2000 [cited by applicant]
US 6157396A · Margulis et al. · 2000 [cited by applicant]
US 7126630B1 · Lee et al. · 2006 [cited by applicant]
US 7292722B2 · Lelescu et al. · 2007 [cited by applicant]
US 7623682B2 · Park et al. · 2009 [cited by applicant]
US 8217988B2 · Park · 2012 [cited by applicant]
US 8264524B1 · Davey · 2012 [cited by applicant]
US 11165958B2 · Kim · 2021 [cited by applicant]
US 20030044080A1 · Frishman et al. · 2003 [cited by applicant]
US 20040105597A1 · Lelescu et al. · 2004 [cited by applicant]
US 20060034367A1 · Park · 2006 [cited by applicant]
US 20060034374A1 · Park et al. · 2006 [cited by applicant]
US 20060034529A1 · Park et al. · 2006 [cited by applicant]
US 20060210145A1 · Lee et al. · 2006 [cited by applicant]
US 20060251336A1 · Lelescu et al. · 2006 [cited by applicant]
US 20070133954A1 · Maeda et al. · 2007 [cited by applicant]
US 20110116548A1 · Amano · 2011 [cited by applicant]
US 20110274166A1 · Jeon et al. · 2011 [cited by applicant]
US 20120057788A1 · Fukuhara et al. · 2012 [cited by applicant]
US 20120176367A1 · Genova et al. · 2012 [cited by applicant]
US 20130010865A1 · Coban et al. · 2013 [cited by applicant]
US 20130022113A1 · Chen et al. · 2013 [cited by applicant]
US 20130044809A1 · Chong · 2013 [cited by examiner]
US 20130194255A1 · Lee et al. · 2013 [cited by applicant]
US 20130195350A1 · Tanaka · 2013 [cited by examiner]
US 20130259133A1 · Song · 2013 [cited by examiner]
US 20130308709A1 · Norkin et al. · 2013 [cited by applicant]
US 20130322523A1 · Huang · 2013 [cited by examiner]
US 20130329794A1 · Jeon et al. · 2013 [cited by applicant]
US 20140023136A1 · Park · 2014 [cited by examiner]
US 20140146873A1 · Lee et al. · 2014 [cited by applicant]
US 20140153636A1 · Esenlik · 2014 [cited by examiner]
US 20140184727A1 · Xiao et al. · 2014 [cited by applicant]
US 20140198844A1 · Hsu · 2014 [cited by examiner]
US 20140267916A1 · Smith · 2014 [cited by applicant]
US 20140269943A1 · Richardson · 2014 [cited by applicant]
US 20140301463A1 · Rusanovskyy et al. · 2014 [cited by applicant]
US 20140307774A1 · Minoo et al. · 2014 [cited by applicant]
US 20140341549A1 · Hattori · 2014 [cited by applicant]
US 20140376612A1 · Chen et al. · 2014 [cited by applicant]
US 20150055703A1 · Pang · 2015 [cited by examiner]
US 20150146779A1 · Bang · 2015 [cited by examiner]
US 20150172544A1 · Deng et al. · 2015 [cited by applicant]
US 20150181234A1 · Tourapis · 2015 [cited by examiner]
US 20150195566A1 · Hinz et al. · 2015 [cited by applicant]
US 20150201204A1 · Chen et al. · 2015 [cited by applicant]
US 20150229932A1 · Sato · 2015 [cited by applicant]
US 20150312593A1 · Akeley · 2015 [cited by examiner]
US 20150350662A1 · Minoo et al. · 2015 [cited by applicant]
US 20150358617A1 · Sato · 2015 [cited by applicant]
US 20160100191A1 · Mishra · 2016 [cited by examiner]
US 20160142697A1 · Budagavi et al. · 2016 [cited by applicant]
US 20160142740A1 · Sharman · 2016 [cited by applicant]
US 20160150238A1 · Park · 2016 [cited by examiner]
US 20160241837A1 · Cole et al. · 2016 [cited by applicant]
US 20160241884A1 · Messing · 2016 [cited by applicant]
US 20160249056A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20160269733A1 · Tourapis et al. · 2016 [cited by applicant]
US 20160328824A1 · Kim et al. · 2016 [cited by applicant]
US 20160373743A1 · Zhao et al. · 2016 [cited by applicant]
US 20160373769A1 · Zhao et al. · 2016 [cited by applicant]
US 20170155920A1 · Park et al. · 2017 [cited by applicant]
US 20170336705A1 · Zhou et al. · 2017 [cited by applicant]
US 20170339391A1 · Zhou et al. · 2017 [cited by applicant]
US 20170347026A1 · Hannuksela · 2017 [cited by applicant]
US 20170366796A1 · Goldentouch · 2017 [cited by applicant]
US 20180025467A1 · Macmillan et al. · 2018 [cited by applicant]
US 20180027226A1 · Abbas et al. · 2018 [cited by applicant]
US 20180040164A1 · Newman et al. · 2018 [cited by applicant]
US 20180084257A1 · Abbas · 2018 [cited by applicant]
US 20180091735A1 · Wang et al. · 2018 [cited by applicant]
US 20180249164A1 · Kim · 2018 [cited by examiner]
US 20190082161A1 · Cole et al. · 2019 [cited by applicant]
US 20190158849A1 · Yu et al. · 2019 [cited by applicant]
US 20190215532A1 · He · 2019 [cited by examiner]
US 20190222862A1 · Shin et al. · 2019 [cited by applicant]
US 20200036997A1 · Li et al. · 2020 [cited by applicant]
US 20200322585A1 · Tsunashima · 2020 [cited by applicant]
US 20240048765A1 · Kim · 2024 [cited by applicant]
US 20240205424A1 · Hendry et al. · 2024 [cited by applicant]
CN 1174646A · 1998 [cited by applicant]
CN 1209933A · 1999 [cited by applicant]
CN 1759616A · 2006 [cited by applicant]
CN 101010960A · 2007 [cited by applicant]
CN 101479765A · 2009 [cited by applicant]
CN 100544444C · 2009 [cited by applicant]
CN 101641955A · 2010 [cited by applicant]
CN 101888555A · 2010 [cited by applicant]
CN 102611884A · 2012 [cited by applicant]
CN 102918840A · 2013 [cited by applicant]
CN 103250416A · 2013 [cited by applicant]
CN 103621084A · 2014 [cited by applicant]
CN 103907350A · 2014 [cited by applicant]
CN 104396259A · 2015 [cited by applicant]
CN 104584560A · 2015 [cited by applicant]
CN 104602013A · 2015 [cited by applicant]
CN 104662897A · 2015 [cited by applicant]
CN 104811637A · 2015 [cited by applicant]
CN 104833307A · 2015 [cited by applicant]
CN 105247870A · 2016 [cited by applicant]
CN 105554506A · 2016 [cited by applicant]
GB 2548358A · 2017 [cited by applicant]
JP 2015180040A · 2015 [cited by applicant]
KR 1020060015223A · 2006 [cited by applicant]
KR 1020060050350A · 2007 [cited by applicant]
KR 1020070103347A · 2007 [cited by applicant]
KR 1020110118527A · 2011 [cited by applicant]
KR 1020130088085A · 2013 [cited by applicant]
KR 1020150068299A · 2015 [cited by applicant]
KR 1020150113524A · 2015 [cited by applicant]
KR 1020160032909A · 2016 [cited by applicant]
WO WO2013159330A1 · 2013 [cited by applicant]
WO WO2014053518A1 · 2014 [cited by applicant]
WO WO2014084656A1 · 2014 [cited by applicant]
WO WO2015199478A1 · 2015 [cited by applicant]
WO WO2016026457A1 · 2016 [cited by applicant]
ITU-T Recommendation H.265 (Apr. 2015 ed.) (Year: 2015). [cited by examiner]
“Series H: Audiovisual and Multimedia Systems Infrastructure of Audiovisual Services—Coding of Moving Video: Advanced Video Coding for Generic Audiovisual Services,” ITU-T Telecommunication Standardization Sector of ITU… [cited by applicant]
Fuldseth Arild, “Replacing Slices with Titles for High Level Parallelism,” Joint Collaborative Team on Video Coding (JCT-VC-D227) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Jan. 2011, (5 Pages in English). [cited by applicant]
Fuldseth Arild, “Tiles” Joint Collaborative Team on Video Coding (JCT-VC-F335) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Jul. 2011, (15 Pages in English). [cited by applicant]
Ohm, Jens-Rainer, et al. “Comparison of the coding efficiency of video coding standards—including high efficiency video coding (HEVC).” [cited by applicant]
Sjoberg, Rickard, et al. “Overview of HEVC high-level syntax and reference picture management.” [cited by applicant]
Bordes, Philippe, et al. “An overview of the emerging HEVC standard.” [cited by applicant]
Sullivan et al. “Overview of the High Efficiency Video Coding (HEVC) Standard”, [cited by applicant]
K. Misra, A. Segall, M. Horowitz, S. Xu, A. Fuldseth, & M. Zhou, “An Overview of Tiles in HEVC”, 7 IEEE J. of Selected Topics in Signal Processing 969-977 (Dec. 2013) (Year: 2013). [cited by applicant]
Sze, Vivienne, et al. “High efficiency video coding (HEVC).” [cited by applicant]
Choi., Byeongdoo et al., “WD on ISO/IEC 23000-20 Omnidirectional Media Application Format”, [cited by applicant]
Lu, International Organisation for Standardisation Organisation Internationale De Normalisation ISO/IEF JTC1/SC29/WG11 Coding of Moving Pictures and Audio, Tile Segmentation Scheme for OMAF, May-Jun. 2016, 4 pgs. [cited by applicant]
P. Hanhart, et al., “InterDigital's Response to the 360 Video Category in Joint Call for Evidence on Video Compression with Capability beyond HEVC”. [cited by applicant]
G. Auwera, et al., “AHG8: ACP with padding for 360-degree video”, [cited by applicant]
Y-K. Wang, et al., “On CMP padding and region-wise packing”, [cited by applicant]
International Search Report issued on Feb. 2, 2018 in counterpart International Patent Application No. PCT/KR2017/011143 (2 pages in English and 2 pages in Korean). [cited by applicant]
Korean Notice of Allowance, issued on Nov. 30, 2020 in counterpart Korean Patent Application No. 10-2019-7011755 (3 pages in Korean). [cited by applicant]
Chinese Office Action issued on Jan. 6, 2021 in counterpart Chinese Patent Application No. 201780073622.9 (9 pages in English and 8 pages in Chinese). [cited by applicant]
KIPO, Written Opinion for KR 10-2021-7034771 (Mar. 14, 2022) (Year: 2022). [cited by applicant]
Zhuo, Li, et al. “Quality fine granular scalability video coding method for head shoulder sequence images.” Tien Tzu Hsueh Pao/Acta Electronica Sinica 32.3, Mar. 1, 2004. (pp. 441-445). [cited by applicant]
Dong, P. Y. “Re-loss-free intra Coding Using Integer Linear Programming for H. 264/MPEG-4 Avc.” Computer Science, vol. 36, Issue 9, 2009. (pp. 1-2). [cited by applicant]
Kim, Jaejoon, et al. “On realization of modified encoding/decoding for high capacity panoramic video.” 2009 Fourth International Conference on Digital Information Management. IEEE, Dec. 18, 2009. (1 page). [cited by applicant]
Sullivan, Gary, et al. “Meeting report of the 23rd meeting of the Joint Collaborative Team on Video Coding (JCT-VC), San Diego, US, Feb. 19-26, 2016” JCTVC-W_Notes_d7. (pp. 1-123). [cited by applicant]
Series, H. “Audiovisual and multimedia systems infrastructure of audiovisual services-Coding of moving video, High efficiency video coding.” International Telecommunication Union, T-Rec-H. 265-201304-1, 2019. (pp. 1-317… [cited by applicant]