IP Library › Granted Patent US 12,464,244
Granted Patent B2
US 12,464,244 · App. 17/512,996 · Granted Nov 4, 2025

Image data encoding/decoding method and apparatus

Inventor: Ki Baek Kim (Daejeon, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N23/698G06T3/40H04N19/103H04N19/11H04N19/119H04N19/124H04N19/129H04N19/13H04N19/134H04N19/159H04N19/176H04N19/51H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,464,244
App. No.
17/512,996
Filed
Oct 28, 2021
Granted
Nov 4, 2025
Kind
B2
Art Unit
2488
USPC
348/36
Abstract

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

Claims (38)

1 . A method of decoding an image, comprising:

partitioning the image to obtain a partitioned image based on partitioning information that is included in a bitstream, the partitioning being performed using tree-based partitioning structures that include a quad-tree partitioning structure, a binary-tree partitioning structure, and a triple-tree partitioning structure; and

decoding the partitioned image by performing inter prediction,

wherein the decoding the partitioned image comprises:

obtaining, from the bitstream, an offset for the image, the offset being signaled for a chroma component, and the offset comprising at least one of a left offset, a right offset, a top offset, or a bottom offset;

deriving a size variable for resizing the image based on the offset; and

performing the inter prediction based on the size variable,

wherein the offset is defined with a direction of resizing, and

wherein, in a case where a ratio of the luma component to the chroma component is 2 to 1, the size variable for resizing for a luma component is derived (i) by multiplying a first offset by 2, the first offset being determined by a sum of the left offset and the right offset, or (ii) by multiplying a second offset by 2, the second offset being determined by a sum of the top offset and the bottom offset.

2 . The method of claim 1 , wherein the size variable for resizing the image in a horizontal direction is derived based on the left offset and the right offset.

3 . A method of encoding an image, comprising:

partitioning the image to obtain a partitioned image based on partitioning information that is encoded into a bitstream, the partitioning being performed using tree-based partitioning structures that include a quad-tree partitioning structure, a binary-tree partitioning structure, and a triple-tree partitioning structure; and

encoding the partitioned image by performing inter prediction,

wherein the encoding the partitioned image comprises:

encoding, into the bitstream, an offset for the image, the offset being encoded for a chroma component, and the offset comprising at least one of a left offset, a right offset, a top offset, or a bottom offset;

deriving a size variable for resizing the image based on the offset; and

performing the inter prediction based on the size variable,

wherein the offset is defined with a direction of resizing, and

wherein, in a case where a ratio of the luma component to the chroma component is 2 to 1, the size variable for resizing for a luma component is derived (i) by multiplying a first offset by 2, the first offset being determined by a sum of the left offset and the right offset, or (ii) by multiplying a second offset by 2, the second offset being determined by a sum of the top offset and the bottom offset.

4 . A non-transitory computer readable recording medium storing a bitstream that is generated by a method of encoding an image, the method comprising:

partitioning the image to obtain a partitioned image based on partitioning information that is encoded into the bitstream, the partitioning being performed using tree-based partitioning structures that include a quad-tree partitioning structure, a binary-tree partitioning structure, and a triple-tree partitioning structure; and

encoding the partitioned image by performing inter prediction,

wherein the encoding the partitioned image comprises:

encoding, into the bitstream, an offset for the image, the offset being encoded for a chroma component, and the offset comprising at least one of a left offset, a right offset, a top offset, or a bottom offset;

deriving a size variable for resizing the image based on the offset; and

performing the inter prediction based on the size variable,

wherein the offset is defined with a direction of resizing, and

wherein, in a case where a ratio of the luma component to the chroma component is 2 to 1, the size variable for resizing for a luma component is derived (i) by multiplying a first offset by 2, the first offset being determined by a sum of the left offset and the right offset, or (ii) by multiplying a second offset by 2, the second offset being determined by a sum of the top offset and the bottom offset.

5 . A method of transmitting a bitstream performed by an encoding apparatus, comprising:

partitioning an image to obtain a partitioned image based on partitioning information that is encoded into the bitstream, the partitioning being performed using tree-based partitioning structures that include a quad-tree partitioning structure, a binary-tree partitioning structure, and a triple-tree partitioning structure;

encoding the partitioned image by performing inter prediction to generate the bitstream; and

transmitting the bitstream to a decoding apparatus,

wherein the encoding the partitioned image comprises:

encoding, into the bitstream, an offset for the image, the offset being encoded for a chroma component, and the offset comprising at least one of a left offset, a right offset, a top offset, or a bottom offset;

deriving a size variable for resizing the image based on the offset; and

performing the inter prediction based on the size variable,

wherein the offset is defined with a direction of resizing, and

wherein, in a case where a ratio of the luma component to the chroma component is 2 to 1, the size variable for resizing for a luma component is derived (i) by multiplying a first offset by 2, the first offset being determined by a sum of the left offset and the right offset, or (ii) by multiplying a second offset by 2, the second offset being determined by a sum of the top offset and the bottom offset.

Priority Claims (3)
KR 10-2016-0127893 · Oct 4, 2016 · national
KR 10-2016-0129391 · Oct 6, 2016 · national
KR 10-2017-0090621 · Jul 17, 2017 · national
Continuity (5)
Continuation 17211575 · Mar 24, 2021
Continuation 17085935 · Oct 30, 2020
Continuation 16372270 · Apr 1, 2019
Continuation PCTKR2017011149 · Oct 10, 2017
Related Publication 20220053128A1 · Feb 17, 2022
References Cited (131)
US 7623682B2 · Park et al. · 2009 [cited by applicant]
US 10009621B2 · Zhang et al. · 2018 [cited by applicant]
US 10104361B2 · Budagavi et al. · 2018 [cited by applicant]
US 20040081238A1 · Parhy · 2004 [cited by applicant]
US 20050276323A1 · Martemyanov · 2005 [cited by examiner]
US 20060034370A1 · Park et al. · 2006 [cited by applicant]
US 20060034374A1 · Park et al. · 2006 [cited by applicant]
US 20060034529A1 · Park et al. · 2006 [cited by applicant]
US 20060268991A1 · Segall et al. · 2006 [cited by applicant]
US 20070211797A1 · Kim et al. · 2007 [cited by applicant]
US 20080226123A1 · Birtwistle et al. · 2008 [cited by applicant]
US 20100086051A1 · Park et al. · 2010 [cited by applicant]
US 20100086052A1 · Park et al. · 2010 [cited by applicant]
US 20110134998A1 · Lee et al. · 2011 [cited by applicant]
US 20120082216A1 · Wang et al. · 2012 [cited by applicant]
US 20120114039A1 · Wang · 2012 [cited by applicant]
US 20120320970A1 · Drugeon et al. · 2012 [cited by applicant]
US 20130108182A1 · Yie et al. · 2013 [cited by applicant]
US 20130188704A1 · Zhou et al. · 2013 [cited by applicant]
US 20130315300A1 · Lee et al. · 2013 [cited by applicant]
US 20140168362A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20140254679A1 · Ramasubramonian et al. · 2014 [cited by applicant]
US 20140355666A1 · Zhang et al. · 2014 [cited by applicant]
US 20140376635A1 · Senoh et al. · 2014 [cited by applicant]
US 20150172688A1 · Maeda et al. · 2015 [cited by applicant]
US 20150201204A1 · Chen · 2015 [cited by examiner]
US 20150350659A1 · Auyeung et al. · 2015 [cited by applicant]
US 20160012855A1 · Krishnan · 2016 [cited by applicant]
US 20160057440A1 · Jeong et al. · 2016 [cited by applicant]
US 20160142697A1 · Budagavi et al. · 2016 [cited by applicant]
US 20160249056A1 · Tsukuba · 2016 [cited by examiner]
US 20160328824A1 · Kim et al. · 2016 [cited by applicant]
US 20170078665A1 · Zheng · 2017 [cited by applicant]
US 20170214937A1 · Lin et al. · 2017 [cited by applicant]
US 20180041764A1 · Lin et al. · 2018 [cited by applicant]
US 20190052859A1 · Budagavi et al. · 2019 [cited by applicant]
US 20190215532A1 · He et al. · 2019 [cited by applicant]
US 20190260990A1 · Lim et al. · 2019 [cited by applicant]
US 20240048765A1 · Kim · 2024 [cited by examiner]
CN 101002479A · 2007 [cited by applicant]
CN 101010960A · 2007 [cited by applicant]
CN 100544444 · 2009 [cited by applicant]
CN 104350745A · 2015 [cited by applicant]
CN 104885470A · 2015 [cited by applicant]
CN 104935945A · 2015 [cited by applicant]
CN 105247870 · 2016 [cited by applicant]
CN 105324984A · 2016 [cited by applicant]
CN 105392008A · 2016 [cited by applicant]
CN 105554506A · 2016 [cited by applicant]
EP 2991356A1 · 2016 [cited by applicant]
EP 3434018B1 · 2021 [cited by applicant]
JP 2012110054A · 2012 [cited by applicant]
JP 2013098711A · 2013 [cited by applicant]
JP 2013118424A · 2013 [cited by applicant]
JP 2013229674A · 2013 [cited by applicant]
JP 2014519764A · 2014 [cited by applicant]
JP 2014535221A · 2014 [cited by applicant]
JP 2015035641A · 2015 [cited by applicant]
JP 2015521442A · 2015 [cited by applicant]
JP 2016531467A · 2016 [cited by applicant]
JP 2017112639A · 2017 [cited by applicant]
JP 2019525563A · 2019 [cited by applicant]
JP 2019536314A · 2019 [cited by applicant]
JP 2022954A · 2022 [cited by applicant]
JP 7201776B2 · 2023 [cited by applicant]
JP 7224280B2 · 2023 [cited by applicant]
JP 202340182A · 2023 [cited by applicant]
JP 2023040179A · 2023 [cited by applicant]
JP 7269455B2 · 2023 [cited by applicant]
JP 7269456B2 · 2023 [cited by applicant]
JP 2023066544A · 2023 [cited by applicant]
JP 7353522B2 · 2023 [cited by applicant]
JP 2023181932A · 2023 [cited by applicant]
JP 2023181961A · 2023 [cited by applicant]
JP 2024026707A · 2024 [cited by applicant]
JP 202442822A · 2024 [cited by applicant]
JP 202442827A · 2024 [cited by applicant]
KR 1020060050350A · 2007 [cited by applicant]
KR 1020070103347A · 2007 [cited by applicant]
KR 1020140019221A · 2014 [cited by applicant]
KR 1020150068299A · 2015 [cited by applicant]
KR 1020150083444A · 2015 [cited by applicant]
KR 20150083444A · 2015 [cited by applicant]
KR 1020160032909A · 2016 [cited by applicant]
KR 1020160097182A · 2016 [cited by applicant]
WO 2013047805A1 · 2013 [cited by applicant]
WO WO2014005297A1 · 2014 [cited by applicant]
WO WO2014120369A1 · 2014 [cited by applicant]
WO WO2014203805A1 · 2014 [cited by applicant]
WO 2015100732A1 · 2015 [cited by applicant]
WO WO2015199478A1 · 2015 [cited by applicant]
WO WO2016026457A1 · 2016 [cited by applicant]
WO 2016053494A1 · 2016 [cited by applicant]
WO WO2016056822A1 · 2016 [cited by applicant]
WO WO2016090568A1 · 2016 [cited by applicant]
WO 2017123980A1 · 2017 [cited by applicant]
WO WO2017162912A1 · 2017 [cited by applicant]
WO WO2017165375A1 · 2017 [cited by applicant]
WO WO2017201408 · 2017 [cited by applicant]
WO WO2017211294A1 · 2017 [cited by applicant]
WO 2018009746A1 · 2018 [cited by applicant]
WO 2018066988A1 · 2018 [cited by applicant]
WO 2018066991A1 · 2018 [cited by applicant]
WO 2019026807A1 · 2019 [cited by applicant]
Kim, Jungsun, et al. “AHG4: Constraint for slice and tile”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11., 10th Meeting, Stockholm, SE, Jul. 11-30, 2012, (4 pages in Eng… [cited by applicant]
Madhukar Budagavi, et al. “Coding of Moving Pictures and Audio” [cited by applicant]
He, Yuwen, et al. “AHG8: Geometry padding for 360 video coding.” Document JVET-D0075. Oct. 2016. Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 pp. 1-10 (10 pages in English). [cited by applicant]
NPL reference: J. Boyce, et al. Draft high efficiency video coding (HEVC) version 2, combined format range extensions (RExt), scalability (SHVC), and multi-view (MV-HEVC) extensions. JCT-VC of ITU-T and ISO/IEC. JCTVC-R… [cited by applicant]
Xiang Li, Multi-Type-Tree, Joint Video Exploration Team (JVET), Document: JVET-D0117rl, Oct. 15-21, 2016, 3 pgs. [cited by applicant]
Jianle Chen, Algorithm Description of Joint Exploration Test Model 7 (JEM 7), Joint Video Exploration Team (JVET), Document: JVET-G1001-v1, Jul. 13-21, 2017, 48 pgs. [cited by applicant]
International Search Report, PCT/KR2017/011149, dated Feb. 6, 2018, 9 pgs. [cited by applicant]
Kim, Non-Final Office Action, U.S. Appl. No. 16/372,270, filed Mar. 6, 2020, 7 pgs. [cited by applicant]
Huang, Han, et al. “EE2. 1: Quadtree plus binary tree structure integration with JEM tools.” [cited by applicant]
Quadtree Based Nonsquare Block Structure for Inter Frame Coding in High Efficiency Video Coding, Yuan Yuan, et al. IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012. [cited by applicant]
Yuwen He, et al. “AHG8: Geometry padding for 360 video coding,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016. [cited by applicant]
Zhichu He et al., “AVS2-video coding standard—An application-oriented and high performance video coding standard,” IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Jul. 14, 2014. [cited by applicant]
Yoav Cohen, et al. “Hierarchical Coding of Binary Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-7, No. 3, May 1985. [cited by applicant]
Yuwen He, et al. “AHG8: Geometry padding for 360 video coding,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-D0075, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016. [cited by applicant]
Huang, H., et al. “EE2. 1: Quadtree plus binary tree structure integration with JEM tools: JVET-C0024_r1, Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO.” IEC JTC1/SC29/WG11 3rd Meeting: Geneva, CH, May 2… [cited by applicant]
Kawamura, Kei, et al. “Extended deblocking-filter process for large block boundary” JVET-C0049_r2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-J… [cited by applicant]
Zhao, Xin, et al. “Grouped signalling for transform in QTBT” JVET-C0054, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, (3 pages). [cited by applicant]
Le Léannec, F., et al. “Asymmetric Coding Units in QTBT” JVET-D0064, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, (10 pages). [cited by applicant]
Li, Xiang, et al. “Multi-Type-Tree” JVET-D0117r1, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, (3 pages). [cited by applicant]
Kim, Notification of the First Office Action, Chinese Application No. 201780073663.8, Jan. 25, 2021, 14pages. [cited by applicant]
Kim, Office Action, Korean Application No. 10-2020-7014807, Feb. 1, 2021, 4 pages. [cited by applicant]
Kim, Extended European Search Report, European Application No. 20209245.8, Feb. 12, 2021, 9 pages. [cited by applicant]
Joint Video Exploration Team (JVET), of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, EE 2.1: Quadtree Plus Binary Tree Structure Integration with JEM Tools, May 26-Jun. 1, 2016, 5 pages. [cited by applicant]
International Telecommunication Union, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Apr. 2013, 317 pages. [cited by applicant]
Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP3 and ISO/IEC JTC1/SC29/WG11, 10th Meeting: Stockholm, Sweden, AHG4: Enable Parallel Decoding with Tiles, Jul. 11-20, 2012, 7 pages. [cited by applicant]
Joint Video Exploration Team (JVET), of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, GoPro test sequences for Virtual Reality video coding, May 26-31, 2016, 10 pages. [cited by applicant]
Zhichu He, et al. “AVS2-video coding standard—An application-oriented and high performance video coding standard,” 2014 IEEE International Conference on Multimedia and Expo Workshop (ICMEW), Jul. 14-18, 2014. [cited by applicant]