IP Library › Granted Patent US 12,262,122
Granted Patent B2
US 12,262,122 · App. 18/502,384 · Granted Mar 25, 2025

Image data encoding/decoding method and apparatus

Inventor: Ki Baek Kim (Daejeon, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N23/698G06T3/40H04N19/103H04N19/11H04N19/119H04N19/124H04N19/129H04N19/13H04N19/134H04N19/159H04N19/176H04N19/51H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,122
App. No.
18/502,384
Filed
Nov 6, 2023
Granted
Mar 25, 2025
Kind
B2
Art Unit
2488
USPC
375/240.024
Abstract

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

Claims (50)

1. A method of decoding an image with a decoding apparatus, comprising:

receiving a bitstream in which the image is encoded;

obtaining, from the bitstream, a single index information for specifying a block division type of a current block in the image;

determining, based on the single index information, the block division type of the current block from a candidate group pre-defined in the decoding apparatus,

wherein the candidate group includes a plurality of candidate division types,

wherein the plurality of candidate division types include at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division,

wherein the first quad-division is representative of dividing, based on one horizontal line and one vertical line, one coding block into four coding blocks, the second quad-division is representative of dividing, based on three horizontal lines or three vertical lines, one coding block into four coding blocks, the binary-division is representative of dividing one coding block into two coding blocks, and the triple-division is representative of dividing one coding block into three coding blocks,

wherein the binary-division includes a horizontal binary-division and a vertical binary-division, and

wherein the bitstream includes a first flag specifying whether to perform the horizontal binary-division and a second flag specifying whether to perform the vertical binary-division, the first flag being different from the second flag;

dividing, based on the determined block division type, the current block into a plurality of sub-blocks; and

decoding each of the sub-blocks with reference to syntax information obtained from the bitstream,

wherein the decoding each of the sub-blocks comprises generating a prediction block of each of the sub-blocks and generating a residual block of each of the sub-blocks.

2. The method of claim 1 ,

wherein the current block is set equal to a largest coding block or is set a block resulting from dividing the largest coding block,

wherein a size of the largest coding block is variably determined based on information on the largest coding block,

wherein the information on the largest coding block is signaled from the bitstream.

3. The method of claim 2 ,

wherein the size of the largest coding block is set equal to 128×128 or 64×64 according to the information on the largest coding block.

4. The method of claim 1 ,

wherein a number of the candidate division types available for the current block is different dependent on at least one of a size of the current block or a shape of the current block.

5. A method of encoding an image with an encoding apparatus, comprising:

determining a block division type of a current block in the image from a candidate group pre-defined in the encoding apparatus,

wherein the candidate group includes a plurality of candidate division types,

wherein the plurality of candidate division types include at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division,

wherein the first quad-division is representative of dividing, based on one horizontal line and one vertical line, one coding block into four coding blocks, the second quad-division is representative of dividing, based on three horizontal lines or three vertical lines, one coding block into four coding blocks, the binary-division is representative of dividing one coding block into two coding blocks, and the triple-division is representative of dividing one coding block into three coding blocks,

wherein the binary-division includes a horizontal binary-division and a vertical binary-division, and

wherein a first flag specifying whether to perform the horizontal binary-division and a second flag specifying whether to perform the vertical binary-division are encoded into the bitstream, the first flag being different from the second flag;

encoding single index information for specifying the determined block division type of the current block; and

encoding each of sub-blocks resulting from dividing the current block based on the determined block division type,

wherein the encoding each of the sub-blocks comprises generating a prediction block of each of the sub-blocks and generating a residual block of each of the sub-blocks.

6. A non-transitory computer-readable recording medium storing a bitstream that is generated by a method of encoding an image with an encoding apparatus, the method comprising:

determining a block division type of a current block in the image from a candidate group pre-defined in the encoding apparatus,

wherein the candidate group includes a plurality of candidate division types,

wherein the plurality of candidate division types include at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division,

wherein the first quad-division is representative of dividing, based on one horizontal line and one vertical line, one coding block into four coding blocks, the second quad-division is representative of dividing, based on three horizontal lines or three vertical lines, one coding block into four coding blocks, the binary-division is representative of dividing one coding block into two coding blocks, and the triple-division is representative of dividing one coding block into three coding blocks,

wherein the binary-division includes a horizontal binary-division and a vertical binary-division, and

wherein a first flag specifying whether to perform the horizontal binary-division and a second flag specifying whether to perform the vertical binary-division are encoded into the bitstream, the first flag being different from the second flag;

encoding single index information for specifying the determined block division type of the current block; and

encoding each of sub-blocks resulting from dividing the current block based on the determined block division type,

wherein the encoding each of the sub-blocks comprises generating a prediction block of each of the sub-blocks and generating a residual block of each of the sub-blocks.

7. A method of transmitting a bitstream that is generated by a method of encoding an image with an encoding apparatus, the method of encoding the image comprising:

determining a block division type of a current block in the image from a candidate group pre-defined in the encoding apparatus,

wherein the candidate group includes a plurality of candidate division types,

wherein the plurality of candidate division types include at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division,

wherein the first quad-division is representative of dividing, based on one horizontal line and one vertical line, one coding block into four coding blocks, the second quad-division is representative of dividing, based on three horizontal lines or three vertical lines, one coding block into four coding blocks, the binary-division is representative of dividing one coding block into two coding blocks, and the triple-division is representative of dividing one coding block into three coding blocks,

wherein the binary-division includes a horizontal binary-division and a vertical binary-division, and

wherein a first flag specifying whether to perform the horizontal binary-division and a second flag specifying whether to perform the vertical binary-division are encoded into the bitstream, the first flag being different from the second flag;

encoding single index information for specifying the determined block division type of the current block; and

encoding each of sub-blocks resulting from dividing the current block based on the determined block division type,

wherein the encoding each of the sub-blocks comprises generating a prediction block of each of the sub-blocks and generating a residual block of each of the sub-blocks.

Priority Claims (3)
KR 10-2016-0127893 · Oct 4, 2016 · national
KR 10-2016-0129391 · Oct 6, 2016 · national
KR 10-2017-0090621 · Jul 17, 2017 · national
Continuity (6)
Continuation 17512996 · Oct 28, 2021
Continuation 17211575 · Mar 24, 2021
Continuation 17085935 · Oct 30, 2020
Continuation 16372270 · Apr 1, 2019
Continuation PCTKR2017011149 · Oct 10, 2017
Related Publication 20240155243A1 · May 9, 2024
References Cited (109)
US 7623682B2 · Park et al. · 2009 [cited by applicant]
US 10009621B2 · Zhang et al. · 2018 [cited by applicant]
US 10104361B2 · Budagavi et al. · 2018 [cited by applicant]
US 20060034370A1 · Park et al. · 2006 [cited by applicant]
US 20060034374A1 · Park et al. · 2006 [cited by applicant]
US 20060034529A1 · Park et al. · 2006 [cited by applicant]
US 20060268991A1 · Segall et al. · 2006 [cited by applicant]
US 20070211797A1 · Kim et al. · 2007 [cited by applicant]
US 20080226123A1 · Birtwistle et al. · 2008 [cited by applicant]
US 20100086051A1 · Park et al. · 2010 [cited by applicant]
US 20100086052A1 · Park et al. · 2010 [cited by applicant]
US 20110134998A1 · Lee et al. · 2011 [cited by applicant]
US 20120082216A1 · Wang et al. · 2012 [cited by applicant]
US 20120114039A1 · Wang · 2012 [cited by applicant]
US 20120170648A1 · Chen · 2012 [cited by examiner]
US 20120320970A1 · Drugeon et al. · 2012 [cited by applicant]
US 20140168362A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20140254679A1 · Ramasubramonian et al. · 2014 [cited by applicant]
US 20140355666A1 · Zhang et al. · 2014 [cited by applicant]
US 20140376635A1 · Park et al. · 2014 [cited by applicant]
US 20150172688A1 · Maeda et al. · 2015 [cited by applicant]
US 20150201204A1 · Chen et al. · 2015 [cited by applicant]
US 20150312588A1 · Yamamoto · 2015 [cited by examiner]
US 20150350659A1 · Auyeung et al. · 2015 [cited by applicant]
US 20160012855A1 · Krishnan · 2016 [cited by applicant]
US 20160057433A1 · Kudo · 2016 [cited by examiner]
US 20160057440A1 · Jeong et al. · 2016 [cited by applicant]
US 20160142697A1 · Budagavi et al. · 2016 [cited by applicant]
US 20160249056A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20160328824A1 · Kim et al. · 2016 [cited by applicant]
US 20170078665A1 · Zheng · 2017 [cited by applicant]
US 20170150186A1 · Zhang · 2017 [cited by examiner]
US 20170208336A1 · Li · 2017 [cited by examiner]
US 20170214937A1 · Lin et al. · 2017 [cited by applicant]
US 20180041764A1 · Lin et al. · 2018 [cited by applicant]
US 20180070110A1 · Chuang · 2018 [cited by examiner]
US 20190052859A1 · Budagavi et al. · 2019 [cited by applicant]
US 20190215532A1 · He et al. · 2019 [cited by applicant]
US 20190260990A1 · Lim et al. · 2019 [cited by applicant]
CN 101002479A · 2007 [cited by applicant]
CN 101010960A · 2007 [cited by applicant]
CN 104350745A · 2015 [cited by applicant]
CN 104885470A · 2015 [cited by applicant]
CN 104935945A · 2015 [cited by applicant]
CN 105324984A · 2016 [cited by applicant]
CN 105392008A · 2016 [cited by applicant]
CN 105554506A · 2016 [cited by applicant]
EP 3434018B1 · 2021 [cited by applicant]
JP 2012110054A · 2012 [cited by applicant]
JP 2013098711A · 2013 [cited by applicant]
JP 2013229674A · 2013 [cited by applicant]
JP 2014519764A · 2014 [cited by applicant]
JP 2015521442A · 2015 [cited by applicant]
JP 2016531467A · 2016 [cited by applicant]
JP 2017112639A · 2017 [cited by applicant]
JP 2019525563A · 2019 [cited by applicant]
JP 2019536314A · 2019 [cited by applicant]
JP 7201776B2 · 2023 [cited by applicant]
JP 7224280B2 · 2023 [cited by applicant]
JP 202340182A · 2023 [cited by applicant]
JP 2023040179A · 2023 [cited by applicant]
JP 7269455B2 · 2023 [cited by applicant]
JP 7269456B2 · 2023 [cited by applicant]
JP 2023066544A · 2023 [cited by applicant]
JP 7353522B2 · 2023 [cited by applicant]
JP 2023181932A · 2023 [cited by applicant]
JP 2024026707A · 2024 [cited by applicant]
JP 202442822A · 2024 [cited by applicant]
JP 202442827A · 2024 [cited by applicant]
KR 1020060050350A · 2007 [cited by applicant]
KR 1020070103347A · 2007 [cited by applicant]
KR 1020140019221A · 2014 [cited by applicant]
KR 1020150068299A · 2015 [cited by applicant]
KR 1020150083444A · 2015 [cited by applicant]
KR 1020160032909A · 2016 [cited by applicant]
KR 1020160097182A · 2016 [cited by applicant]
WO 2013047805A1 · 2013 [cited by applicant]
WO WO2014005297A1 · 2014 [cited by applicant]
WO WO2014120369A1 · 2014 [cited by applicant]
WO 2014203805A1 · 2014 [cited by applicant]
WO WO2015199478A1 · 2015 [cited by applicant]
WO WO2016026457A1 · 2016 [cited by applicant]
WO WO2016056822A1 · 2016 [cited by applicant]
WO 2016090568A1 · 2016 [cited by applicant]
WO WO2017123980A1 · 2017 [cited by applicant]
WO 2017165375A1 · 2017 [cited by applicant]
WO WO2017162912A1 · 2017 [cited by applicant]
WO WO2017211294A1 · 2017 [cited by applicant]
WO 2018009746A1 · 2018 [cited by applicant]
WO 2018066988A1 · 2018 [cited by applicant]
WO WO2018066991A1 · 2018 [cited by applicant]
WO WO2019026807A1 · 2019 [cited by applicant]
Kim et al. “AHG4: Constraint for slice and tile”, [cited by applicant]
Boyce et al. “Draft high efficiency video coding (HEVC) version 2, combined format range extensions (RExt), scalability (SHVC), and multi-view (MV-HEVC) extensions.” [cited by applicant]
Huang et al. “EE2. 1: Quadtree plus binary tree structure integration with JEM tools.” [cited by applicant]
Huang, H., et al. “EE2. 1: Quadtree plus binary tree structure integration with JEM tools: JVET-C0024_r1, Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO.” IEC JTC1/SC29/WG11 3rd Meeting: Geneva, CH, May 2… [cited by applicant]
Kawamura, Kei, et al. “Extended deblocking-filter process for large block boundary” JVET-C0049_r2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-J… [cited by applicant]
Zhao, Xin, et al. “Grouped signalling for transform in QTBT” JVET-C0054, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, (3 pages). [cited by applicant]
Li et al. “Multi-Type-Tree” [cited by applicant]
Le Léannec, F., et al. “Asymmetric Coding Units in QTBT” JVET-D0064, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, (10 pages). [cited by applicant]
Li, Xiang, et al. “Multi-Type-Tree” JVET-D0117r1, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, (3 pages). [cited by applicant]
Budagava et al. “OMAF: Metadata for guard margin at polygon boundaries in 360 degrees video to prevent boundary artifacts” [cited by applicant]
He et al. “AHG8: Geometry padding for 360 video coding.” [cited by applicant]
Chen et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”, [cited by applicant]
International Search Report issued on Feb. 6, 2018 in counterpart Korean Patent Application PCT/KR2017/011149 (9 Pages). [cited by applicant]
Non-Final Office Action issued on Mar. 6, 2020 in counterpart U.S. Appl. No. 16/372,270 (7 pages). [cited by applicant]
Quadtree Based Nonsquare Block Structure for Inter Frame Coding in High Efficiency Video Coding, Yuan Yuan, et al. IEEE Transactions On Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012. [cited by applicant]
Yoav Cohen, et al. “Hierarchical Coding of Binary Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-7, No. 3, May 1985. [cited by applicant]
Yuwen He, et al., “AHG8: Geometry padding for 360 video coding”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting, Chengdu, CN, Oct. 15-21, 2016. [cited by applicant]