IP Library › Granted Patent US 12,262,034
Granted Patent B2
US 12,262,034 · App. 18/492,046 · Granted Mar 25, 2025

Method for coding and decoding scalable video and apparatus using same

Inventors: Ha Hyun Lee (Seoul, KR); Jung Won Kang (Daejeon-si, KR); Jin Soo Choi (Daejeon-si, KR); Jin Woong Kim (Daejeon-si, KR); Dong Gyu Sim (Seoul, KR); Hyo Min Choi (Seoul, KR); Jung Hak Nam (Seoul, KR)
Assignees: Electronics and Telecommunications Research Institute; KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
H04N19/30H04N19/11H04N19/176H04N19/187H04N19/33H04N19/503H04N19/103H04N19/36H04N19/59
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,034
App. No.
18/492,046
Granted
Mar 25, 2025
Kind
B2
Abstract

The present invention relates to a method and an apparatus for interlayer prediction, and the method for interlayer prediction, according to the present invention, comprises the steps of: deciding whether to apply an interlayer prediction to an enhancement layer; and performing a prediction on a current block of the enhancement layer based on reference information that is generalized and generated from a reference picture, which is decoded, of a reference layer, when the interlayer prediction is applied, wherein the reference layer information can be encoding information of a reference block, which corresponds to a current block of the enhancement layer, from the reference layer, and residual information.

Claims (21)

1. A decoding method performed by a decoding apparatus comprising one or more processors and a memory, the method comprising:

determining whether to apply interlayer prediction to an enhancement layer;

constructing a reference picture list for a current block in the enhancement layer by including at least one of a reconstructed picture of the enhancement layer or a reconstructed picture of a reference layer or combination thereof, in response to a determination that the interlayer prediction is to be applied; and

performing prediction on the current block of the enhancement layer based on the reference picture list and motion information of the current block,

when the reconstructed picture of the reference layer is used for prediction of the current block, a generalized reference block is generated from the reconstructed picture of the reference layer and the generalized reference block is used for prediction of the current block,

wherein the generalized reference block is resampled using a filter determined in units of slices, and

wherein the generalized reference block is resampled based on a size of the reconstructed picture of the reference layer and a size of a current picture to which the current block of the enhancement layer belongs.

2. An encoding method performed by an encoding apparatus comprising one or more processors and a memory, the method comprising:

determining whether to apply interlayer prediction to an enhancement layer;

constructing a reference picture list for a current block in the enhancement layer by including at least one of a reconstructed picture of the enhancement layer or a reconstructed picture of a reference layer or combination thereof, in response to a determination that the interlayer prediction is to be applied; and

performing prediction on the current block of the enhancement layer based on the reference picture list and motion information of the current block,

when the reconstructed picture of the reference layer is used for prediction of the current block, a generalized reference block is generated from the reconstructed picture of the reference layer and the generalized reference block is used for prediction of the current block,

wherein the generalized reference block is resampled using a filter determined in units of slices, and

wherein the generalized reference block is resampled based on a size of the reconstructed picture of the reference layer and a size of a current picture to which the current block of the enhancement layer belongs.

3. A non-transitory computer-readable recording medium storing a bitstream that is generated by an encoding method, the method comprising:

determining whether to apply interlayer prediction to an enhancement layer;

constructing a reference picture list for a current block in the enhancement layer by including at least one of a reconstructed picture of the enhancement layer or a reconstructed picture of a reference layer or combination thereof, in response to a determination that the interlayer prediction is to be applied; and

performing prediction on the current block of the enhancement layer based on the reference picture list and motion information of the current block,

when the reconstructed picture of the reference layer is used for prediction of the current block, a generalized reference block is generated from the reconstructed picture of the reference layer and the generalized reference block is used for prediction of the current block,

wherein the generalized reference block is resampled using a filter determined in units of slices, and

wherein the generalized reference block is resampled based on a size of the reconstructed picture of the reference layer and a size of a current picture to which the current block of the enhancement layer belongs.

Priority Claims (2)
KR 10-2011-0057906 · Jun 15, 2011 · national
KR 10-2012-0064634 · Jun 15, 2012 · national
Continuity (6)
Continuation 17852523 · Jun 29, 2022
Continuation 17018245 · Sep 11, 2020
Continuation 16166712 · Oct 22, 2018
Continuation 15585687 · May 3, 2017
Continuation 14125840
Related Publication 20240056587A1 · Feb 15, 2024
References Cited (101)
US 8194735B2 · Matsumura et al. · 2012 [cited by applicant]
US 8249155B2 · Yatabe et al. · 2012 [cited by applicant]
US 8265152B2 · Anisimov · 2012 [cited by applicant]
US 8422555B2 · Wang et al. · 2013 [cited by applicant]
US 8634457B2 · Lee et al. · 2014 [cited by applicant]
US 8660176B2 · Lee et al. · 2014 [cited by applicant]
US 8700794B2 · Kim et al. · 2014 [cited by applicant]
US 8724697B2 · Lee et al. · 2014 [cited by applicant]
US 8923395B2 · Wang et al. · 2014 [cited by applicant]
US 8923407B2 · Sze et al. · 2014 [cited by applicant]
US 9113147B2 · Raveendran et al. · 2015 [cited by applicant]
US 9319729B2 · Sullivan · 2016 [cited by applicant]
US 9357212B2 · Zhang et al. · 2016 [cited by applicant]
US 9641866B2 · Chong et al. · 2017 [cited by applicant]
US 9674530B1 · Bultje et al. · 2017 [cited by applicant]
US 9906786B2 · Seregin et al. · 2018 [cited by applicant]
US 9948939B2 · Zhang et al. · 2018 [cited by applicant]
US 10021414B2 · Seregin et al. · 2018 [cited by applicant]
US 20040013195A1 · Panusopone et al. · 2004 [cited by applicant]
US 20060083308A1 · Schwarz et al. · 2006 [cited by applicant]
US 20060083309A1 · Schwarz et al. · 2006 [cited by applicant]
US 20060126962A1 · Sun · 2006 [cited by applicant]
US 20060153294A1 · Wang et al. · 2006 [cited by applicant]
US 20070074266A1 · Raveendran et al. · 2007 [cited by applicant]
US 20070086521A1 · Wang et al. · 2007 [cited by applicant]
US 20070140349A1 · Burazerovic · 2007 [cited by applicant]
US 20070160133A1 · Bao et al. · 2007 [cited by applicant]
US 20070230575A1 · Han · 2007 [cited by applicant]
US 20070263087A1 · Hong et al. · 2007 [cited by applicant]
US 20070286283A1 · Yin · 2007 [cited by examiner]
US 20070291842A1 · Au et al. · 2007 [cited by applicant]
US 20080013633A1 · Ye et al. · 2008 [cited by applicant]
US 20080069239A1 · Yan · 2008 [cited by examiner]
US 20080089417A1 · Bao et al. · 2008 [cited by applicant]
US 20090141814A1 · Yin et al. · 2009 [cited by applicant]
US 20090147848A1 · Park et al. · 2009 [cited by applicant]
US 20090175349A1 · Ye et al. · 2009 [cited by applicant]
US 20090187960A1 · Lee et al. · 2009 [cited by applicant]
US 20100030997A1 · Gupta et al. · 2010 [cited by applicant]
US 20100061447A1 · Tu et al. · 2010 [cited by applicant]
US 20100080284A1 · Lee et al. · 2010 [cited by applicant]
US 20100080285A1 · Lee et al. · 2010 [cited by applicant]
US 20100080296A1 · Lee et al. · 2010 [cited by applicant]
US 20100086049A1 · Ye et al. · 2010 [cited by applicant]
US 20100098156A1 · Karczewicz et al. · 2010 [cited by applicant]
US 20100111182A1 · Karczewicz et al. · 2010 [cited by applicant]
US 20100165077A1 · Yin · 2010 [cited by examiner]
US 20100309974A1 · Reznik · 2010 [cited by applicant]
US 20110038421A1 · Schwarz et al. · 2011 [cited by applicant]
US 20110110426A1 · Kim et al. · 2011 [cited by applicant]
US 20110134999A1 · Han et al. · 2011 [cited by applicant]
US 20110248873A1 · Karczewicz et al. · 2011 [cited by applicant]
US 20110317766A1 · Lim et al. · 2011 [cited by applicant]
US 20120044322A1 · Tian et al. · 2012 [cited by applicant]
US 20120189058A1 · Chen et al. · 2012 [cited by applicant]
US 20120236115A1 · Zhang et al. · 2012 [cited by applicant]
US 20130188717A1 · Chen et al. · 2013 [cited by applicant]
US 20130188719A1 · Chen et al. · 2013 [cited by applicant]
US 20130194386A1 · Leontaris et al. · 2013 [cited by applicant]
US 20130272372A1 · Hannuksela et al. · 2013 [cited by applicant]
US 20130279576A1 · Chen et al. · 2013 [cited by applicant]
US 20140044161A1 · Chen et al. · 2014 [cited by applicant]
US 20140064386A1 · Chen et al. · 2014 [cited by applicant]
US 20140192885A1 · Seregin et al. · 2014 [cited by applicant]
US 20140254666A1 · Rapaka et al. · 2014 [cited by applicant]
US 20140301463A1 · Rusanovskyy et al. · 2014 [cited by applicant]
US 20150304666A1 · Seregin · 2015 [cited by examiner]
US 20160156932A1 · Lee et al. · 2016 [cited by applicant]
US 20160261877A1 · Wang · 2016 [cited by applicant]
US 20160381385A1 · Ugur · 2016 [cited by applicant]
CN 101163241A · 2008 [cited by applicant]
CN 101198064A · 2008 [cited by applicant]
CN 101317459A · 2008 [cited by applicant]
CN 101416513A · 2009 [cited by applicant]
CN 101438596A · 2009 [cited by applicant]
CN 101771873A · 2010 [cited by applicant]
CN 101822060A · 2010 [cited by applicant]
CN 101873484A · 2010 [cited by applicant]
CN 101888555A · 2010 [cited by applicant]
CN 101888559A · 2010 [cited by applicant]
KR 1020070096884A · 2007 [cited by applicant]
KR 1020090016544A · 2009 [cited by applicant]
KR 1020110052203A · 2011 [cited by applicant]
WO WO2010027637A2 · 2010 [cited by applicant]
Choi, Hyomin, et al. “Scalable structures and inter-layer predictions for HEVC scalable extension.” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. 6th Meeting: Torino, It… [cited by applicant]
Extended European Search Report mailed Jan. 30, 2015 in counterpart European Application No. 12 80 1420.6 (9 pages in English). [cited by applicant]
International Search Report issued Dec. 21, 2012 in corresponding International Patent Application No. PCT/KR2012/004777 (3 pages, in Korean). [cited by applicant]
Reichel, Julien et al, “Joint Scalable Video Model JSVM-4,” Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), 17th Meeting: Nice, France, Oct. 2005, Document: JVT-Q202. XP0… [cited by applicant]
Chun-Su Park et al., “Selective Inter-layer Residual Prediction for SVC-based Video Streaming,” [cited by applicant]
Schwarz, Heiko, et al. “Constrained Inter-Layer Prediction for Single-Loop Decoding in Spatial Scalability,” [cited by applicant]
Segall, C. Andrew, et al. “Spatial scalability within the H. 264/AVC scalable video coding extension.” [cited by applicant]
Alfonso, D., et al., “Multiple Description for Robust Scalable Video Coding”, 2009 [cited by applicant]
Su Yang et al., “Multimedia Communication and Scalable Video Coding,” [cited by applicant]
Domanski, Marek et al., “Modified MPEG-2 Video Coders with Efficient Multi-Layer Scalability,” [cited by applicant]
Ohm, Jens-Rainer., “Advances in Scalable Video Coding.” Proceedings of the IEEE 93.1 (2005): 42-56. [cited by applicant]
Telecom, I. T. U. “Advanced video coding for generic audiovisual services.” [cited by applicant]
Domanski, Marek, et al. “Modified MPEG-2 video coders with efficient multi-layer scalability.” [cited by applicant]
Ohm, J-R. “Advances in scalable video coding.” Proceedings of the IEEE vol. 93 No. 1 (2005): (pp. 42-56) (15 pages in English). [cited by applicant]
Julien et al. “Joint Scalable Video Model JSVM-4. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q. 6).” 17th Meeting: Nice, France Oct. 2005. (pp. 1-41) (41 pages in English). [cited by applicant]
Choi, Hyomin, et al. “Scalable structures and inter-layer predictions for HEVC scalable extension.” Document of JCT-VC (JCTVC-F096) Jul. 2011 (pp. 1-11) (11 pages in English). [cited by applicant]
Schwarz, Heiko, et al. “Constrained inter-layer prediction for single-loop decoding in spatial scalability.” IEEE International Conference on Image Processing 2005. vol. 2. IEEE, 2005 (4 pages in English). [cited by applicant]