IP Library › Granted Patent US 12,267,510
Granted Patent B2
US 12,267,510 · App. 18/417,415 · Granted Apr 1, 2025

Image information decoding method, image decoding method, and device using same

Inventors: Jung Won Kang (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Jin Soo Choi (Daejeon, KR); Jin Woong Kim (Daejeon, KR)
Assignee: Electronics and Telecommunications Research Institute
H04N19/187H04N19/124H04N19/13H04N19/182H04N19/188H04N19/30H04N19/31H04N19/46H04N19/52H04N19/593H04N19/61H04N19/70H04N19/80H04N19/91H04N19/33H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,510
App. No.
18/417,415
Granted
Apr 1, 2025
Kind
B2
Abstract

The present invention relates to an image information decoding method. The decoding method includes receiving a bit stream including a Network Abstraction Layer (NAL) unit that includes information related to encoded image, and parsing a NAL unit header of the NAL unit. The NAL unit header may not include 1 bit flag information that represents whether a picture is a non-reference picture or a reference picture in the entire bit stream during encoding.

Claims (28)

1. A video decoding apparatus, comprising:

a parsing module configured to:

parse a slice header of a second picture that is a next picture of a decoded first picture; wherein the slice header of the second picture includes reference picture information indicating whether the decoded first picture is a reference picture,

mark the decoded first picture as a reference picture in a Decoded Picture Buffer (DPB),

determine whether the decoded first picture is a non-reference picture based on the reference picture information included in the slice header of the second picture,

mark the decoded first picture marked as a reference picture as a non-reference picture when the decoded first picture is a non-reference picture, and

parse a transmission unit header of a transmission unit for the first picture,

wherein the transmission unit header does not comprise flag information indicating whether the transmission unit for the first picture is a non-reference picture or a reference picture, and

wherein the transmission unit header comprises type information of the transmission unit.

2. A video encoding apparatus, comprising:

an encoding module configured to:

encode a first picture, a slice header of a second picture that is a next picture of the first picture, and a transmission unit header of a transmission unit for the first picture, and

generate a bitstream that includes the encoded first picture and the encoded slice header,

wherein the slice header of the second picture includes reference picture information indicating whether the first picture is a reference picture,

wherein the first picture is marked as a reference picture,

wherein the reference picture information included in the slice header of the second picture is encoded based on whether the first picture marked as a reference picture is a reference picture or a non-reference picture, and

wherein the first picture marked as a reference picture is marked as a non-reference picture when the reference picture information indicates that the first picture is a non-reference picture;

wherein the transmission unit header does not comprise flag information indicating whether the transmission unit for the first picture is a non-reference picture or a reference picture, and

wherein the transmission unit header comprises type information of the transmission unit.

3. A method for transmitting a bitstream that is encoded by a video encoding method, the encoding method comprising:

encoding a first picture, a slice header of a second picture that is a next picture of the first picture, and a transmission unit header of a transmission unit for the first picture, and

generating a bitstream that includes the encoded first picture and the encoded slice header,

wherein the slice header of the second picture includes reference picture information indicating whether the first picture is a reference picture,

wherein the first picture is marked as a reference picture,

wherein the reference picture information included in the slice header of the second picture is encoded based on whether the first picture marked as a reference picture is a reference picture or a non-reference picture,

wherein the first picture marked as a reference picture is marked as a non-reference picture when the reference picture information indicates that the first picture is a non-reference picture,

wherein the transmission unit header does not comprise flag information indicating whether the transmission unit for the first picture is a non-reference picture or a reference picture, and

wherein the transmission unit header comprises type information of the transmission unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2024
From: KANG, JUNG WON; LEE, HA HYUN; CHOI, JIN SOO; KIM, JIN WOONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 066183/0476 →
Priority Claims (8)
KR 10-2012-0038870 · Apr 16, 2012 · national
KR 10-2012-0066606 · Jun 21, 2012 · national
KR 10-2012-0067925 · Jun 25, 2012 · national
KR 10-2012-0071933 · Jul 2, 2012 · national
KR 10-2012-0077012 · Jul 16, 2012 · national
KR 10-2012-0108925 · Sep 28, 2012 · national
KR 10-2012-0112598 · Oct 10, 2012 · national
KR 10-2013-0041862 · Apr 16, 2013 · national
Continuity (5)
Continuation 17950248 · Sep 22, 2022
Continuation 17144409 · Jan 8, 2021
Continuation 16784714 · Feb 7, 2020
Continuation 14391061
Related Publication 20240155140A1 · May 9, 2024
References Cited (169)
US 7415069B2 · Wiger · 2008 [cited by applicant]
US 8711931B2 · Tanaka et al. · 2014 [cited by applicant]
US 8855200B2 · Koo et al. · 2014 [cited by applicant]
US 9131245B2 · Chen et al. · 2015 [cited by applicant]
US 9179157B2 · Zhu et al. · 2015 [cited by applicant]
US 9332254B2 · Wang et al. · 2016 [cited by applicant]
US 10595026B2 · Kang et al. · 2020 [cited by applicant]
US 10602160B2 · Kang · 2020 [cited by examiner]
US 10958918B2 · Kang et al. · 2021 [cited by applicant]
US 10958919B2 · Kang · 2021 [cited by examiner]
US 11483578B2 · Kang · 2022 [cited by examiner]
US 11490100B2 · Kang et al. · 2022 [cited by applicant]
US 12028538B2 · Kang · 2024 [cited by examiner]
US 20010001614A1 · Boice et al. · 2001 [cited by applicant]
US 20030231769A1 · Bolle et al. · 2003 [cited by applicant]
US 20060165182A1 · Kukuchi · 2006 [cited by applicant]
US 20060188225A1 · Yamakage et al. · 2006 [cited by applicant]
US 20070086516A1 · Lee et al. · 2007 [cited by applicant]
US 20070086521A1 · Wang et al. · 2007 [cited by applicant]
US 20090097573A1 · Choi et al. · 2009 [cited by applicant]
US 20090175353A1 · Suh et al. · 2009 [cited by applicant]
US 20100098157A1 · Yang · 2010 [cited by applicant]
US 20100129052A1 · Fujinami et al. · 2010 [cited by applicant]
US 20100142613A1 · Zhu · 2010 [cited by applicant]
US 20100158116A1 · Jeon et al. · 2010 [cited by applicant]
US 20100158133A1 · Mn et al. · 2010 [cited by applicant]
US 20100208735A1 · Wiegand · 2010 [cited by applicant]
US 20100226227A1 · Yu et al. · 2010 [cited by applicant]
US 20110064146A1 · Chen et al. · 2011 [cited by applicant]
US 20110082945A1 · Myers et al. · 2011 [cited by applicant]
US 20120013746A1 · Chen et al. · 2012 [cited by applicant]
US 20120183077A1 · Hong et al. · 2012 [cited by applicant]
US 20120230409A1 · Chen et al. · 2012 [cited by applicant]
US 20120230431A1 · Boyce et al. · 2012 [cited by applicant]
US 20130114743A1 · Sjoberg et al. · 2013 [cited by applicant]
US 20130136176A1 · Chen et al. · 2013 [cited by applicant]
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20130215975A1 · Samuelsson et al. · 2013 [cited by applicant]
CN 1666195A · 2005 [cited by applicant]
CN 101120593A · 2008 [cited by applicant]
CN 101180883A · 2008 [cited by applicant]
CN 101218828A · 2008 [cited by applicant]
CN 101292538A · 2008 [cited by applicant]
CN 101317459A · 2008 [cited by applicant]
CN 101390400A · 2009 [cited by applicant]
CN 101401433A · 2009 [cited by applicant]
CN 101444102A · 2009 [cited by applicant]
CN 101449585A · 2009 [cited by applicant]
CN 101455084A · 2009 [cited by applicant]
CN 101485208A · 2009 [cited by applicant]
CN 101536533A · 2009 [cited by applicant]
CN 101569197A · 2009 [cited by applicant]
CN 101578867A · 2009 [cited by applicant]
CN 101641954A · 2010 [cited by applicant]
CN 101653002A · 2010 [cited by applicant]
CN 101658038A · 2010 [cited by applicant]
CN 101841708A · 2010 [cited by applicant]
CN 101889448A · 2010 [cited by applicant]
CN 102065319A · 2011 [cited by applicant]
EP 1578136A2 · 2005 [cited by applicant]
EP 1773063A1 · 2007 [cited by applicant]
EP 2200295A1 · 2010 [cited by applicant]
EP 3086556A1 · 2016 [cited by applicant]
EP 2984833B1 · 2020 [cited by applicant]
JP 2007208917A · 2007 [cited by applicant]
JP 2010516085A · 2010 [cited by applicant]
JP 2014530571A · 2014 [cited by applicant]
JP 2016146636A · 2016 [cited by applicant]
JP 2016174384A · 2016 [cited by applicant]
JP 2016174385A · 2016 [cited by applicant]
JP 6186026B2 · 2017 [cited by applicant]
JP 2018152864A · 2018 [cited by applicant]
JP 2018152865A · 2018 [cited by applicant]
JP 2018152866A · 2018 [cited by applicant]
JP 2018152867A · 2018 [cited by applicant]
JP 2018152868A · 2018 [cited by applicant]
JP 2018152873A · 2018 [cited by applicant]
JP 2018152874A · 2018 [cited by applicant]
JP 6553245B2 · 2019 [cited by applicant]
JP 6556903B2 · 2019 [cited by applicant]
KR 1020060068254 · 2006 [cited by applicant]
KR 100596706B1 · 2006 [cited by applicant]
KR 1020060122664 · 2006 [cited by applicant]
KR 1020070074503 · 2007 [cited by applicant]
KR 100763196B1 · 2007 [cited by applicant]
KR 1020080007086 · 2008 [cited by applicant]
KR 1020080066784 · 2008 [cited by applicant]
KR 1020090021136 · 2009 [cited by applicant]
KR 1020090037689A · 2009 [cited by applicant]
KR 1020090045323A · 2009 [cited by applicant]
KR 1020090079932A · 2009 [cited by applicant]
KR 1020110019955A · 2011 [cited by applicant]
KR 102011033240A · 2011 [cited by applicant]
KR 1020120015260A · 2012 [cited by applicant]
WO 2005055608A1 · 2005 [cited by applicant]
WO 2006080561A2 · 2006 [cited by applicant]
WO 2006126841A1 · 2006 [cited by applicant]
WO 2006134110A1 · 2006 [cited by applicant]
WO 2007042914A1 · 2007 [cited by applicant]
WO 2007046633A1 · 2007 [cited by applicant]
WO 2007081150A1 · 2007 [cited by applicant]
WO 2008042259A2 · 2008 [cited by applicant]
WO 2008047303A3 · 2008 [cited by applicant]
WO 2008085013A1 · 2008 [cited by applicant]
WO 2008105389A1 · 2008 [cited by applicant]
WO 2010011295A1 · 2010 [cited by applicant]
WO 2011052215A1 · 2011 [cited by applicant]
WO 2012122176A1 · 2012 [cited by applicant]
WO 2013043887 · 2013 [cited by applicant]
WO 2013043913A1 · 2013 [cited by applicant]
WO 2013082517A1 · 2013 [cited by applicant]
WO 2013106705A2 · 2013 [cited by applicant]
WO 2013153227A2 · 2013 [cited by applicant]
WO 2014046812A2 · 2014 [cited by applicant]
WO 2014046813A2 · 2014 [cited by applicant]
WO 2014098703A1 · 2014 [cited by applicant]
WO 2014162739A1 · 2014 [cited by applicant]
Ying Chen and Ye-Kui Wang, “AHG10: High-level syntax hook for HEVC multi-standard extensions,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: Stockholm… [cited by applicant]
Amon, Peter, et al. “File Format For Scalable Video Coding.” IEEE Transactions on Circuits and Systems for Video Technology 17.9 (2007): 1174-1185. (12 pages, in English). [cited by applicant]
Argyriou et al. “Streaming H. 264/AVC video over the internet.” Consumer Communications and Networking Conference, 2004. CCNC 2004. First IEEE. IEEE, 2004. [cited by applicant]
Boyce et al. “High level syntax hooks for future extensions.” Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC-H0388, 8th Meeting: San Jose, CA, USA. 2012. [cited by applicant]
Bross, Benjamin et al., “High efficiency video coding (HEVC) text specification draft 6”, Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG16 WP3 and /SOI/Ec JTC11SC29/WG11, 8th Meeting: San Jose, California… [cited by applicant]
Chen et al., “AHG10: Video parameter set HEVC base specification,” Joint Collaborative Team on Video Coding (JCT-CV) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 10th Meeting: Stockholm, SE, Jul. 11-20, 2012. [cited by applicant]
Chinese Patent Office Action for Application No. 201810384112.X dated May 28, 2020 (9 pages). [cited by applicant]
Chinese Patent Office Action for Application No. 201810384114.9 dated May 25, 2020 (10 pages). [cited by applicant]
Chinese Patent Office Action for Application No. 201810384281.3 dated Jun. 3, 2020 (11 pages). [cited by applicant]
Chinese Patent Office Action for Application No. 201810384705.6 dated Jun. 22, 2020 (11 pages). [cited by applicant]
English Language Translation of KR20120038870, filed Apr. 16, 2012. [cited by applicant]
English Language Translation of KR20120066606, filed Jun. 21, 2012. [cited by applicant]
English Language Translation of KR20120067925, filed Jun. 25, 2012. [cited by applicant]
English Language Translation of KR20120071933, filed Jul. 2, 2012. [cited by applicant]
English Language Translation of KR20120077012, filed Jul. 16, 2012. [cited by applicant]
English Language Translation of KR20120108925, filed Sep. 28, 2012. [cited by applicant]
English Language Translation of KR20120112598, filed Oct. 10, 2012. [cited by applicant]
Feng et al. “A scalable video codec for layered video streaming.” Real-Time Imaging 10.5, 2004. [cited by applicant]
Hannuksela et al., “Hook for scalable extensions: video parameter set,” JCTVC-10524, Joint Collaborative Team on Video Coding (JCT-CV) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 9th Meeting: Geneva, CH, 27 Apr. … [cited by applicant]
Hannuksela et al., “Indication of the temporal structure of coded video sequences,” JCTVC-H0423r3, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 8th Meeting: San José, CA… [cited by applicant]
International Search Report issued on Jul. 31, 2013 in counterpart International Application No. PCT/KR2013/003204 (3 pages in English, 4 pages in Korean). [cited by applicant]
International Search Report issued on Jul. 31, 2013 in counterpart International Application No. PCT/KR2013/003206. (7 pages in English, 8 pages, in Korean). [cited by applicant]
Japanese Patent Office Action for Application No. 2019-122109 dated Jun. 9, 2020 (4 pages). [cited by applicant]
Jill Boyce et al., “Information for scalable extension high layer syntax,” Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting: San Jose, CA, USA, Feb. 2012, Docum… [cited by applicant]
Jill Boyce et al., “Parameter Sets Modifications for Temporal Scalability and Extension Hooks”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 9th Meeting: Geneva, C… [cited by applicant]
Jill Boyce et al., “SEI message for sub-bitstream profile & level indicators,” Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11, 9th Meeting: Geneva, CH, Apr. 2012, Do… [cited by applicant]
Jung Won Kang et al., “On NAL unit header,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 9th Meeting: Geneva, CH, Apr. 2012, JCTVC-10251, pp. -3. [cited by applicant]
Jung Won Kang et al., “Simple NAL Unit Header for HEVC, ”(JCTVC-H0410), JCT-VC of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29/WG11, 8th Meeting: San Jose, USA, Feb. 1-10, 2012 (5 pages, in English). [cited by applicant]
Korean Office Action issued Dec. 2, 2014 in counterpart Korean Patent Application No. 10-2014-0054445 (6 pages, in Korean). [cited by applicant]
Miska M. Hannuksela et al., “H.264/AVC Video for Wireless Transmission”, IEEE Wireless Communications, IEEE Service Center, Piscataway, NJ, US, vol. 12, No. 4, Aug. 1, 2005 (Aug. 1, 2005), pp. 6-13, XP011137994, ISSN: 1… [cited by applicant]
Miska M. Hannuksela, et al., “Indication of the temporal structure of coded video sequences,” Proceedings of the 8th Meeting of the Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG 16 WP3 and ISO/IEC JTCI/S… [cited by applicant]
Schwarz et al. “Overview of the scalable video coding extension of the H. 264/AVC standard.” Circuits and Systems for Video Technology, IEEE Transactions on 17.9, 2007. [cited by applicant]
Segall, “On the requirements for bit-depth and chroma format scalability,” 26. JVT Meeting; 83. MPEG Meeting; Jan. 13-Jan. 18, 2008; Antalya, (Joint Video Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVT-Z036, … [cited by applicant]
Sjoberg et al. “Overview of HEVC high-level syntax and reference picture management.” Circuits and Systems for Video Technology, IEEE Transactions on 22.12, 2012. [cited by applicant]
Skupin et al., “Generic HEVC high level syntax for scalability and adaptation,” JCTVC-10217, Joint Collaborative Team on Video Coding (JCT-CV) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 9th Meeting: Geneva, CH, A… [cited by applicant]
Specification from U.S. Appl. No. 61/507,388, filed Jul. 13, 2011. [cited by applicant]
TK TAN and Junya Takiue, “On nal_ref_flag,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: Stockholm, SE, Jul. 2012, JCTVC-J0231r1, pp. 1-3. [cited by applicant]
Truong Cong Thang et al., “AHG 9 / AHG 10:On NAL unit header,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: Stockholm, SE, Jul. 2012, JCTVC-J0174, pp… [cited by applicant]
Truong Cong Thang et al., “High level syntax for future scalable extension”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11, 9th Meeting: Geneva, CH, Apr. 27-May 7, … [cited by applicant]
Truong Cong Thang et al., “High-Level Syntax Modifications to Support Extractor Operation”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 9th Meeting: Geneva, CH, A… [cited by applicant]
Truong Cong Thang et al., “Signaling of VPS Activation”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: Stockholm, SE, Jul. 11-20, 2012, XP002722600 (D… [cited by applicant]
Truong Cong Thang et al., “Signaling of VPS Activation”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: Stockholm, SE, Jul. 11-20, 2012, XP030112623 (D… [cited by applicant]
Truong et al., “On NAL Unit Header,” (JCTVC-10251 ), JCT-VC of ITU-T SG16 WP3 and ISO/IEC JTC 1/SC 29/ WG11 9th Meeting: Geneva, CH, (Apr. 27-May 7, 2012), (3 pages, in English). [cited by applicant]
Wang et al. “System and transport interface of SVC.” Circuits and Systems for Video Technology, IEEE Transactions on 17.9, 2007. [cited by applicant]
Wang et al., “AHG12: Video parameter set and its use in 3D-HEVC,” Joint Collaborative Team on Video Coding (JCT-CV) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 9th Meeting: Geneva, CH, Apr. 27-May 7, 2012. [cited by applicant]
Wang et al., “MV-HEVC/SHVC HLS: On VPS and SPS in HEVC 3DV and scalable extensions,” Joint Collaborative Team on Video Coding (JCT-CV) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 4th Meeting: Incheon, KR, Apr. 20-26, 2… [cited by applicant]
Wang et al., “MV-HEVC/SHVC HLS: VPS and SPS designs in HEVC 3DV and scalable extensions,” 4.JCT-3V Meeting; Apr. 20-Apr. 26, 2013; Incheon; (The Joint Collaborative Team on 30 Video Coding Extension Development of ISO/I… [cited by applicant]
Wiegand et al. “WD3: Working draft 3 of high-efficiency video coding.” JCT-VC 5th Meeting, JCTVC-E603. 2011. [cited by applicant]
Ye-Kui Wang and Ying Chen, “High-level syntax hook for HEVC multi-standard extensions,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 9th Meeting: Geneva, CH, Apr. … [cited by applicant]
Ye-Kui Wang and Zhenyu Wu, “On NAL unit header,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC, JTC1/SC29/WG11, 4th Meeting: Daegu, KR, Jan. 2011, JCTVC-D080, pp. 1-3. [cited by applicant]
Ye-Kui Wang, “AHG9: High-Level Syntax Clean-Ups”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Shanghai, CN, Oct. 10-19, 2012, XP030113002 (Document:… [cited by applicant]
Japanese Patent Office Action for Application No. 2024-015010 dated Sep. 30, 2024 (7 pages with translation). [cited by applicant]