IP Library › Granted Patent US 12,581,060
Granted Patent B2
US 12,581,060 · App. 18/591,673 · Granted Mar 17, 2026

Reference picture management in video coding

Inventors: Fnu Hendry (San Diego, CA); Ye-Kui Wang (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/105A61C7/002A61C7/02A61C7/08B29C51/30B29C51/46H04N19/159H04N19/174H04N19/176H04N19/44H04N19/46H04N19/58H04N19/70H04N21/44004B29L2031/753G06T1/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,581,060
App. No.
18/591,673
Granted
Mar 17, 2026
Kind
B2
Abstract

A method of decoding a coded video bitstream. The method includes obtaining a first reference picture list of a current slice represented in the coded video bitstream and a second reference picture list of the current slice, and marking a status of a reference picture in a decoded picture buffer (DPB) based on the first reference picture list and the second reference picture list when the current slice is a first slice in a current picture to which the current slice belongs. The status of the reference picture in the decoded picture buffer is used for short-term reference, used for long-term reference, or unused for reference. The method also includes using the reference picture in a reconstructing process of the current picture or a picture following the current picture when the status of the reference picture is used for short-term reference or used for long-term reference.

Claims (24)

1 . A non-transitory computer-readable medium storing a bitstream and one or more instructions executable by at least one processor to perform operations of encoding or decoding of the bitstream, the operations comprising:

obtaining a first reference picture list of a current slice and a second reference picture list of the current slice;

marking a status of a reference picture in a decoded picture buffer (DPB) based on the first reference picture list and the second reference picture list when the current slice is a first slice in a current picture to which the current slice belongs, wherein the status of the reference picture in the decoded picture buffer is used for short-term reference, used for long-term reference, or unused for reference; and

using the reference picture in a reconstructing process of the current picture when the status of the reference picture is used for short-term reference or used for long-term reference,

wherein a long-term reference picture (LTRP) is identified by a logarithmic function of maximum long-term picture order count least significant bits of a picture order count value, and wherein the current picture is inter predicted.

2 . The non-transitory computer-readable medium of claim 1 , wherein the current picture comprises an inter predicted picture.

3 . The non-transitory computer-readable medium of claim 1 , further comprising deriving the picture order count value by adding picture order count most significant bits (PicOrderCntMsb) and slice picture order count least significant bits (slice_pic_order_cnt_lsb).

4 . The non-transitory computer-readable medium of claim 1 , wherein the DPB contains a plurality of reference pictures in addition to a picture following the current picture after decoding of the current picture.

5 . A non-transitory computer-readable medium storing a bitstream and one or more instructions executable by at least one processor to perform operations of encoding or decoding of the bitstream, the operations comprising:

decoding a previous picture including all slices thereof to obtain a previous decoded picture;

storing the previous decoded picture in a decoded picture buffer (DPB) after the decoding;

marking the previous decoded picture as used for short-term reference after all the slices of the previous decoded picture have been decoded; and

decoding a first slice of a current picture, the decoding of the first slice of the current picture comprising:

obtaining a first reference picture list of the first slice and a second reference picture list of the first slice;

re-marking the previous decoded picture as used for long-term reference when the previous decoded picture is referred to by a long-term reference picture (LTRP) entry in the first reference picture list or the second reference picture list; and

re-marking the previous decoded picture as unused for reference when the previous decoded picture is not referred to in the first reference picture list or the second reference picture list,

wherein a LTRP is identified by a logarithmic function of maximum long-term picture order count least significant bits of a picture order count value, and

wherein the current picture is inter predicted.

6 . The non-transitory computer-readable medium of claim 5 , wherein the current picture comprises an inter predicted picture.

7 . The non-transitory computer-readable medium of claim 5 , wherein the previous decoded picture is referred to as a short-term reference picture (STRP) when marked as used for short-term reference, and wherein the STRP is identified by the picture order count value (PicOrderCntVal).

8 . The non-transitory computer-readable medium of claim 5 , further comprising deriving the picture order count value by adding picture order count most significant bits (PicOrderCntMsb) and slice picture order count least significant bits (slice_pic_order_cnt_lsb).

9 . The non-transitory computer-readable medium of claim 5 , wherein the DPB contains a plurality of reference pictures in addition to the previous decoded picture after decoding of the current picture.

10 . The non-transitory computer-readable medium of claim 5 , wherein at any given time the previous decoded picture is only marked or re-marked as one of used for short-term reference, used for short-term reference, and unused for reference.

11 . The non-transitory computer-readable medium of claim 10 , wherein marking or re-marking the previous decoded picture as one of used for short-term reference, used for short-term reference, and unused for reference removes any other marking for the previous decoded picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2025
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 073926/0059 →
Continuity (5)
Continuation 17578178 · Jan 18, 2022
Continuation 17176551 · Feb 16, 2021
Continuation PCTUS2019046927 · Aug 16, 2019
Provisional Application 62719360 · Aug 17, 2018
Related Publication 20240259553A1 · Aug 1, 2024
References Cited (122)
US 9008176B2 · Chen et al. · 2015 [cited by applicant]
US 9258559B2 · Chen et al. · 2016 [cited by applicant]
US 9264717B2 · Chen et al. · 2016 [cited by applicant]
US 9451284B2 · Wang et al. · 2016 [cited by applicant]
US 9485503B2 · Zhang et al. · 2016 [cited by applicant]
US 9521418B2 · Chen et al. · 2016 [cited by applicant]
US 10003817B2 · Sullivan et al. · 2018 [cited by applicant]
US 10158881B2 · Chen et al. · 2018 [cited by applicant]
US 10432928B2 · Li et al. · 2019 [cited by applicant]
US 10743024B2 · Yamamoto et al. · 2020 [cited by applicant]
US 20050123056A1 · Wang et al. · 2005 [cited by applicant]
US 20070019724A1 · Tourapis et al. · 2007 [cited by applicant]
US 20090262804A1 · Pandit et al. · 2009 [cited by applicant]
US 20110096835A1 · Lim et al. · 2011 [cited by applicant]
US 20120056981A1 · Tian et al. · 2012 [cited by applicant]
US 20120183076A1 · Boyce et al. · 2012 [cited by applicant]
US 20120189053A1 · Chen et al. · 2012 [cited by applicant]
US 20130057646A1 · Chen et al. · 2013 [cited by applicant]
US 20130077677A1 · Wang et al. · 2013 [cited by applicant]
US 20130077685A1 · Chen et al. · 2013 [cited by applicant]
US 20130077687A1 · Wang et al. · 2013 [cited by applicant]
US 20130089134A1 · Wang et al. · 2013 [cited by applicant]
US 20130107953A1 · Chen et al. · 2013 [cited by applicant]
US 20130107958A1 · Shimada · 2013 [cited by applicant]
US 20130114710A1 · Park et al. · 2013 [cited by applicant]
US 20130114741A1 · Sullivan et al. · 2013 [cited by applicant]
US 20130114742A1 · Hannuksela et al. · 2013 [cited by applicant]
US 20130155184A1 · Chen et al. · 2013 [cited by applicant]
US 20130202034A1 · Yu et al. · 2013 [cited by applicant]
US 20130202035A1 · Chen et al. · 2013 [cited by applicant]
US 20130208792A1 · He et al. · 2013 [cited by applicant]
US 20130215975A1 · Samuelsson · 2013 [cited by examiner]
US 20130279589A1 · Gu et al. · 2013 [cited by applicant]
US 20130322531A1 · Chen et al. · 2013 [cited by applicant]
US 20130329787A1 · Ramasubramonian et al. · 2013 [cited by applicant]
US 20140010291A1 · He et al. · 2014 [cited by applicant]
US 20140016699A1 · Chen et al. · 2014 [cited by applicant]
US 20140049604A1 · Chen et al. · 2014 [cited by applicant]
US 20140050270A1 · Lim et al. · 2014 [cited by applicant]
US 20140086324A1 · Ramasubramonian et al. · 2014 [cited by applicant]
US 20140198857A1 · Deshpande · 2014 [cited by applicant]
US 20140286416A1 · Jeon et al. · 2014 [cited by applicant]
US 20140301453A1 · Deshpande · 2014 [cited by applicant]
US 20150016505A1 · Sjoberg et al. · 2015 [cited by applicant]
US 20150023422A1 · Zhang et al. · 2015 [cited by applicant]
US 20150071351A1 · Lee et al. · 2015 [cited by applicant]
US 20150092839A1 · Chien et al. · 2015 [cited by applicant]
US 20150103881A1 · Hendry · 2015 [cited by examiner]
US 20150103912A1 · Lee et al. · 2015 [cited by applicant]
US 20150124877A1 · Choi et al. · 2015 [cited by applicant]
US 20150172655A1 · Hendry · 2015 [cited by applicant]
US 20150195506A1 · Lin et al. · 2015 [cited by applicant]
US 20150271487A1 · Li et al. · 2015 [cited by applicant]
US 20150312591A1 · Takahashi et al. · 2015 [cited by applicant]
US 20150326866A1 · Ikai et al. · 2015 [cited by applicant]
US 20150373315A1 · Chen et al. · 2015 [cited by applicant]
US 20160057420A1 · Pang et al. · 2016 [cited by applicant]
US 20160100189A1 · Pang et al. · 2016 [cited by applicant]
US 20160241850A1 · Deshpande · 2016 [cited by examiner]
US 20160353117A1 · Seregin et al. · 2016 [cited by applicant]
US 20170094270A1 · Zhao et al. · 2017 [cited by applicant]
US 20170150159A1 · Lee et al. · 2017 [cited by applicant]
US 20170214938A1 · Zhang et al. · 2017 [cited by applicant]
US 20180160122A1 · Xu · 2018 [cited by examiner]
US 20180270504A1 · Park et al. · 2018 [cited by applicant]
US 20190012839A1 · Wang · 2019 [cited by applicant]
US 20190230376A1 · Hu et al. · 2019 [cited by applicant]
US 20190238849A1 · Fang et al. · 2019 [cited by applicant]
US 20200296392A1 · Choi et al. · 2020 [cited by applicant]
US 20210092448A1 · Choi et al. · 2021 [cited by applicant]
US 20210168359A1 · Wang et al. · 2021 [cited by applicant]
US 20210195236A1 · Hendry et al. · 2021 [cited by applicant]
US 20210203923A1 · Sjoberg et al. · 2021 [cited by applicant]
US 20210266600A1 · Seregin et al. · 2021 [cited by applicant]
US 20210360290A1 · Seregin et al. · 2021 [cited by applicant]
US 20210368163A1 · Chen et al. · 2021 [cited by applicant]
US 20210385436A1 · Hsiang et al. · 2021 [cited by applicant]
US 20210409691A1 · Hendry et al. · 2021 [cited by applicant]
US 20220038685A1 · Deshpande · 2022 [cited by applicant]
US 20220060712A1 · Zhang et al. · 2022 [cited by applicant]
US 20220394301A1 · Deshpande et al. · 2022 [cited by applicant]
US 20230008778A1 · Wang et al. · 2023 [cited by applicant]
US 20230048070A1 · Deshpande · 2023 [cited by applicant]
US 20230084006A1 · Wang et al. · 2023 [cited by applicant]
US 20230111484A1 · Wang et al. · 2023 [cited by applicant]
US 20230120726A1 · Deng et al. · 2023 [cited by applicant]
CN 103814574A · 2014 [cited by applicant]
CN 103828374A · 2014 [cited by applicant]
CN 103959793A · 2014 [cited by applicant]
CN 104662920A · 2015 [cited by applicant]
CN 105122816A · 2015 [cited by applicant]
CN 106664426A · 2017 [cited by applicant]
CN 112585974A · 2021 [cited by applicant]
GB 2548739A · 2017 [cited by applicant]
JP 2016533077A · 2016 [cited by applicant]
RU 2571410C2 · 2015 [cited by applicant]
WO 2013043886A2 · 2013 [cited by applicant]
WO 2013043887A1 · 2013 [cited by applicant]
WO 2013111605A1 · 2013 [cited by applicant]
WO 2014004201A1 · 2014 [cited by applicant]
WO 2014006854A1 · 2014 [cited by applicant]
WO 2014097913A1 · 2014 [cited by applicant]
Document: JCTVC-U1005_v2_defects, Gerhard Tech, et al., “JCT-3V AHG Report: 3D-HEVC Draft and MV-HEVC / 3D-HEVC Test Model editing (AGH2) Defect report,” Joint Collaborative Team on 3D Video Coding Extension of ITU-T SG… [cited by applicant]
Sakae Okubo (et al.), Supervising Editor, “H.265/HEVC Textbook,” 1st Ed., Impress Japan Co., Ltd., Oct. 21, 2013, pp. 130-135, 208-214. [cited by applicant]
Sjoberg, “Overview of HEVC High-Level Syntax and Reference Picture Management,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, pp. 1858-1870. [cited by applicant]
“Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services at p x 64 kbits,” ITU-T, H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals, Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” ITU-T H.262 Feb. 2000, 220 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Video coding for low bit rate communication,” ITU-T H.263, Feb. 1998, 167 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services,” ITU-T H.264, Feb. 2016, 807 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High Efficiency Video Coding,” ITU-T H.265, Apr. 2013, 317 pages. [cited by applicant]
Hannuksela, M., et al., “AHG21: On reference picture list construction and reference picture marking,” JCTVC-G643, 7th Meeting: Geneva, CH, Nov. 21-30, 2011, JCTVC-G643, XP030230380, 10 pages. [cited by applicant]
JVET-M0128-v1, Wang, Y., et al., “On reference picture management for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 9 pages. [cited by applicant]
JCTVC-G643r1, Miska M. Hannuksela et al., “AHG21: On reference picture list construction and reference picture marking,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/ SC29/WG11, 7… [cited by applicant]
JVET-L0112-v1, Wang, Y., et al., “On reference picture management for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 11 pages. [cited by applicant]
JCTVC-F803 d5, Bross, B., et al., “WD4: Working Draft 4 of High-Efficiency Video Coding”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG116th Meeting: Torino, IT, Jul. 14-22… [cited by applicant]
JVET-K1001-v1, “Versatile Video Coding (Draft 21),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, 43 pages. [cited by applicant]
JVET-K0325-v2, “On High Level Syntax Starting Point,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, 6 pages. [cited by applicant]
Wahadaniah, V. et al., JCTVC-G548, “AHG21: Construction and modification of predefined reference picture sets and reference picture lists,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC… [cited by applicant]
JCTVC-H0433, WG11 No. m23309, Deshpande, S., et al., “AHG21: Reference Picture Set Signaling Method,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting: San Jose… [cited by applicant]
JVET-I0450-v2, Deshpande, S., “On Reference Pictures Signaling and Management for VVC,” Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 7 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High Efficiency Video Coding,” Recommendation ITU-T H.265, Dec. 2016, 664 pages. [cited by applicant]
Wang, Y., et al., “On reference picture management for VVC,” JVET-L0112-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 13 pages. [cited by applicant]