IP Library › Granted Patent US 12,395,625
Granted Patent B2
US 12,395,625 · App. 18/526,481 · Granted Aug 19, 2025

Reference picture management and list construction

Inventors: Alexandros Tourapis (Milpitas, CA); Jungsun Kim (Cupertino, CA); Krishnakanth Rapaka (San Jose, CA); David William Singer (San Francisco, CA)
H04N19/105H04N19/172H04N19/174H04N19/184H04N19/513H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,395,625
App. No.
18/526,481
Granted
Aug 19, 2025
Kind
B2
Abstract

Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

Claims (52)

1. A method for managing a decoded picture buffer (DPB) of a decoder comprising:

responsive to a bitstream of a coded sequence of pictures, deriving a list of all reference pictures to be stored in the DPB while decoding a portion of the bitstream, the list derived from a bitstream syntax essentially consisting of a single list of reference pictures including a single number indicating a total number of all reference pictures used in the portion of the bitstream;

parsing, from the bitstream syntax for the single list of reference pictures, an identification of the reference picture by a difference in a picture order count (POC) between a current picture and the identified reference picture and an indication of a weighting of the reference picture;

decoding a target picture in the coded sequence of pictures including predicting a portion of the target picture from the reference picture based on the indication of the weighting.

2. The method of claim 1 , further comprising:

wherein the indication of the weighting of the reference picture includes an indication of a weighting derivations flag indicating whether or not the weighting of the reference picture is to be derived based on the POC of the reference picture.

3. The method of claim 1 , further comprising:

wherein the single list includes multiple entries with the same reference picture, and a first entry with a common reference picture includes an indication of a first weight different from a second weight in a second entry for the same reference picture.

4. The method of claim 1 , further comprising:

evicting decoded pictures from a DPB that are not in the list.

5. The method of claim 1 , wherein the parsing of the identification of the reference picture includes:

parsing a magnitude of the difference in POC;

determining if the magnitude of the difference is greater than zero; and

when the magnitude is determined to be greater than zero, parsing a flag indicating a sign of the difference.

6. A non-transitory computer readable medium containing instructions that, when executed on a processor, cause:

responsive to a bitstream of a coded sequence of pictures, deriving a list of all reference pictures to be stored in the DPB while decoding a portion of the bitstream, the list derived from a bitstream syntax essentially consisting of a single list of reference pictures including a single number indicating a total number of all reference pictures used in the portion of the bitstream;

parsing, from the bitstream syntax for the single list of reference pictures, an identification of a reference picture by a difference in a picture order count (POC) between a current picture and the identified reference picture and an indication of a weighting of the reference picture;

decoding a target picture in the coded sequence of pictures including predicting a portion of the target picture from the reference picture based on the indication of the weighting.

7. A video decoder comprising:

a decoded picture buffer (DPB);

a decoder for decoding compressed video and storing reference pictures in the DPB;

a predictor for predicting from reference pictures in the DPB; and

a controller with instructions that cause the decoder to:

responsive to a bitstream of a coded sequence of pictures,

deriving a list of all reference pictures to be stored in the DPB while decoding a portion of the bitstream, the list derived from a bitstream syntax essentially consisting of a single list of reference pictures including a single number indicating a total number of all reference pictures used in the portion of the bitstream;

parsing, from the bitstream syntax for the single list of reference pictures, an identification of the reference picture by a difference in a picture order count (POC) between a current picture and the identified reference picture and an indication of a weighting of the reference picture;

decoding a target picture in the coded sequence of pictures including predicting a portion of the target picture from the reference picture based on the indication of the weighting.

8. A method for managing a decoded picture buffer (DPB) of an encoder comprising:

encoding a source picture of a sequence of pictures into an encoded bitstream including predicting a portion of the source picture from a reference picture based on the indication of a weighting for the reference picture;

including, in the encoded bitstream, a list of all reference pictures to be stored in the DPB while decoding a portion of the encoded bitstream in a bitstream syntax essentially consisting of a single list of reference pictures including a single number indicating a total number of all reference pictures used in the portion of the bitstream;

including, in the bitstream syntax for the single list of reference pictures, an identification of the reference picture by a difference in a picture order count (POC) between a current picture and the identified reference picture and an indication of the weighting of the reference picture.

9. The method of claim 8 , further comprising:

wherein the indication of the weighting of the reference picture includes an indication of a weighting derivations flag indicating whether or not the weighting of the reference picture should be derived based on the POC of the reference picture.

10. The method of claim 8 , further comprising:

wherein the single list includes multiple entries with a common reference picture, and a first entry with the same reference picture includes an indication of a first weight different from a second weight in a second entry for the same reference picture.

11. The method of claim 8 , further comprising:

evicting decoded pictures from a DPB that are not in the list.

12. The method of claim 8 , wherein the identification of the reference picture includes:

a magnitude of the difference in POC; and

when the magnitude is determined to be greater than zero, a flag indicating a sign of the difference.

13. A non-transitory computer readable medium containing instructions that, when executed on a processor, cause:

encoding a source picture of a sequence of pictures into an encoded bitstream including predicting a portion of the source picture from a reference picture based on the indication of the weighting for the reference picture;

including, in the encoded bitstream, a list of all reference pictures to be stored in the DPB while decoding a portion of the encoded bitstream in a bitstream syntax essentially consisting of a single list of reference pictures including a single number indicating a total number of all reference pictures used in the portion of the bitstream;

including, in the bitstream syntax for the single list of reference pictures, an identification of the reference picture by a difference in a picture order count (POC) between a current picture and the identified reference picture and an indication of a weighting of the reference picture.

14. A video encoder comprising:

a decoded picture buffer (DPB);

a decoder for decoding encoded pictures and storing reference pictures in the DPB;

a predictor for predicting from reference pictures in the DPB; and

a controller with instructions that cause the encoder to:

encoding a source picture of a sequence of pictures into an encoded bitstream including predicting, with the predictor, a portion of the source picture from a reference picture in the DPB based on the indication of the weighting for the reference picture;

including, in the encoded bitstream, a list of all reference pictures to be stored in the DPB while decoding a portion of the encoded bitstream in a bitstream syntax essentially consisting of a single list of reference pictures including a single number indicating a total number of all reference pictures used in the portion of the bitstream;

including, in the bitstream syntax for the single list of reference pictures, an identification of the reference picture by a difference in a picture order count (POC) between a current picture and the identified reference picture and an indication of a weighting of the reference picture.

Continuity (5)
Continuation 17540356 · Dec 2, 2021
Continuation 16669385 · Oct 30, 2019
Provisional Application 62786771 · Dec 31, 2018
Provisional Application 62780848 · Dec 17, 2018
Related Publication 20240114128A1 · Apr 4, 2024
References Cited (35)
US 11343530B2 · Lee · 2022 [cited by examiner]
US 20120189053A1 · Chen et al. · 2012 [cited by applicant]
US 20120189058A1 · Chen et al. · 2012 [cited by applicant]
US 20120250765A1 · Wu et al. · 2012 [cited by applicant]
US 20130003850A1 · Sugio et al. · 2013 [cited by applicant]
US 20130077677A1 · Wang et al. · 2013 [cited by applicant]
US 20130089134A1 · Wang et al. · 2013 [cited by applicant]
US 20130101034A1 · Wahadaniah et al. · 2013 [cited by applicant]
US 20130107953A1 · Chen et al. · 2013 [cited by applicant]
US 20130114742A1 · Hannuksela et al. · 2013 [cited by applicant]
US 20130188738A1 · Hannuksela et al. · 2013 [cited by applicant]
US 20130215975A1 · Samuelsson et al. · 2013 [cited by applicant]
US 20140003521A1 · Lee et al. · 2014 [cited by applicant]
US 20140016699A1 · Chen et al. · 2014 [cited by applicant]
US 20140169459A1 · Zhang et al. · 2014 [cited by applicant]
US 20140205014A1 · Nakamura et al. · 2014 [cited by applicant]
US 20140211856A1 · Sugio et al. · 2014 [cited by applicant]
US 20140286427A1 · Fukushima et al. · 2014 [cited by applicant]
US 20150304671A1 · Deshpande · 2015 [cited by applicant]
US 20150334399A1 · Hendry et al. · 2015 [cited by applicant]
US 20160323573A1 · Ikai · 2016 [cited by applicant]
US 20170244966A1 · Joshi · 2017 [cited by examiner]
US 20170310961A1 · Liu et al. · 2017 [cited by applicant]
US 20180160122A1 · Xu et al. · 2018 [cited by applicant]
US 20180184093A1 · Xu et al. · 2018 [cited by applicant]
US 20190141320A1 · Wang et al. · 2019 [cited by applicant]
US 20200221097A1 · Laroche et al. · 2020 [cited by applicant]
Bross et al.; “Versatile Video Coding (Draft 3)”; Joint Video Experts Team; Document: JVET-LI006-v6; Oct. 2018; 204 pages. [cited by applicant]
Bross et al.; “Versatile Video Coding (Draft 2)”; Joint Video Experts Team; Document: JVET-K1001-v6; Jul. 2018; 146 pages. [cited by applicant]
Hannuksela et al.; “AHG21: Removal of reference picture list modification”; Joint Collaborative Team on Video Coding; Document: JCTVC-H0426; Feb. 2012; 10 pages. [cited by applicant]
Wang et al.; “On Reference Picture Management for VVC”; Joint Video Experts Team; JVET-M0128-v1; Jan. 2019; 9 pages. [cited by applicant]
International Patent Application No. PCT/US2019/059429; Invitation to Pay Add'l Fees; dated Feb. 6, 2020; 17 pages. [cited by applicant]
International Patent Application No. PCT/US2019/059429; Int'l Search Report and the Written Opinion; dated Apr. 6, 2020; 40 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems: Infrastructure of audiovisual services—Coding of moving video—High efficiency video coding”; Telecommunication Standardization Sector; ITU-T H.265; Feb. 2018; 692 pages. [cited by applicant]
International Patent Application No. PCT/US2019/059429; Int'l Preliminary Report on Patentability; dated Jul. 1, 2021; 13 pages. [cited by applicant]