IP Library Granted Patent US 12,464,163
Granted Patent B2
US 12,464,163 · App. 18/232,193 · Granted Nov 4, 2025

Conditional signaling of reference picture list modification information

Inventors: Gary J. Sullivan (Bellevue, WA); Sandeep Kanumuri (Redmond, WA)
Assignee: Microsoft Technology Licensing, LLC
H04N19/58H04N19/105H04N19/109H04N19/134H04N19/46H04N19/503H04N19/573H04N19/70H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,464,163
App. No.
18/232,193
Granted
Nov 4, 2025
Kind
B2
Abstract

Innovations in signaling of reference picture list (“RPL”) modification information. For example, a video encoder evaluates a condition that depends at least in part on a variable indicating a number of total reference pictures. Depending on the results of the evaluation, the encoder signals in a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. A video decoder evaluates the condition and, depending on results of the evaluation, parses from a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. The condition can be evaluated as part of processing for an RPL modification structure that includes the flag, or as part of processing for a slice header. The encoder and decoder can also evaluate other conditions that affect syntax elements for list entries of the RPL modification information.

Claims (40)

1 . In a computer system that implements a video decoder, a method comprising:

receiving encoded data in a bitstream; and

decoding the encoded data, to produce reconstructed video, by operations comprising:

determining that a first condition is satisfied, wherein the first condition depends at least in part on a value of a reference picture list (“RPL”) variable exceeding a first threshold amount;

responsive to the first condition being satisfied, parsing from the bitstream a flag that indicates whether additional RPL information is indicated in the bitstream;

determining, based on the flag, that the additional RPL information is indicated in the bitstream;

responsive to the determining that the additional RPL information is indicated in the bitstream, checking whether or not a second condition is satisfied, wherein the second condition depends at least in part on the value of the RPL variable exceeding a second threshold amount, the second threshold amount being greater than the first threshold amount; and

determining a value of an index that indicates an entry in an RPL structure, including, if the second condition is satisfied, parsing from the bitstream the value of the index, but otherwise, the second condition not being satisfied, inferring the value of the index.

2 . The method of claim 1 , wherein, when the second condition is satisfied, the value of the index has a number of bits that depends on the value of the RPL variable.

3 . The method of claim 2 , wherein the value of the index is in the range of 0 to the value of the RPL variable minus 1.

4 . The method of claim 2 , wherein the number of bits is log base 2 of the value of the RPL variable, rounded up to the nearest integer according to a ceiling function.

5 . The method of claim 1 , wherein the first threshold amount is one less than the second threshold amount.

6 . The method of claim 1 , wherein the operations are performed as part of processing of a slice header for a current slice.

7 . The method of claim 1 , wherein, when the second condition is not satisfied, the value of the index is inferred to be 0.

8 . One or more non-transitory computer-readable media having programmed thereon encoded data in a bitstream, the encoded data including a flag that indicates whether additional reference picture list (“RPL”) information is indicated in the bitstream, the encoded data further conditionally including a value of an index that indicates an entry in an RPL structure, the encoded data being usable to cause a video decoder, when processing the encoded data in a computer system having one or more processing units, to perform operations comprising:

determining that a first condition is satisfied, wherein the first condition depends at least in part on a value of an RPL variable exceeding a first threshold amount;

responsive to the first condition being satisfied, parsing from the bitstream the flag that indicates whether additional RPL information is indicated in the bitstream;

based on the flag, determining that the additional RPL information is indicated in the bitstream;

responsive to the determining that the additional RPL information is indicated in the bitstream, checking whether or not a second condition is satisfied, wherein the second condition depends at least in part on the value of the RPL variable exceeding a second threshold amount, the second threshold amount being greater than the first threshold amount;

determining the value of the index that indicates the entry in the RPL structure, including, if the second condition is satisfied, parsing from the bitstream the value of the index, but otherwise, the second condition not being satisfied, inferring the value of the index; and

based on the value of the index, determining the entry in the RPL structure.

9 . The one or more non-transitory computer-readable media of claim 8 , wherein, when the second condition is satisfied, the value of the index has a number of bits that depends on the value of the RPL variable.

10 . The one or more non-transitory computer-readable media of claim 9 , wherein the value of the index is in the range of 0 to the value of the RPL variable minus 1, and wherein the number of bits is log base 2 of the value of the RPL variable, rounded up to the nearest integer according to a ceiling function.

11 . The one or more non-transitory computer-readable media of claim 8 , wherein the first threshold amount is one less than the second threshold amount.

12 . The one or more non-transitory computer-readable media of claim 8 , wherein the operations are performed as part of processing of a slice header for a current slice.

13 . The one or more non-transitory computer-readable media of claim 8 , wherein, when the second condition is not satisfied, the value of the index is inferred to be 0.

14 . A computer system comprising memory and one or more processing units, wherein the computer system implements a video encoder system that includes:

a buffer configured to receive video; and

a video encoder configured to perform encoding of the video, to produce encoded data in a bitstream, by operations comprising:

determining that a first condition is satisfied, wherein the first condition depends at least in part on a value of a reference picture list (“RPL”) variable exceeding a first threshold amount;

responsive to the first condition being satisfied, signaling in the bitstream a flag that indicates whether additional RPL information is indicated in the bitstream;

determining, consistent with the flag, that the additional RPL information is indicated in the bitstream;

responsive to the determining that the additional RPL information is indicated in the bitstream, checking whether or not a second condition is satisfied, wherein the second condition depends at least in part on the value of the RPL variable exceeding a second threshold amount, the second threshold amount being greater than the first threshold amount; and

conditionally signaling in the bitstream a value of an index that indicates an entry in an RPL structure, including, if the second condition is satisfied, signaling in the bitstream the value of the index, but otherwise, the second condition not being satisfied, skipping the signaling in the bitstream the value of the index.

15 . The computer system of claim 14 , wherein, when the second condition is satisfied, the value of the index has a number of bits that depends on the value of the RPL variable.

16 . The computer system of claim 15 , wherein the value of the index is in the range of 0 to the value of the RPL variable minus 1.

17 . The computer system of claim 15 , wherein the number of bits is log base 2 of the value of the RPL variable, rounded up to the nearest integer according to a ceiling function.

18 . The computer system of claim 14 , wherein the first threshold amount is one less than the second threshold amount.

19 . The computer system of claim 14 , wherein the operations are performed as part of processing of a slice header for a current slice.

20 . The computer system of claim 14 , wherein, when the second condition is not satisfied, the value of the index is inferred to be 0.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2023
From: SULLIVAN, GARY J.; KANUMURI, SANDEEP
To: MICROSOFT CORPORATION
Reel/Frame 064836/0150 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2023
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 064836/0182 →
Continuity (9)
Continuation 17845346 · Jun 21, 2022
Continuation 17229649 · Apr 13, 2021
Continuation 16727690 · Dec 26, 2019
Continuation 16191843 · Nov 15, 2018
Continuation 15655797 · Jul 20, 2017
Continuation 15064299 · Mar 8, 2016
Continuation 13781710 · Feb 28, 2013
Provisional Application 61708042 · Sep 30, 2012
Related Publication 20230412836A1 · Dec 21, 2023
References Cited (61)
US 6956545B2 · McClintock et al. · 2005 [cited by applicant]
US 9313500B2 · Sullivan et al. · 2016 [cited by applicant]
US 9762928B2 · Sullivan et al. · 2017 [cited by applicant]
US 10003817B2 · Sullivan et al. · 2018 [cited by applicant]
US 10165302B2 · Sullivan et al. · 2018 [cited by applicant]
US 10432964B2 · Sullivan et al. · 2019 [cited by applicant]
US 10560720B2 · Sullivan et al. · 2020 [cited by applicant]
US 10924760B2 · Sullivan et al. · 2021 [cited by applicant]
US 11012709B2 · Sullivan et al. · 2021 [cited by applicant]
US 11405636B2 · Sullivan et al. · 2022 [cited by applicant]
US 11418809B2 · Sullivan et al. · 2022 [cited by applicant]
US 11770553B2 · Sullivan et al. · 2023 [cited by applicant]
US 11770554B2 · Sullivan et al. · 2023 [cited by applicant]
US 11778229B2 · Sullivan et al. · 2023 [cited by applicant]
US 12003753B2 · Lim et al. · 2024 [cited by applicant]
US 20090238269A1 · Pandit et al. · 2009 [cited by applicant]
US 20090262804A1 · Pandit et al. · 2009 [cited by applicant]
US 20100189173A1 · Chen et al. · 2010 [cited by applicant]
US 20100195721A1 · Wu et al. · 2010 [cited by applicant]
US 20120294366A1 · Eliyahu · 2012 [cited by applicant]
US 20130003823A1 · Misra et al. · 2013 [cited by applicant]
US 20130077679A1 · Wang et al. · 2013 [cited by applicant]
US 20130077687A1 · Wang et al. · 2013 [cited by applicant]
US 20130094585A1 · Misra et al. · 2013 [cited by applicant]
US 20130094772A1 · Deshpande et al. · 2013 [cited by applicant]
US 20130114741A1 · Sullivan et al. · 2013 [cited by applicant]
US 20130202035A1 · Chen · 2013 [cited by examiner]
US 20130208792A1 · He · 2013 [cited by examiner]
US 20130215975A1 · Samuelsson et al. · 2013 [cited by applicant]
US 20130343465A1 · Chen · 2013 [cited by examiner]
US 20140016699A1 · Chen · 2014 [cited by examiner]
US 20140049604A1 · Chen · 2014 [cited by examiner]
US 20140072031A1 · Xiu · 2014 [cited by examiner]
US 20140092991A1 · Sullivan et al. · 2014 [cited by applicant]
US 20140126640A1 · Samuelsson et al. · 2014 [cited by applicant]
US 20150016505A1 · Sjoberg · 2015 [cited by examiner]
US 20220329852A1 · Sullivan et al. · 2022 [cited by applicant]
US 20240080475A1 · Sullivan et al. · 2024 [cited by applicant]
KR 102344167 · 2021 [cited by applicant]
Communication under Rule 71(3) EPC dated Jun. 7, 2024, from European Patent Application No. 21155916.6, 8 pp. [cited by applicant]
Notice of Allowance dated Oct. 4, 2023, from U.S. Appl. No. 17/850,622, 11 pp. [cited by applicant]
Notice of Preliminary Rejection dated Feb. 6, 2024, from Korean Patent Application No. 10-2023-7020078, 13 pp. [cited by applicant]
Decision to Grant dated Oct. 10, 2024, from European Patent Application No. 21155916.6, 2 pp. [cited by applicant]
Office Action dated Aug. 5, 2024, from U.S. Appl. No. 18/386,778, 16 pp. [cited by applicant]
Communication Pursuant to Rules 70(2) and 70a(2) EPC and reference to Rule 39(1) EPC dated Jan. 27, 2025, from European Patent Application No. 24201660.8, 2 pp. [cited by applicant]
Communication Pursuant to Rules 70(2) and 70a(2) EPC and reference to Rule 39(1) EPC dated Feb. 3, 2025, from European Patent Application No. 24201657.4, 2 pp. [cited by applicant]
Decision to Grant dated Feb. 4, 2021, from European Patent Application No. 13774010.6, 2 pp. [cited by applicant]
Decision to Grant dated Aug. 23, 2018, from European Patent Application No. 12848102.5, 1 p. [cited by applicant]
Extended European Search Report dated Dec. 23, 2024, from European Patent Application No. 24201660.8, 9 pp. [cited by applicant]
Extended European Search Report dated Jan. 8, 2025, from European Patent Application No. 24201657.4, 7 pp. [cited by applicant]
Intimation to Grant for Indian Application No. 3320/CHENP/2014, mailed on Sep. 3, 2021, 1 page. [cited by applicant]
Notice of Allowance dated Dec. 7, 2015, from U.S. Appl. No. 13/781,710, 7 pp. [cited by applicant]
Notice of Allowance dated Nov. 1, 2016, from U.S. Appl. No. 15/064,299, 8 pp. [cited by applicant]
Notice of Allowance dated Apr. 18, 2017, from U.S. Appl. No. 15/064,299, 9 pp. [cited by applicant]
Notice of Allowance dated Apr. 6, 2018, from U.S. Appl. No. 13/669,380, 11 pp. [cited by applicant]
Notice of Allowance dated Aug. 14, 2018, from U.S. Appl. No. 15/655,797, 8 pp. [cited by applicant]
Notice of Allowance dated Apr. 29, 2020, from Argentina Patent Application No. 20130103543, 2 pp. [cited by applicant]
Notice of Grant dated Dec. 4, 2017, from Chinese Patent Application No. 201280054626.X, 4 pp. [cited by applicant]
Notice of Preliminary Rejection dated Jan. 11, 2022, from Korean Patent Application No. 10-2021-7041951, 12 pp. [cited by applicant]
Notice of Preliminary Rejection dated Feb. 10, 2025, from Korean Patent Application No. 10-2023-7020078, 17 pp. [cited by applicant]
Office Action dated Feb. 6, 2025, from U.S. Appl. No. 18/386,778, 10 pp. [cited by applicant]