IP Library Granted Patent US 11,405,636
Granted Patent B2
US 11,405,636 · App. 17/229,649 · Granted Aug 2, 2022

Conditional signalling of reference picture list modification information

Inventors: Gary J. Sullivan (Bellevue, WA); Sandeep Kanumuri (Redmond, WA)
Assignee: Microsoft Technology Licensing, LLC
H04N19/58H04N19/105H04N19/109H04N19/134H04N19/46H04N19/503H04N19/573H04N19/70H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,405,636
App. No.
17/229,649
Granted
Aug 2, 2022
Kind
B2
Abstract

Innovations in signaling of reference picture list (“RPL”) modification information. For example, a video encoder evaluates a condition that depends at least in part on a variable indicating a number of total reference pictures. Depending on the results of the evaluation, the encoder signals in a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. A video decoder evaluates the condition and, depending on results of the evaluation, parses from a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. The condition can be evaluated as part of processing for an RPL modification structure that includes the flag, or as part of processing for a slice header. The encoder and decoder can also evaluate other conditions that affect syntax elements for list entries of the RPL modification information.

Claims (39)

1. A computer system comprising memory and one or more processing units, wherein the computer system implements a video decoder system that includes:

a buffer configured to receive encoded data in a bitstream; and

a video decoder configured to perform decoding of the encoded data, to produce reconstructed video, by operations comprising:

determining that a first condition is satisfied, wherein the first condition depends at least in part on a value of a reference picture list (“RPL”) variable exceeding a first threshold amount;

responsive to the first condition being satisfied, parsing from the bitstream a flag that indicates whether additional RPL information is indicated in the bitstream;

determining, based on the flag, that the additional RPL information is indicated in the bitstream;

responsive to the determining that the additional RPL information is indicated in the bitstream, checking whether or not a second condition is satisfied, wherein the second condition depends at least in part on the value of the RPL variable exceeding a second threshold amount, the second threshold amount being greater than the first threshold amount; and

determining a value of an index that indicates an entry in an RPL structure, including, if the second condition is satisfied, parsing from the bitstream the value of the index, but otherwise, the second condition not being satisfied, inferring the value of the index.

2. The computer system of claim 1 , wherein, when the second condition is satisfied, the value of the index has a number of bits that depends on the value of the RPL variable.

3. The computer system of claim 2 , wherein the value of the index is in the range of 0 to the value of the RPL variable minus 1.

4. The computer system of claim 2 , wherein the number of bits is log base 2 of the value of the RPL variable, rounded up to the nearest integer according to a ceiling function.

5. The computer system of claim 1 , wherein the first threshold amount is one less than the second threshold amount.

6. The computer system of claim 1 , wherein the operations are performed as part of processing of a slice header for a current slice.

7. The computer system of claim 1 , wherein, when the second condition is not satisfied, the value of the index is inferred to be 0.

8. One or more computer-readable media having stored thereon encoded data in a bitstream, the one or more computer-readable media being selected from the group consisting of volatile memory, non-volatile memory, magnetic disk, CD-ROM, and DVD, the encoded data being organized to facilitate decoding of the encoded data, to produce reconstructed video, by operations comprising:

determining that a first condition is satisfied, wherein the first condition depends at least in part on a value of a reference picture list (“RPL”) variable exceeding a first threshold amount;

responsive to the first condition being satisfied, parsing from the bitstream a flag that indicates whether additional RPL information is indicated in the bitstream;

determining, based on the flag, that the additional RPL information is indicated in the bitstream;

responsive to the determining that the additional RPL information is indicated in the bitstream, checking whether or not a second condition is satisfied, wherein the second condition depends at least in part on the value of the RPL variable exceeding a second threshold amount, the second threshold amount being greater than the first threshold amount; and

determining a value of an index that indicates an entry in an RPL structure, including, if the second condition is satisfied, parsing from the bitstream the value of the index, but otherwise, the second condition not being satisfied, inferring the value of the index.

9. The one or more computer-readable media of claim 8 , wherein, when the second condition is satisfied, the value of the index has a number of bits that depends on the value of the RPL variable.

10. The one or more computer-readable media of claim 9 , wherein the value of the index is in the range of 0 to the value of the RPL variable minus 1, and wherein the number of bits is log base 2 of the value of the RPL variable, rounded up to the nearest integer according to a ceiling function.

11. The one or more computer-readable media of claim 8 , wherein the first threshold amount is one less than the second threshold amount.

12. The one or more computer-readable media of claim 8 , wherein the operations are performed as part of processing of a slice header for a current slice.

13. The one or more computer-readable media of claim 8 , wherein, when the second condition is not satisfied, the value of the index is inferred to be 0.

14. In a computing device that implements a video encoder, a method comprising:

receiving video; and

encoding the video to produce encoded data in a bitstream, wherein the encoding the video includes:

determining that a first condition is satisfied, wherein the first condition depends at least in part on a value of a reference picture list (“RPL”) variable exceeding a first threshold amount;

responsive to the first condition being satisfied, signaling in the bitstream a flag that indicates whether additional RPL information is indicated in the bitstream;

determining, consistent with the flag, that the additional RPL information is indicated in the bitstream;

responsive to the determining that the additional RPL information is indicated in the bitstream, checking whether or not a second condition is satisfied, wherein the second condition depends at least in part on the value of the RPL variable exceeding a second threshold amount, the second threshold amount being greater than the first threshold amount; and

conditionally signaling in the bitstream a value of an index that indicates an entry in an RPL structure, including, if the second condition is satisfied, signaling in the bitstream the value of the index, but otherwise, the second condition not being satisfied, skipping the signaling in the bitstream the value of the index.

15. The method of claim 14 , wherein, when the second condition is satisfied, the value of the index has a number of bits that depends on the value of the RPL variable.

16. The method of claim 15 , wherein the value of the index is in the range of 0 to the value of the RPL variable minus 1.

17. The method of claim 15 , wherein the number of bits is log base 2 of the value of the RPL variable, rounded up to the nearest integer according to a ceiling function.

18. The method of claim 14 , wherein the first threshold amount is one less than the second threshold amount.

19. The method of claim 14 , wherein the determining that the first condition is satisfied, the signaling the flag, the determining that the additional RPL information is indicated in the bitstream, the checking, and the conditionally signaling are performed as part of processing of a slice header for a current slice.

20. The method of claim 14 , wherein, when the second condition is not satisfied, the value of the index is inferred to be 0.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: SULLIVAN, GARY J.; KANUMURI, SANDEEP
To: MICROSOFT CORPORATION
Reel/Frame 056307/0505 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 056307/0519 →
Cited By (2)
US 12,407,853 US 12,464,163