IP Library › Granted Patent US 11,973,968
Granted Patent B2
US 11,973,968 · App. 17/990,959 · Granted Apr 30, 2024

Signaling of coded picture buffer information in video bitstreams

Inventor: Ye-kui Wang (San Diego, CA)
Assignee: BYTEDANCE INC.
H04N19/46H04N19/105H04N19/172H04N19/188H04N19/423H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,973,968
App. No.
17/990,959
Granted
Apr 30, 2024
Kind
B2
Abstract

Methods, systems and devices for signaling of coded buffer picture information in video bitstream processing are disclosed. An example method of video processing includes performing a conversion between a video comprising one or more pictures and a bitstream of the video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that a first syntax element, when included in the bitstream, is access unit (AU) specific, wherein the value of the first syntax element is based on whether an associated AU is an intra random access points (IRAP) AU or a gradual decoding refresh (GDR) AU, and wherein the value of the first syntax element specifies (i) whether a second syntax element is present in a buffering period supplemental enhancement information (SEI) message, and (ii) whether alternative timing information is present in a picture timing SEI message in a current buffering period.

Claims (67)

1. A method of video processing, comprising:

performing a conversion between a video comprising one or more pictures and a bitstream of the video,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies that a first syntax element, when included in the bitstream, is access unit (AU) specific,

wherein a value of the first syntax element is based on whether an associated AU is an intra random access points (TRAP) AU or a gradual decoding refresh (GDR) AU,

wherein the value of the first syntax element specifies (i) whether a second syntax element is present in a buffering period (BP) supplemental enhancement information (SEI) message, and (ii) whether alternative timing information is present in a picture timing (PT) SEI message in a current BP,

wherein a value of the second syntax element indicates whether to use alternative coded picture buffer (CPB) parameters or not,

wherein the format rule specifies that a value of a third syntax element is based on a fourth syntax element that indicates whether a temporal distance between output times of consecutive pictures of a hypothetical reference decoder (HRD) is constrained and a variable that identifies a highest temporal sublayer to be decoded, and

wherein the third syntax element specifies a number of elemental picture period intervals that one or more decoded pictures of the current AU occupy for a display model.

2. The method of claim 1 , wherein the value of the first syntax element is equal to zero in response to the associated AU not being an IRAP AU or a GDR AU.

3. The method of claim 1 , wherein the value of the first syntax element is inferred to be zero in response to the first syntax element not being included in the bitstream.

4. The method of claim 1 , wherein the value of the first syntax element being one specifies that the second syntax element is present in the BP SEI message and the alternative timing information is present in the PT SEI message in the current BP.

5. The method of claim 1 , wherein the first syntax element is bp_alt_cpb_params_present_flag and the second syntax element is bp_use_alt_cpb_params_flag.

6. The method of claim 1 , wherein the third syntax element is included in a picture timing supplemental enhancement information (SEI) message, wherein the fourth syntax element is included in an output layer set (OLS) timing and HRD parameters syntax structure.

7. The method of claim 1 , wherein the third syntax element is pt_display_elemental_periods_minus1, the fourth syntax element is fixed_pic_rate_within_cvs_flag, and the variable is Htid.

8. The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.

9. The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video comprising one or more pictures and a bitstream of the video,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies that a first syntax element, when included in the bitstream, is access unit (AU) specific,

wherein a value of the first syntax element is based on whether an associated AU is an intra random access points (TRAP) AU or a gradual decoding refresh (GDR) AU,

wherein the value of the first syntax element specifies (i) whether a second syntax element is present in a buffering period (BP) supplemental enhancement information (SEI) message, and (ii) whether alternative timing information is present in a picture timing (PT) SEI message in a current BP,

wherein a value of the second syntax element indicates whether to use alternative coded picture buffer (CPB) parameters or not,

wherein the format rule specifies that a value of a third syntax element is based on a fourth syntax element that indicates whether a temporal distance between output times of consecutive pictures of a hypothetical reference decoder (HRD) is constrained and a variable that identifies a highest temporal sublayer to be decoded, and

wherein the third syntax element specifies a number of elemental picture period intervals that one or more decoded pictures of the current AU occupy for a display model.

11. The apparatus of claim 10 , wherein the value of the first syntax element is equal to zero in response to the associated AU not being an TRAP AU or a GDR AU, and

wherein the value of the first syntax element is inferred to be zero in response to the first syntax element not being included in the bitstream.

12. The apparatus of claim 10 , wherein the value of the first syntax element being one specifies that the second syntax element is present in the BP SEI message and the alternative timing information is present in the PT SEI message in the current BP.

13. The apparatus of claim 10 , wherein the first syntax element is bp_alt_cpb_params_present_flag and the second syntax element is bp_use_alt_cpb_params_flag.

14. The apparatus of claim 10 ,

wherein the third syntax element is included in a picture timing supplemental enhancement information (SEI) message,

wherein the fourth syntax element is included in an output layer set (OLS) timing and HRD parameters syntax structure, and

wherein the third syntax element is pt_display_elemental_periods_minus1, the fourth syntax element is fixed_pic_rate_within_cvs_flag, and the variable is Htid.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video comprising one or more pictures and a bitstream of the video,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies that a first syntax element, when included in the bitstream, is access unit (AU) specific,

wherein a value of the first syntax element is based on whether an associated AU is an intra random access points (TRAP) AU or a gradual decoding refresh (GDR) AU,

wherein the value of the first syntax element specifies (i) whether a second syntax element is present in a buffering period (BP) supplemental enhancement information (SEI) message, and (ii) whether alternative timing information is present in a picture timing (PT) SEI message in a current BP,

wherein a value of the second syntax element indicates whether to use alternative coded picture buffer (CPB) parameters or not,

wherein the format rule specifies that a value of a third syntax element is based on a fourth syntax element that indicates whether a temporal distance between output times of consecutive pictures of a hypothetical reference decoder (HRD) is constrained and a variable that identifies a highest temporal sublayer to be decoded, and

wherein the third syntax element specifies a number of elemental picture period intervals that one or more decoded pictures of the current AU occupy for a display model.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the value of the first syntax element is equal to zero in response to the associated AU not being an TRAP AU or a GDR AU,

wherein the value of the first syntax element is inferred to be zero in response to the first syntax element not being included in the bitstream,

wherein the value of the first syntax element being one specifies that the second syntax element is present in the BP SEI message and the alternative timing information is present in the PT SEI message in the current BP, and

wherein the first syntax element is bp_alt_cpb_params_present_flag and the second syntax element is bp_use_alt_cpb_params_flag.

17. The non-transitory computer-readable storage medium of claim 15 ,

wherein the third syntax element is included in a picture timing supplemental enhancement information (SEI) message,

wherein the fourth syntax element is included in an output layer set (OLS) timing and HRD parameters syntax structure, and

wherein the third syntax element is pt_display_elemental_periods_minus1, the fourth syntax element is fixed_pic_rate_within_cvs_flag, and the variable is Htid.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of the video comprising one or more pictures,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies that a first syntax element, when included in the bitstream, is access unit (AU) specific,

wherein a value of the first syntax element is based on whether an associated AU is an intra random access points (TRAP) AU or a gradual decoding refresh (GDR) AU,

wherein the value of the first syntax element specifies (i) whether a second syntax element is present in a buffering period (BP) supplemental enhancement information (SEI) message, and (ii) whether alternative timing information is present in a picture timing (PT) SEI message in a current BP,

wherein a value of the second syntax element indicates whether to use alternative coded picture buffer (CPB) parameters or not,

wherein the format rule specifies that a value of a third syntax element is based on a fourth syntax element that indicates whether a temporal distance between output times of consecutive pictures of a hypothetical reference decoder (HRD) is constrained and a variable that identifies a highest temporal sublayer to be decoded, and

wherein the third syntax element specifies a number of elemental picture period intervals that one or more decoded pictures of the current AU occupy for a display model.

19. The non-transitory computer-readable recording medium of claim 18 , wherein the value of the first syntax element is equal to zero in response to the associated AU not being an IRAP AU or a GDR AU,

wherein the value of the first syntax element is inferred to be zero in response to the first syntax element not being included in the bitstream,

wherein the value of the first syntax element being one specifies that the second syntax element is present in the BP SEI message and the alternative timing information is present in the PT SEI message in the current BP,

wherein the first syntax element is bp_alt_cpb_params_present_flag and the second syntax element is bp_use_alt_cpb_params_flag,

wherein the third syntax element is included in a picture timing supplemental enhancement information (SEI) message,

wherein the fourth syntax element is included in an output layer set (OLS) timing and HRD parameters syntax structure, and

wherein the third syntax element is pt_display_elemental_periods_minus1, the fourth syntax element is fixed_pic_rate_within_cvs_flag, and the variable is Htid.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2023
From: WANG, YE-KUI
To: BYTEDANCE INC.
Reel/Frame 062804/0856 →
Continuity (3)
Continuation PCTUS2021033785 · May 21, 2021
Provisional Application 63029321 · May 22, 2020
Related Publication 20230085717A1 · Mar 23, 2023
Cited By (3)
US 12,309,410 US 12,348,753 US 12,506,893