IP Library Granted Patent US 11,831,921
Granted Patent B2
US 11,831,921 · App. 17/477,320 · Granted Nov 28, 2023

Video operating points record syntax and semantics

Inventor: Ye-Kui Wang (San Diego, CA)
Assignee: Lemon Inc.
H04N19/70H04N19/105H04N19/132H04N19/172H04N19/184H04N19/186H04N19/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,831,921
App. No.
17/477,320
Granted
Nov 28, 2023
Kind
B2
Abstract

Systems, methods and apparatus for processing visual media data are described. One example method includes performing a conversion between visual media data and a visual media file that includes one or more tracks that store one or more bitstreams of the visual media data according to a format rule; wherein the visual media file includes an operating point record and an operating point group box, and wherein the format rule specifies to include, for each operating point indicated in the visual media file, in the operating point record and the operating point group box, a first element indicative of a chroma format, a second element indictive of a bit depth information, a third element indicative of a maximum picture width, and/or a fourth element indicative of a maximum picture height.

Claims (32)

1. A method of processing visual media data, comprising:

performing a conversion between visual media data and a visual media file that includes one or more tracks that store one or more bitstreams of the visual media data according to a format rule;

wherein the visual media file includes an operating point record and an operating point group box,

wherein the format rule specifies to include, for each operating point indicated in the visual media file, in the operating point record and the operating point group box, a first element indicative of a chroma format, a second element indictive of a bit depth information, a third element indicative of a maximum picture width, and a fourth element indicative of a maximum picture height, and

wherein the format rule further specifies a syntax constraint on a value of the first element, a value of the second element, a value of the third element, and a value of the fourth element that apply to an operating point associated with a bitstream based on whether the operating point contains only a single layer.

2. The method of claim 1 , wherein the format rule further specifies that the first element, the second element, the third element, and/or the fourth element is immediately after a fifth element indicating a zero-based index of a profile, level, and tier structure for an output layer set identified by an output layer set index.

3. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing the single layer, the syntax constraint is that one or more chroma format values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units in the bitstream of the operating point are equal.

4. The method of claim 3 , wherein the format rule further specifies that the value of the first element is equal to the one or more chroma format values.

5. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing more than one layer, the syntax constraint is that the value of the first element is set to be equal to a chroma format value that is indicated in a video parameter set and applies to an output layer set identified by an output layer set index.

6. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing the single layer, the syntax constraint is that one or more bit depth information values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units in the bitstream of the operating point are equal.

7. The method of claim 6 , wherein the format rule further specifies that the value of the second element is equal to the one or more bit depth information values.

8. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing more than one layer, the syntax constraint is that the value of the second element is set to be equal to a bit depth information value that is indicated in a video parameter set and applies to an output layer set identified by an output layer set index.

9. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing the single layer, the syntax constraint is that one or more picture width values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units in the bitstream of the operating point are equal.

10. The method of claim 9 , wherein the format rule further specifies that the value of the third element is equal to the one or more picture width values.

11. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing more than one layer, the syntax constraint is that the value of the third element is set to be equal to a picture width value that is indicated in a video parameter set and applies to an output layer set identified by an output layer set index.

12. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing the single layer, the syntax constraint is that one or more picture height values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units in the bitstream of the operating point are equal.

13. The method of claim 12 , wherein the format rule further specifies that the value of the fourth element is equal to the one or more picture height values.

14. The method of claim 1 , wherein the format rule further specifies that, in response to the operating point containing more than one layer, the syntax constraint is that the value of the fourth element is set to be equal to a picture height value that is indicated in a video parameter set and applies to an output layer set identified by an output layer set index.

15. The method of claim 1 , wherein the conversion comprises generating a visual media file and storing the one or more bitstreams to the visual media file according to the format rule.

16. The method of claim 1 , wherein the conversion comprises parsing the visual media file according to the format rule to reconstruct the one or more bitstreams.

17. An apparatus of processing visual media data, comprising a processor configured to implement a method comprising:

performing a conversion between visual media data and a visual media file that includes one or more tracks that store one or more bitstreams of the visual media data according to a format rule;

wherein the visual media file includes an operating point record and an operating point group box,

wherein the format rule specifies whether to include, for each operating point indicated in the visual media file, in the operating point record and the operating point group box, a first element indicative of a chroma format, a second element indictive of a bit depth information, a third element indicative of a maximum picture width, and a fourth element indicative of a maximum picture height, and

wherein the format rule further specifies a syntax constraint on a value of the first element, a value of the second element, a value of the third element, and a value of the fourth element that apply to an operating point associated with a bitstream based on whether the operating point contains only a single layer.

18. The apparatus of claim 17 , wherein the format rule further specifies that the first element, the second element, the third element, and/or the fourth element are immediately after a fifth element indicating a zero-based index of a profile, level, and tier structure for an output layer set identified by an output layer set index.

19. A non-transitory computer-readable recording medium storing instructions that cause a processor to:

perform a conversion between visual media data and a visual media file that includes one or more tracks that store one or more bitstreams of the visual media data according to a format rule;

wherein the visual media file includes an operating point record and an operating point group box,

wherein the format rule specifies whether to include, for each operating point indicated in the visual media file, in the operating point record and the operating point group box, a first element indicative of a chroma format, a second element indictive of a bit depth information, a third element indicative of a maximum picture width, and a fourth element indicative of a maximum picture height, and

wherein the format rule further specifies a syntax constraint on a value of the first element, a value of the second element, a value of the third element, and a value of the fourth element that apply to an operating point associated with a bitstream based on whether the operating point contains only a single layer.

20. The apparatus of claim 17 , wherein the format rule further specifies that, in response to the operating point containing the single layer, the syntax constraint is that one or more chroma format values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units in the bitstream of the operating point are equal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2021
From: WANG, YE-KUI
To: BYTEDANCE INC.
Reel/Frame 057507/0164 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2021
From: BYTEDANCE INC.
To: LEMON INC.
Reel/Frame 057507/0208 →
Continuity (2)
Provisional Application 63079910 · Sep 17, 2020
Related Publication 20220086499A1 · Mar 17, 2022