IP Library › Granted Patent US 11,729,427
Granted Patent B2
US 11,729,427 · App. 17/476,809 · Granted Aug 15, 2023

Chroma format and bit depth indication in coded video

Inventor: Ye-Kui Wang (San Diego, CA)
Assignee: LEMON INC.
H04N19/70H04N19/105H04N19/132H04N19/172H04N19/184H04N19/186H04N19/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,729,427
App. No.
17/476,809
Granted
Aug 15, 2023
Kind
B2
Abstract

Systems, methods and apparatus for processing visual media data are described. One example method includes performing a conversion between visual media data and a visual media file including one or more tracks storing one or more bitstreams of the visual media data according to a format rule; wherein the format rule specifies whether a first element indicative of whether a track contains a bitstream corresponding to a specific output layer set controls whether a second element indicative of a chroma format of the track and/or a third element indictive of a bit depth information of the track is included in a configuration record of the track.

Claims (28)

1. A method of processing visual media data, comprising:

performing a conversion between visual media data and a visual media file including one or more tracks storing one or more bitstreams of the visual media data according to a format rule;

wherein the format rule specifies that a first element indicative of whether a track contains a specific bitstream corresponding to a specific output layer set controls whether a second element indicative of a chroma format of the track and/or a third element indictive of a bit depth information of the track is included in a configuration record of the track, wherein the specific output layer set is formed by a plurality of output layers, and

wherein the format rule further specifies a syntax constraint depending on whether a bitstream to which the configuration record applies is a multi-layer bitstream.

2. The method of claim 1 , wherein the format rule specifies to include the second element and/or the third element in response to the first element indicating that the track contains the specific bitstream corresponding to the specific output layer set.

3. The method of claim 1 , wherein the format rule specifies to omit the second element and/or the third element in response to the first element indicating that the track is allowed not to contain the specific bitstream corresponding to the specific output layer set.

4. The method of claim 1 , wherein the format rule further specifies that, in response to the bitstream not being the multi-layer bitstream, the syntax constraint is that one or more chroma format values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units included in samples of the visual media file to which a sample entry description of the configuration record applies are equal.

5. The method of claim 4 , wherein the format rule further specifies that a chroma format value indicated in the configuration record is equal to the one or more chroma format values.

6. The method of claim 1 , wherein the format rule further specifies that, in response to the bitstream being the multi-layer bitstream, the syntax constraint is that a value of a chroma format indicated in the configuration record is set to be equal to a maximum value of a chroma format that is indicated in a video parameter set and is a maximum format value among all chroma format values indicated in all video parameter sets for all coded video sequences to which a sample entry description of the configuration record applies and applies to an output layer set identified by an output layer set index.

7. The method of claim 1 , wherein the format rule further specifies, in response to the bitstream not being the multi-layer bitstream, that one or more bit depth information values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units included in samples of the visual media file to which a sample entry description of the configuration record applies are equal.

8. The method of claim 7 , wherein the format rule further specifies that a bit depth information value indicated in the configuration record is equal to the one or more bit depth information values.

9. The method of claim 1 , wherein the format rule further specifies that, in response to the bitstream being the multi-layer bitstream, the syntax constraint is that a bit depth information value indicated in the configuration record is set to be equal to a maximum value of bit depth information that is indicated in a video parameter set and is a maximum value of bit depth information among all bit depth information values indicated in all video parameter sets for all coded video sequences to which a sample entry description of the configuration record applies and applies to an output layer set identified by an output layer set index.

10. The method of claim 1 , wherein the conversion comprises generating the visual media file and storing the one or more bitstreams to the visual media file according to the format rule.

11. The method of claim 1 , wherein the conversion comprises parsing the visual media file according to the format rule to reconstruct the one or more bitstreams.

12. An apparatus of processing visual media data, comprising a processor configured to implement a method comprising:

performing a conversion between visual media data and a visual media file including one or more tracks storing one or more bitstreams of the visual media data according to a format rule,

wherein the format rule specifies that a first element indicative of whether a track contains a specific bitstream corresponding to a specific output layer set controls whether a second element indicative of a chroma format of the track and/or a third element indicative of a bit depth information of the track is included in a configuration record of the track, wherein the specific output layer set is formed by a plurality of output layers, and

wherein the format rule further specifies a syntax constraint depending on whether a bitstream to which the configuration record applies is a multi-layer bitstream.

13. The apparatus of claim 12 , wherein the format rule specifies to include the second element and/or the third element in response to the first element indicating that the track contains the specific bitstream corresponding to the specific output layer set.

14. The apparatus of claim 12 , wherein the format rule specifies to omit the second element and/or the third element in response to the first element indicating that the track is allowed not to contain the specific bitstream corresponding to the specific output layer set.

15. The apparatus of claim 12 , wherein the format rule specifies that, in response to the bitstream not being the multi-layer bitstream, the syntax constraint is that one or more chroma format values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units included in samples of the visual media file to which a sample entry description of the configuration record applies are equal.

16. The apparatus of claim 12 , wherein the format rule specifies that, in response to the bitstream being the multi-layer bitstream, the syntax constraint is that a value of a chroma format indicated in the configuration record is set to be equal to a maximum value of a chroma format that is indicated in a video parameter set and is a maximum format value among all chroma format values indicated in all video parameter sets for all coded video sequences to which a sample entry description of the configuration record applies and applies to an output layer set identified by an output layer set index.

17. The apparatus of claim 12 , wherein the format rule specifies that, in response to the bitstream not being the multi-layer bitstream, that one or more bit depth information values indicated in one or more sequence parameter sets referenced by NAL (network abstraction layer) units included in samples of the visual media file to which a sample entry description of the configuration record applies are equal.

18. The apparatus of claim 12 , wherein the format rule specifies that, in response to the bitstream being the multi-layer bitstream, the syntax constraint is that a bit depth information value indicated in the configuration record is set to be equal to a maximum value of bit depth information that is indicated in a video parameter set and is a maximum value of bit depth information among all bit depth information values indicated in all video parameter sets for all coded video sequences to which a sample entry description of the configuration record applies and applies to an output layer set identified by an output layer set index.

19. A non-transitory computer-readable recording medium storing instructions that cause a processor to:

perform a conversion between visual media data and a visual media file including one or more tracks storing one or more bitstreams of the visual media data according to a format rule,

wherein the format rule specifies that a first element indicative of whether a track contains a specific bitstream corresponding to a specific output layer set controls whether a second element indicative of a chroma format of the track and/or a third element indicative of a bit depth information of the track is included in configuration record of the track, wherein the specific output layer set is formed by a plurality of output layers, and

wherein the format rule further specifies a syntax constraint depending on whether a bitstream to which the configuration record applies is a multi-layer bitstream.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2021
From: WANG, YE-KUI
To: BYTEDANCE INC.
Reel/Frame 057502/0427 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2021
From: BYTEDANCE INC.
To: LEMON INC.
Reel/Frame 057502/0443 →
Continuity (2)
Provisional Application 63079910 · Sep 17, 2020
Related Publication 20220103865A1 · Mar 31, 2022