IP Library › Granted Patent US 11,711,518
Granted Patent B2
US 11,711,518 · App. 17/475,774 · Granted Jul 25, 2023

Decoding capability information storage in video coding

Inventor: Ye-Kui Wang (San Diego, CA)
Assignee: Lemon Inc.
H04N19/132H04N19/105H04N19/159H04N19/172H04N19/188H04N19/513H04N21/2343H04N21/23418
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,711,518
App. No.
17/475,774
Granted
Jul 25, 2023
Kind
B2
Abstract

Systems, methods and apparatus for encoding or decoding a file format that stores one or more images are described. One example method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that a type of a sample entry determines whether decoding capability information network abstraction layer units are included in either the sample entry of a video track in the visual media file or in a sample of the video track and the sample entry of the video track in the visual media file.

Claims (48)

1. A method of processing visual media data, comprising:

performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the format rule specifies that a type of a sample entry determines whether decoding capability information network abstraction layer units are included in either the sample entry of a video track in the visual media file or in a sample of the video track and the sample entry of the video track in the visual media file.

2. The method of claim 1 ,

wherein the format rule specifies that the decoding capability information network abstraction layer units are included in the sample entry of the video track in response to the type of the sample entry being vvc1.

3. The method of claim 1 ,

wherein the format rule specifies that the decoding capability information network abstraction layer units are included in the sample of the video track and the sample entry of the video track in response to the type of the sample entry being vvi1.

4. The method of claim 1 ,

wherein the format rule specifies that a video elementary stream in the visual media file includes video coding layer network abstraction layer units,

wherein the format rule specifies that the video elementary stream in the visual media file is disallowed from including a parameter set or the decoding capability information network abstraction layer units, and

wherein the format rule specifies that sample entries in the visual media file store the parameter set and the decoding capability information network abstraction layer units.

5. The method of claim 4 ,

wherein the format rule specifies that the video elementary stream in the visual media file is disallowed from including the parameter set, the decoding capability information network abstraction layer units, or operating point information network abstraction units, and

wherein the format rule specifies that sample entries in the visual media file store the parameter set, the decoding capability information network abstraction layer units, and the operating point information network abstraction units.

6. The method of claim 1 ,

wherein the format rule specifies that samples in the visual media file are allowed to belong to a same decoder capability information sample group in response to the samples belonging to multiple versatile video coding bitstreams and in response to the samples being included in a same track, and

wherein the format rule specifies that all samples belonging to the same decoder capability information sample group share a same decoder capability information sample group description entry.

7. The method of claim 6 , wherein the format rule specifies that the decoding capability information network abstraction layer units are indicated in a track level box in the visual media file in response to all samples of a track belonging to a same bitstream or in response to all samples sharing a same decoding capability information regardless of a number of bitstreams.

8. The method of claim 7 , wherein the track level box is a track header box, a track level meta box, or another track level box.

9. The method of claim 1 ,

wherein the format rule specifies that operating point information network abstraction layer units are allowed to be included in the visual media file in a sample entry description as one of a plurality of non-video coding layer network abstraction layer unit arrays in a decoder configuration record.

10. The method of claim 1 ,

wherein the format rule specifies that a second type of a second sample entry determines whether operating point information network abstraction layer units are included in either:

(1) the second sample entry of the video track in the visual media file, or

(2) either a sample of the video track in the visual media file or the second sample entry of the video track in the visual media file or both.

11. The method of claim 1 , wherein the conversion comprises generating the visual media file and storing the bitstream to the visual media file according to the format rule.

12. The method of claim 1 , wherein the conversion comprises parsing the visual media file according to the format rule to reconstruct the bitstream.

13. The method of claim 1 , wherein the visual media file is processed by a versatile video coding (VVC), and the video track is VVC track.

14. An apparatus for processing visual media data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to implement a method comprising:

perform a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the format rule specifies that a type of a sample entry determines whether decoding capability information network abstraction layer units are included in either the sample entry of a video track in the visual media file or in a sample of the video track and the sample entry of the video track in the visual media file.

15. The apparatus of claim 14 ,

wherein the format rule specifies that the decoding capability information network abstraction layer units are included in the sample entry of the video track in response to the type of the sample entry being vvc1.

16. The apparatus of claim 14 ,

wherein the format rule specifies that the decoding capability information network abstraction layer units are included in the sample of the video track and the sample entry of the video track in response to the type of the sample entry being vvi1.

17. The apparatus of claim 14 ,

wherein the format rule specifies that a video elementary stream in the visual media file includes video coding layer network abstraction layer units,

wherein the format rule specifies that the video elementary stream in the visual media file is disallowed from including a parameter set or the decoding capability information network abstraction layer units, and

wherein the format rule specifies that sample entries in the visual media file store the parameter set and the decoding capability information network abstraction layer units.

18. The apparatus of claim 14 ,

wherein the format rule specifies that samples in the visual media file are allowed to belong to a same decoder capability information sample group in response to the samples belonging to multiple versatile video coding bitstreams and in response to the samples being included in a same track, and

wherein the format rule specifies that all samples belonging to the same decoder capability information sample group share a same decoder capability information sample group description entry.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the format rule specifies that a type of a sample entry determines whether decoding capability information network abstraction layer units are included in either the sample entry of a video track in the visual media file or in a sample of the video track and the sample entry of the video track in the visual media file.

20. A non-transitory computer-readable recording medium storing a bitstream in a visual media file which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating, for the visual media file, the bitstream of a visual media data according to a format rule,

wherein the format rule specifies that a type of a sample entry determines whether decoding capability information network abstraction layer units are included in either the sample entry of a video track in the visual media file or in a sample of the video track and the sample entry of the video track in the visual media file.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2021
From: WANG, YE-KUI
To: BYTEDANCE INC.
Reel/Frame 057487/0947 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2021
From: BYTEDANCE INC.
To: LEMON INC.
Reel/Frame 057488/0001 →
Continuity (2)
Provisional Application 63079869 · Sep 17, 2020
Related Publication 20220086446A1 · Mar 17, 2022