IP Library Granted Patent US 11,356,681
Granted Patent B2
US 11,356,681 · App. 17/063,891 · Granted Jun 7, 2022

Coded video sub-bitstream extraction

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (San Jose, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/30H04N19/105H04N19/188H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,356,681
App. No.
17/063,891
Granted
Jun 7, 2022
Kind
B2
Abstract

A method of extracting a sub-bitstream from an encoded video bitstream using at least one processor includes: obtaining an encoded video bitstream, the encoded video bitstream including a plurality of Network Abstraction Layer (NAL) units; obtaining an output layer set list; comparing the NAL units with the output layer set list; and removing NAL units that are not included in the output layer set list.

Claims (40)

1. A method of extracting a sub-bitstream from an encoded video bitstream using at least one processor, the method comprising:

obtaining an encoded video bitstream, the encoded video bitstream including a plurality of Network Abstraction Layer (NAL) units;

obtaining an output layer set list;

comparing the NAL units with the output layer set list; and

removing NAL units that are not included in the output layer set list,

wherein the NAL units which are removed include at least one of Sequence Parameter Set (SPS) NAL units, Package Per Second (PPS) NAL units, and Application Support Sublayer (APS) NAL units.

2. The method of extracting a sub-bitstream according to claim 1 , wherein the NAL units which are removed have a greater temporal ID than a target temporal ID.

3. The method of extracting a sub-bitstream according to claim 1 , further comprising: removing NAL units that contain a scalable nesting Supplementary Enhancement Information (SEI) message.

4. The method of extracting a sub-bitstream according to claim 1 , further comprising: removing NAL units that contain a non-scalable nesting Supplementary Enhancement Information (SEI) message.

5. The method of extracting a sub-bitstream according to claim 1 , wherein the NAL units which are removed include Picture Header (PH) NAL units.

6. The method of extracting a sub-bitstream according to claim 1 , wherein the output layer set list is located in a video parameter set.

7. The method of extracting a sub-bitstream according to claim 1 , further comprising: outputting the extracted sub-bitstream.

8. The method of claim 1 , wherein the extracted sub-bitstream includes at least one Visual Component Library (VCL) NAL unit having a temporal ID that matches a temporal ID included in the output layer set list.

9. The method of claim 2 , wherein the extracted sub-bitstream includes at least one Visual Component Library (VCL) NAL unit having a temporal ID that matches the target temporal ID included in the output layer set list.

10. A device for extracting a sub-bitstream from an encoded video, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

first obtaining code configured to obtain an encoded video bitstream, the encoded video bitstream including a plurality of Network Abstraction Layer (NAL) units;

second obtaining code configured to obtaining an output layer set list;

comparing code configured to compare the NAL units with the output layer set list; and

first removing code configured to remove NAL units that are not included in the output layer set list,

wherein the NAL units which are removed include at least one of Sequence Parameter Set (SPS) NAL units, Package Per Second (PPS) NAL units, and Application Support Sublayer (APS) NAL units.

11. The device of claim 10 , wherein the NAL units which are removed have a greater temporal ID than a target temporal ID.

12. The device of claim 10 , wherein the program code further includes:

second removing code configured to remove NAL units that contain a scalable nesting Supplementary Enhancement Information (SEI) message.

13. The device of claim 10 , wherein the program code further includes:

second removing code configured to remove NAL units that contain a non-scalable nesting Supplementary Enhancement Information (SEI) message.

14. The device of claim 10 , wherein the NAL units which are removed include Picture Header (PH) NAL units.

15. The device of claim 10 , wherein the output layer set list is located in a video parameter set.

16. The device of claim 10 , further comprising:

outputting code configured to: output the extracted sub-bitstream.

17. The device of claim 11 , wherein the extracted sub-bitstream includes at least one Visual Component Library (VCL) NAL unit having a temporal ID that matches the target temporal ID included in the output layer set list.

18. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for extracting a sub-bitstream from an encoded video, cause the one or more processors to:

obtain an encoded video bitstream, the encoded video bitstream including a plurality of Network Abstraction Layer (NALs) units;

obtain an output layer set list;

compare the NAL units with the output layer set list; and

remove NAL units that are not included in the output layer set list,

wherein the NAL units which are removed include at least one of Sequence Parameter Set (SPS) NAL units, Package Per Second (PPS) NAL units, and Application Support Sublayer (APS) NAL units.

19. A method of extracting a sub-bitstream from each of a plurality of encoded video bitstreams, wherein, each extraction of sub-bitstreams from each of the plurality of encoded video bitstreams comprises the method of claim 1 .

20. The device of claim 10 , wherein the device is configured to extract a sub-bitstream from each of a plurality of encoded videos.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2020
From: CHOI, BYEONGDOO; LIU, SHAN; WENGER, STEPHAN
To: TENCENT AMERICA LLC
Reel/Frame 053987/0144 →
Continuity (3)
Provisional Application 62956259 · Jan 1, 2020
Provisional Application 62954100 · Dec 27, 2019
Related Publication 20210203965A1 · Jul 1, 2021
Cited By (7)
US 12,192,493 US 12,200,236 US 12,301,849 US 12,413,762 US 12,432,369 US 12,501,062 US 12,621,470