Extracting MCTS sub-bitstreams for video coding

1. A method of processing video data, the method comprising:

determining to extract a motion constrained tile sets (MCTS) sub-bitstream from an original bitstream based at least in part on information of an MCTS extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message; and

in response to determining to extract the MCTS sub-bitstream, extracting the MCTS sub-bitstream from the original bitstream, wherein extracting the MCTS sub-bitstream comprises:

extracting one or more MCTS-nested SEI messages from the original bitstream and adding the one or more MCTS-nested SEI messages to the MCTS sub-bitstream to cause the MCTS sub-bitstream to include the one or more MCTS-nested SEI messages; and

not extracting all other SEI network abstraction layer (NAL) units that contain non-MCTS-nested SEI messages from the original bitstream, such that the MCTS sub-bitstream does not include the other SEI NAL units that contain the non-MCTS-nested SEI messages, regardless of a value of a NAL unit header layer identifier value for the non-MCTS-nested SEI messages.

2. The method of claim 1 , further comprising determining that all slice segments of the MCTS sub-bitstream containing one or more tiles belonging to respective MCTSs of the video data depend at most on slice segments within the same MCTS.

3. The method of claim 1 , further comprising:

determining that an access unit of the sub-bitstream includes the MCTS-EIS SEI message; and

decoding an MCTS nesting SEI message of the access unit in response to determining that the access unit includes the MCTS-EIS SEI message.

4. The method of claim 1 , further comprising:

determining that the access unit of the sub-bitstream includes the MCTS-EIS SEI message; and

in response to determining that the access unit includes the MCTS-EIS SEI message:

determining a set of associated pictures of the MCTS-EIS SEI message;

determining whether a current picture of the access unit is included in the set of associated pictures; and

coding an MCTS nesting SEI message of the access unit only when the current picture is included in the set of associated pictures.

5. The method of claim 1 , further comprising:

passing the MCTS sub-bitstream to a video decoder.

6. A device for processing video data, the device comprising:

a memory configured to store video data; and

one or more processors implemented in circuitry and configured to:

determine to extract a motion constrained tile sets (MCTS) sub-bitstream from an original bitstream including the video data based at least in part on information of an MCTS extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message; and

in response to determining to extract the MCTS sub-bitstream, extract the MCTS sub-bitstream from the original bitstream, wherein to extract the MCTS sub-bitstream, the one or more processors are configured to:

extract one or more MCTS-nested SEI messages from the original bitstream and add the one or more MCTS-nested SEI messages to the MCTS sub-bitstream to cause the MCTS sub-bitstream to include the one or more MCTS-nested SEI messages; and

not extract all other SEI network abstraction layer (NAL) units that contain non-MCTS-nested SEI messages from the original bitstream, such that the MCTS sub-bitstream does not include the other SEI NAL units that contain the non-MCTS-nested SEI messages, regardless of a value of a NAL unit header layer identifier value for the non-MCTS-nested SEI messages.

7. The device of claim 6 , wherein the one or more processors are further configured to determine that all slice segments of the MCTS sub-bitstream containing one or more tiles belonging to respective MCTSs of the video data depend at most on slice segments within the same MCTS.

8. The device of claim 6 , wherein the one or more processors are further configured to:

determine that an access unit of the sub-bitstream includes the MCTS-EIS SEI message; and

decode an MCTS nesting SEI message of the access unit in response to the determination that the access unit includes the MCTS-EIS SEI message.

9. The device of claim 6 , wherein the one or more processors are further configured to:

determine that an access unit of the sub-bitstream includes the MCTS-EIS SEI message; and

in response to the determination that the access unit includes the MCTS-EIS SEI message:

determine a set of associated pictures of the MCTS-EIS SEI message;

determine whether a current picture of the access unit is included in the set of associated pictures; and

code an MCTS nesting SEI message of the access unit only when the current picture is included in the set of associated pictures.

10. The device of claim 6 , wherein the one or more processors are further configured to:

pass the MCTS sub-bitstream to a video decoder.

11. The device of claim 6 , further comprising a display configured to display the video data.

12. A device for processing video data, the device comprising:

means for determining to extract a motion constrained tile sets (MCTS) sub-bitstream from an original bitstream based at least in part on information of an MCTS extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message; and

means for extracting the MCTS sub-bitstream from the original bitstream, wherein the means for extracting the MCTS sub-bitstream comprises:

means for extracting one or more MCTS-nested SEI messages from the original bitstream and adding the one or more MCTS-nested SEI messages to the MCTS sub-bitstream to cause the MCTS sub-bitstream to include the one or more MCTS-nested SEI messages, wherein

the means for extracting is configured not to extract all other SEI network abstraction layer (NAL) units that contain non-MCTS-nested SEI messages from the original bitstream, such that the MCTS sub-bitstream does not include the other SEI NAL units that contain the non-MCTS-nested SEI messages, regardless of a value of a NAL unit header layer identifier value for the non-MCTS-nested SEI messages.

13. The device of claim 12 , further comprising means for determining that all slice segments of the MCTS sub-bitstream containing one or more tiles belonging to respective motion constrained tile sets (MCTS) of the video data depend at most on slice segments within the same MCTS.

14. The device of claim 12 , further comprising:

means for determining that an access unit of the sub-bitstream includes the MCTS-EIS SEI message; and

means for decoding an MCTS nesting SEI message of the access unit in response to the determination that the access unit includes the MCTS-EIS SEI message.

15. The device of claim 12 , further comprising:

means for determining that an access unit of the sub-bitstream includes the MCTS-EIS SEI message;

means for determining a set of associated pictures of the MCTS-EIS SEI message in response to the determination that the access unit includes the MCTS-EIS SEI message;

means for determining whether a current picture of the access unit is included in the set of associated pictures in response to the determination that the access unit includes the MCTS-EIS SEI message; and

means for coding an MCTS nesting SEI message of the access unit only when the current picture is included in the set of associated pictures in response to the determination that the access unit includes the MCTS-EIS SEI message.

16. The device of claim 12 , further comprising:

means for passing the extracted MCTS sub-bitstream to a video decoder.

17. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor to:

determine to extract a motion constrained tile sets (MCTS) sub-bitstream from an original bitstream based at least in part on information of an MCTS extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message; and

in response to determining to extract the MCTS sub-bitstream, extract the MCTS sub-bitstream from the original bitstream, wherein the instructions that cause the processor to extract the MCTS sub-bitstream comprise instructions that cause the processor to:

extract one or more MCTS-nested SEI messages from the original bitstream and adding the one or more MCTS-nested SEI messages to the MCTS sub-bitstream to cause the MCTS sub-bitstream to include the one or more MCTS-nested SEI messages; and

not extract all other SEI network abstraction layer (NAL) units that contain non-MCTS-nested SEI messages from the original bitstream, such that the MCTS sub-bitstream does not include the other SEI NAL units that contain the non-MCTS-nested SEI messages, regardless of a value of a NAL unit header layer identifier value for the non-MCTS-nested SEI messages.

18. The non-transitory computer-readable storage medium of claim 17 , further comprising instructions that cause the processor to determine that all slice segments of the MCTS sub-bitstream containing one or more tiles belonging to respective motion constrained tile sets (MCTS) of the video data depend at most on slice segments within the same MCTS.

19. The non-transitory computer-readable storage medium of claim 17 , further comprising instructions that cause the processor to:

determine that an access unit of the sub-bitstream includes an MCTS extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message; and

decode an MCTS nesting SEI message of the access unit in response to the determination that the access unit includes the MCTS-EIS SEI message.

20. The non-transitory computer-readable storage medium of claim 17 , further comprising instructions that cause the processor to:

determine that an access unit of the sub-bitstream includes the MCTS-EIS SEI message; and

in response to the determination that the access unit includes the MCTS-EIS SEI message:

determine a set of associated pictures of the MCTS-EIS SEI message;

determine whether a current picture of the access unit is included in the set of associated pictures; and

code an MCTS nesting SEI message of the access unit only when the current picture is included in the set of associated pictures.

21. The non-transitory computer-readable storage medium of claim 17 , further comprising instructions that cause the processor to:

pass the extracted MCTS sub-bitstream to a video decoder.