Constraints and unit types to simplify video random access
Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.
1 . In a computer system that implements a video encoder, a method comprising:
generating at least a portion of a bitstream comprising encoded data for plural pictures, the plural pictures comprising a random access point (RAP) picture, one or more associated potentially non-decodable leading pictures, and one or more non-leading pictures associated with the RAP picture, the RAP picture being at a bitstream order position after an initial picture of the bitstream, the at least a portion of the bitstream further comprising an indication signaling that the RAP picture is a picture from which a video decoder can begin decoding, wherein the generating the at least a portion of the bitstream includes ordering the one or more leading pictures and the one or more non-leading pictures associated with the RAP picture such that all of the one or more leading pictures precede, in decoding order, the one or more non-leading pictures associated with the RAP picture; and
outputting the at least a portion of the bitstream.
2 . The computer-readable storage medium of claim 1 , wherein the indication signaling that the RAP picture is a picture from which a video decoder can begin decoding is a syntax element signaling that the RAP picture is one of a plurality of RAP picture types.
3 . The computer-readable storage medium of claim 2 , wherein the plurality of RAP picture types include a broken link access (BLA) picture type and a clean random access (CRA) picture type.
4 . The computer-readable storage medium of claim 2 , wherein the syntax element indicates a network abstraction layer (NAL) unit type value for a NAL unit that includes at least some encoded data for the RAP picture.
5 . The computer-readable storage medium of claim 1 , wherein the method further comprises:
receiving the at least a portion of a bitstream; and
decoding the RAP picture such that decoding begins at the RAP picture.
6 . The computer-readable storage medium of claim 1 , wherein the at least a portion of the bitstream further includes, for each of the one or more potentially non-decodable leading pictures, an indication that the potentially non-decoding leading picture is a random access skipped leading (RASL) picture.
7 . The computer-readable storage medium of claim 6 , wherein the indication that the potentially non-decoding leading picture is a RASL picture is a syntax element that indicates a network abstraction layer (NAL) unit type value for a NAL unit that includes at least some encoded data for the RASL picture.
8 . The computer-readable storage medium of claim 1 , wherein the one or more leading pictures are potentially non-decodable when decoding begins at the RAP picture due to missing reference pictures for the one or more leading pictures when decoding begins at the RAP picture.
9 . A computer system comprising one or more processing units and memory, wherein the computer system implements a video decoder configured to perform operations comprising:
receiving at least a portion of a bitstream comprising encoded data for plural pictures, the plural pictures comprising a random access point (RAP) picture, one or more associated potentially non-decodable leading pictures, and one or more non-leading pictures associated with the RAP picture, the RAP picture being at a bitstream order position after an initial picture of the bitstream, the at least a portion of the bitstream further comprising an indication signaling that the RAP picture is a picture from which the video decoder can begin decoding, the at least a portion of the bitstream having been generated by operations that include ordering the one or more leading pictures and the one or more non-leading pictures associated with the RAP picture such that all of the one or more leading pictures precede, in decoding order, the one or more non-leading pictures associated with the RAP picture; and
decoding the at least a portion of the bitstream.
10 . The method of claim 9 , wherein the indication signaling that the RAP picture is a picture from which the video decoder can begin decoding is a syntax element signaling that the RAP picture is one of a plurality of RAP picture types.
11 . The method of claim 10 , wherein the plurality of RAP picture types include a broken link access (BLA) picture type and a clean random access (CRA) picture type.
12 . The method of claim 10 , wherein the syntax element indicates a network abstraction layer (NAL) unit type value for a NAL unit that includes at least some encoded data for the RAP picture.
13 . The method of claim 9 , wherein the decoding the at least a portion of the bitstream includes:
decoding the RAP picture such that decoding begins at the RAP picture; and
discarding the one or more non-leading pictures associated with the RAP picture.
14 . The method of claim 9 , wherein the decoding the at least a portion of the bitstream includes:
decoding the RAP picture such that decoding does not begin at the RAP picture; and
decoding the one or more non-leading pictures associated with the RAP picture.
15 . The method of claim 9 , wherein the at least a portion of the bitstream further includes, for each of the one or more potentially non-decodable leading pictures, an indication that the potentially non-decoding leading picture is a random access skipped leading (RASL) picture.
16 . The method of claim 15 , wherein the indication that the potentially non-decoding leading picture is a RASL picture is a syntax element that indicates a network abstraction layer (NAL) unit type value for a NAL unit that includes at least some encoded data for the RASL picture.
17 . The method of claim 9 , wherein the one or more leading pictures are potentially non-decodable when decoding begins at the RAP picture due to missing reference pictures for the one or more leading pictures when decoding begins at the RAP picture.
18 . In a computer system, a method comprising:
receiving at least a portion of a bitstream comprising encoded data for plural pictures, the plural pictures comprising a random access point (RAP) picture, one or more associated potentially non-decodable leading pictures, and one or more non-leading pictures associated with the RAP picture, the RAP picture being at a bitstream order position after an initial picture of the bitstream, the at least a portion of the bitstream further comprising an indication signaling that the RAP picture is a picture from which a video decoder can begin decoding, the at least a portion of the bitstream having been generated by operations that include ordering the one or more leading pictures and the one or more non-leading pictures associated with the RAP picture such that all of the one or more leading pictures precede, in decoding order, the one or more non-leading pictures associated with the RAP picture; and
storing, in memory or storage, the at least a portion of a bitstream, the encoded data being organized to facilitate decoding, with the video decoder, by operations that include:
receiving the at least a portion of the bitstream; and
decoding the at least a portion of the bitstream.
19 . The method of claim 18 , wherein the indication signaling that the RAP picture is a picture from which the video decoder can begin decoding is a syntax element signaling that the RAP picture is one of a plurality of RAP picture types, the syntax element indicating a network abstraction layer (NAL) unit type value for a NAL unit that includes at least some encoded data for the RAP picture.
20 . The method of claim 18 , wherein the bitstream further includes, for each of the one or more potentially non-decodable leading pictures, an indication that the potentially non-decoding leading picture is a random access skipped leading (RASL) picture, and wherein the indication that the potentially non-decoding leading picture is a RASL picture is a syntax element that indicates a network abstraction layer (NAL) unit type value for a NAL unit that includes at least some encoded data for the RASL picture.