Syntax and semantics for buffering information to simplify video splicing
Innovations in syntax and semantics of coded picture buffer removal delay (“CPBRD”) values potentially simplify splicing operations. For example, a video encoder sets a CPBRD value for a current picture that indicates an increment value relative to a nominal coded picture buffer removal time of a preceding picture in decoding order, regardless of whether the preceding picture has a buffering period SEI message. The encoder can signal the CPBRD value according to a single-value approach in which a flag indicates how to interpret the CPBRD value, according to a two-value approach in which another CPBRD value (having a different interpretation) is also signaled, or according to a two-value approach that uses a flag and a delta value. A corresponding video decoder receives and parses the CPBRD value for the current picture. A splicing tool can perform simple concatenation operations to splice bitstreams using the CPBRD value for the current picture.
1. In a computer system that implements a video decoder, a method comprising:
receiving encoded data for pictures of a video sequence, the encoded data including:
a picture timing supplemental enhancement information (“SEI”) message associated with a current picture among the pictures of the video sequence, the picture timing SEI message including a coded picture buffer removal delay (“CPBRD”) value for the current picture, the CPBRD value for the current picture specifying a nominal coded picture buffer (“CPB”) removal time of the current picture relative to a nominal CPB removal time of a first preceding picture in decoding order, the first preceding picture having a buffering period SEI message associated with the first preceding picture; and
a buffering period SEI message associated with the current picture, the buffering period SEI message including a concatenation flag and a CPBRD delta value, wherein the concatenation flag has a given value, and wherein the CPBRD delta value indicates a difference between the CPBRD value for the current picture and a CPBRD value for a second preceding picture in decoding order, the second preceding picture lacking a buffering period SEI message associated with the second preceding picture; and
decoding the encoded data, including parsing the picture timing SEI message associated with the current picture and parsing the buffering period SEI message associated with the current picture, wherein the CPBRD delta value enables the video decoder, using the CPBRD delta value and based on the concatenation flag having the given value, to detect loss of encoded data for the second preceding picture.
2. The method of claim 1 , wherein the CPBRD delta value is signaled in the buffering period SEI message associated with the current picture as a syntax element representing the CPBRD delta value minus 1.
3. The method of claim 1 , wherein the CPBRD value for the current picture is signaled in the picture timing SEI message as a syntax element representing the CPBRD value for the current picture minus 1.
4. The method of claim 1 , wherein the current picture is a random access picture.
5. The method of claim 1 , further comprising:
determining, based on a check indicating (a) the CPBRD value for the current picture is equal to (b) a sum based on the CPBRD value for the second preceding picture and the CPBRD delta value for the current picture, that the encoded data for the second preceding picture has not been lost.
6. The method of claim 1 , further comprising:
determining, based on a check indicating (a) the CPBRD value for the current picture is not equal to (b) a sum based on the CPBRD value for the second preceding picture and the CPBRD delta value for the current picture, that the encoded data for the second preceding picture has been lost.
7. The method of claim 1 , wherein the second preceding picture immediately precedes the current picture in decoding order.
8. The method of claim 1 , wherein:
the current picture is part of a temporal layer, and the second preceding picture immediately precedes the current picture in decoding order in the temporal layer of the current picture or a lower temporal layer; or
the second preceding picture, among pictures having a temporal identifier of zero, immediately precedes the current picture in decoding order.
9. One or more computer-readable media having stored thereon encoded data in a bitstream for pictures of a video sequence, the one or more computer-readable media being selected from the group consisting of volatile memory, non-volatile memory, magnetic disk, CD-ROM, and DVD, the encoded data being organized to facilitate decoding, by a video decoder, with operations comprising:
receiving the encoded data, the encoded data including:
a picture timing supplemental enhancement information (“SEI”) message associated with a current picture among the pictures of the video sequence, the picture timing SEI message including a coded picture buffer removal delay (“CPBRD”) value for the current picture, the CPBRD value for the current picture specifying a nominal coded picture buffer (“CPB”) removal time of the current picture relative to a nominal CPB removal time of a first preceding picture in decoding order, the first preceding picture having a buffering period SEI message associated with the first preceding picture; and
a buffering period SEI message associated with the current picture, the buffering period SEI message including a concatenation flag and a CPBRD delta value, wherein the concatenation flag has a given value, and wherein the CPBRD delta value indicates a difference between the CPBRD value for the current picture and a CPBRD value for a second preceding picture in decoding order, the second preceding picture lacking a buffering period SEI message associated with the second preceding picture; and
decoding the encoded data, including parsing the picture timing SEI message associated with the current picture and parsing the buffering period SEI message associated with the current picture, wherein the CPBRD delta value enables the video decoder, using the CPBRD delta value and based on the concatenation flag having the given value, to detect loss of encoded data for the second preceding picture.
10. The one or more computer-readable media of claim 9 , wherein the CPBRD delta value is signaled in the buffering period SEI message associated with the current picture as a syntax element representing the CPBRD delta value minus 1.
11. The one or more computer-readable media of claim 9 , wherein the CPBRD value for the current picture is signaled in the picture timing SEI message as a syntax element representing the CPBRD value for the current picture minus 1.
12. The one or more computer-readable media of claim 9 , wherein the current picture is a random access picture.
13. The one or more computer-readable media of claim 9 , wherein the second preceding picture immediately precedes the current picture in decoding order.
14. The one or more computer-readable media of claim 9 , wherein:
the current picture is part of a temporal layer, and the second preceding picture immediately precedes the current picture in decoding order in the temporal layer of the current picture or a lower temporal layer; or
the second preceding picture, among pictures having a temporal identifier of zero, immediately precedes the current picture in decoding order.
15. A computer system comprising:
a video encoder configured to encode pictures of a video sequence by performing operations, thereby producing encoded data, the operations comprising:
encoding a picture timing supplemental enhancement information (“SEI”) message associated with a current picture among the pictures of the video sequence, the picture timing SEI message including a coded picture buffer removal delay (“CPBRD”) value for the current picture, the CPBRD value for the current picture specifying a nominal coded picture buffer (“CPB”) removal time of the current picture relative to a nominal CPB removal time of a first preceding picture in decoding order, the first preceding picture having a buffering period SEI message associated with the first preceding picture; and
encoding a buffering period SEI message associated with the current picture, the buffering period SEI message including a concatenation flag and a CPBRD delta value, wherein the concatenation flag has a given value, and wherein the CPBRD delta value indicates a difference between the CPBRD value for the current picture and a CPBRD value for a second preceding picture in decoding order, the second preceding picture lacking a buffering period SEI message associated with the second preceding picture; and
a buffer configured to store the encoded data for output in a bitstream, the encoded data including the picture timing SEI message associated with the current picture and the buffering period SEI message associated with the current picture, thereby enabling a video decoder, using the CPBRD delta value and so long as the concatenation flag has the given value, to detect loss of encoded data for the second preceding picture.
16. The computer system of claim 15 , wherein the CPBRD delta value is signaled in the buffering period SEI message associated with the current picture as a syntax element representing the CPBRD delta value minus 1.
17. The computer system of claim 15 , wherein the CPBRD value for the current picture is signaled in the picture timing SEI message as a syntax element representing the CPBRD value for the current picture minus 1.
18. The computer system of claim 15 , wherein the current picture is a random access picture.
19. The computer system of claim 15 , wherein the second preceding picture immediately precedes the current picture in decoding order.
20. The computer system of claim 15 , wherein:
the current picture is part of a temporal layer, and the second preceding picture immediately precedes the current picture in decoding order in the temporal layer of the current picture or a lower temporal layer; or
the second preceding picture, among pictures having a temporal identifier of zero, immediately precedes the current picture in decoding order.