Supplemental enhancement information including confidence level and mixed content information
This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.
1 . In a computer system that implements a video encoder, a method comprising:
encoding video content, thereby producing encoded data, wherein the encoding the video content includes setting multiple syntax elements that indicate one of multiple possible options for a scan type for the video content and degree of confidence in the scan type for the video content, and wherein each of the multiple possible options can be indicated with the multiple syntax elements, the multiple possible options including:
(1) the scan type of the video content is progressive, and following the scan type of the video content is recommended;
(2) the scan type of the video content is interlaced, and following the scan type of the video content is recommended;
(3) the scan type of the video content is not indicated with certainty; and
(4) the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content, and following the scan type of the video content is recommended; and
outputting the encoded data in at least part of a bitstream, the encoded data including, in a syntax structure, the multiple syntax elements that indicate the one of the multiple possible options, the multiple syntax elements that indicate the one of the multiple possible options being different than one or more other syntax elements that indicate whether pictures of the video content are fields or frames.
2 . The method of claim 1 , wherein the multiple syntax elements include a flag that indicates whether the scan type of the video content is progressive.
3 . The method of claim 1 , wherein the multiple syntax elements include a flag that indicates whether the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content.
4 . The method of claim 1 , wherein the multiple syntax elements include:
a flag that indicates whether the scan type of the video content is progressive; and
a flag that indicates whether the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content.
5 . The method of claim 1 , wherein the multiple syntax elements include a syntax element that indicates the degree of confidence in the source indication for the video content.
6 . The method of claim 1 , wherein the syntax structure is video usability information.
7 . The method of claim 1 , wherein the syntax structure is a supplemental enhancement information message.
8 . A computer system comprising one or more processing units and memory, wherein the computer system implements a video decoder configured to perform operations comprising:
receiving encoded data in at least part of a bitstream, the encoded data including, in a syntax structure, multiple syntax elements that indicate one of multiple possible options for a scan type for the video content and degree of confidence in the scan type for the video content, wherein each of the multiple possible options can be indicated with the multiple syntax elements, the multiple possible options including:
(1) the scan type of the video content is progressive, and following the scan type of the video content is recommended;
(2) the scan type of the video content is interlaced, and following the scan type of the video content is recommended;
(3) the scan type of the video content is not indicated with certainty; and
(4) the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content, and following the scan type of the video content is recommended; and
decoding the encoded data to reconstruct the video content, wherein the decoding the encoded data includes parsing the multiple syntax elements that indicate the one of multiple possible options, the multiple syntax elements that indicate the one of the multiple possible options being different than one or more other syntax elements that indicate whether pictures of the video content are fields or frames.
9 . The computer system of claim 8 , wherein the multiple syntax elements include a flag that indicates whether the scan type of the video content is progressive.
10 . The computer system of claim 8 , wherein the multiple syntax elements include a flag that indicates whether the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content.
11 . The computer system of claim 8 , wherein the multiple syntax elements include:
a flag that indicates whether the scan type of the video content is progressive; and
a flag that indicates whether the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content.
12 . The computer system of claim 8 , wherein the multiple syntax elements include a syntax element that indicates the degree of confidence in the source indication for the video content.
13 . The computer system of claim 8 , wherein the syntax structure is video usability information.
14 . The computer system of claim 8 , wherein the syntax structure is a supplemental enhancement information message.
15 . One or more non-transitory computer-readable media having stored thereon encoded data in at least part of a bitstream, the encoded data including, in a syntax structure, multiple syntax elements that indicate one of multiple possible options for a scan type for the video content and degree of confidence in the scan type for the video content, wherein each of the multiple possible options can be indicated with the multiple syntax elements, the multiple possible options including:
(1) the scan type of the video content is progressive, and following the scan type of the video content is recommended;
(2) the scan type of the video content is interlaced, and following the scan type of the video content is recommended;
(3) the scan type of the video content is not indicated with certainty; and
(4) the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content, and following the scan type of the video content is recommended;
wherein the encoded data is organized to facilitate, with a video decoder implemented in a computer system comprising one or more processing units and memory, decoding the encoded data to reconstruct the video content, wherein the decoding the encoded data includes parsing the multiple syntax elements that indicate the one of multiple possible options, the multiple syntax elements that indicate the one of the multiple possible options being different than one or more other syntax elements that indicate whether pictures of the video content are fields or frames.
16 . The one or more computer-readable media of claim 15 , wherein the multiple syntax elements include a flag that indicates whether the scan type of the video content is progressive.
17 . The one or more computer-readable media of claim 15 , wherein the multiple syntax elements include a flag that indicates whether the scan type of the video content is progressive for some of the video content and is interlaced for some of the video content.
18 . The one or more computer-readable media of claim 15 , wherein the multiple syntax elements include a syntax element that indicates the degree of confidence in the source indication for the video content.
19 . The one or more computer-readable media of claim 15 , wherein the syntax structure is video usability information.
20 . The one or more computer-readable media of claim 15 , wherein the syntax structure is a supplemental enhancement information message.