SUPPLEMENTAL ENHANCEMENT INFORMATION INCLUDING CONFIDENCE LEVEL AND MIXED CONTENT INFORMATION
This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.
1 . A method performed by an encoder device, comprising:
encoding one or more pictures in a bitstream or bitstream portion, wherein the encoding includes encoding in the bitstream or bitstream portion one or more syntax elements for identifying a source scan type for the one or more pictures, the one or more syntax elements having at least a state indicating that the one or more pictures are of an interlaced scan type, a state indicating that the one or more pictures are of a progressive scan type, and a state indicating that the one or more pictures are of an unknown source scan type; and
outputting the bitstream or bitstream portion.
2 . The method of claim 1 , wherein the one or more syntax elements comprise a first flag indicating whether the one or more pictures are of an interlaced scan type and a second flag indicating whether the one or more pictures are of a progressive scan type.
3 . The method of claim 1 , wherein the one or more syntax elements comprise a single syntax element.
4 . The method of claim 1 , wherein the one or more syntax elements comprise a first flag indicating whether the one or more pictures are of a progressive scan type and a second syntax element of one or more bits indicating a confidence level of the value of the first flag.
5 . The method of claim 1 , wherein the encoding further comprises encoding a duplicate picture flag indicating whether one or more of the pictures are duplicate pictures.
6 . The method of claim 1 , wherein the encoding further comprises encoding a mixed data flag indicating whether one or more of the pictures includes a mixture of scan types.
7 . A method performed by a decoder device, comprising:
receiving one or more pictures in a bitstream or bitstream portion, the bitstream or bitstream further including one or more syntax elements for identifying a source scan type for the one or more pictures, the one or more syntax elements having at least a state indicating that the one or more pictures are of an interlaced scan type, a state indicating that the one or more pictures are of a progressive scan type, and a state indicating that the one or more pictures are of an unknown source scan type;
decoding the one or more pictures; and
processing the decoded one or more pictures in accordance with the source scan type identified in the one or more syntax elements.
8 . The method of claim 7 , wherein the one or more syntax elements comprise a first flag indicating whether the one or more pictures are of an interlaced type and a second flag indicating whether the one or more pictures are of a progressive type.
9 . The method of claim 7 , wherein the one or more syntax elements comprise a single syntax element.
10 . The method of claim 7 , wherein the one or more syntax elements comprise a first flag indicating whether the one or more pictures are of a progressive type and a second syntax element of one or more bits indicating a confidence level of the value of the first flag.
11 . The method of claim 7 , wherein the bitstream or bitstream portion further comprises a duplicate picture flag indicating whether one or more of the pictures are duplicate pictures.
12 . The method of claim 7 , wherein the bitstream or bitstream portion further comprises a mixed data flag indicating whether one or more of the pictures include a mixture of video types.
13 . A tangible computer-readable media storing computer-executable instructions for causing a computing device to perform a method, the method comprising:
encoding a picture in a bitstream or bitstream portion, wherein the encoding includes encoding in the bitstream or bitstream portion a message comprising a source indicator and a confidence level indicator, the source indicator indicating whether the picture is encoded as an interlaced-scan picture or a progressive-scan picture, the confidence level indicator indicating a level of certainty that the source indicator is accurate; and
outputting the bitstream or bitstream portion.
14 . The tangible computer-readable media of claim 13 , wherein the message further comprises one or more of a duplicate picture flag indicating whether the picture is a duplicate picture or a mixed data flag indicating whether the picture includes a mixture of video types.
15 . The tangible computer-readable media of claim 13 , wherein the confidence level indicator includes two or more confidence levels.
16 . The tangible computer-readable media of claim 15 , wherein the confidence level indicator includes four confidence levels, a first of the confidence levels signaling that the source indicator is accurate, a second of the confidence levels signaling that the source indicator is likely accurate, a third of the confidence level indicating that the source indicator is likely not accurate, and a fourth of the confidence levels indicating that the source indicator is not accurate.
17 . A tangible computer-readable media storing computer-executable instructions for causing a computing device to perform a method, the method comprising:
receiving a bitstream or bitstream portion comprising encoded data for a picture, the encoded data including a message that comprises a source format indicator that indicates whether the picture is an interlaced-scan picture or a progressive-scan picture and a confidence level indicator that indicates a level of certainty that the source format indicator is accurate;
decoding the picture; and
processing the picture in accordance with a source format indicated by the message.
18 . The tangible computer-readable media of claim 17 , wherein the message further comprises one or more of a duplicate picture flag indicating whether the picture is a duplicate picture or a mixed data flag indicating whether the picture includes a mixture of video types.
19 . The tangible computer-readable media of claim 17 , wherein the confidence level indicator includes two or more confidence levels.
20 . The tangible computer-readable media of claim 19 , wherein the confidence level indicator includes four confidence levels, a first of the confidence levels signaling that the source indicator is accurate, a second of the confidence levels signaling that the source indicator is likely accurate, a third of the confidence level indicating that the source indicator is likely not accurate, and a fourth of the confidence levels indicating that the source indicator is not accurate.