Encoding a transparency (alpha) channel in a video bitstream
View Patent ↗Disclosed herein is a technique for delimiting the alpha channel at the NAL layer in codecs like H.264 to facilitate the optional nature of the alpha channel. In coded video sequences that include alpha, there is one alpha picture for every primary coded (e.g., luma-chroma) picture, and the coded alpha picture is contained in the same access unit as its corresponding primary coded picture. The alpha coded slice NAL units of each access unit are sent after the NAL units of the primary coded picture and redundant coded pictures, if any. The presence or absence of the alpha NAL units does not affect the decoding of the remaining NAL units in any way.
1. A method of transmitting image data for a composite image, wherein the transmitted data includes at least a foreground image and a transparency mask, the method comprising:
encoding, by a video codec device, the foreground image;
encoding, by the video codec device, the transparency mask;
transmitting, by the video codec device, an image data stream comprising one or more syntax structures corresponding to the encoded foreground image and one or more syntax structures corresponding to the encoded transparency mask, wherein the one or more syntax structures corresponding to the transparency mask are delimited from and are located after the syntax structures corresponding to the foreground image in the data stream.
2. The method of claim 1 wherein the image data is encoded according to ITU Recommendation H.264.
3. The method of claim 2 wherein the image data stream is in a NAL unit format.
4. The method of claim 3 wherein the image data stream is in a byte stream format.
5. The method of claim 1 wherein there is one and only one transparency mask for each foreground image.
6. The method of claim 1 , wherein the video codec device comprises hardware and software.
7. A method of receiving and processing an image data stream, the method comprising:
receiving, by a video codec device, an image data stream comprising one or more syntax structures corresponding to an encoded foreground image and one or more syntax structures corresponding to an encoded transparency mask, wherein the one or more syntax structures corresponding to the transparency mask are delimited from and are located after the syntax structures corresponding to the foreground image in the data stream;
decoding, by the video codec device, the syntax structures corresponding to the encoded foreground image;
decoding, by the video codec device, the syntax structures corresponding to the transparency mask; and
computing, by the video codec device, a displayed image as a function of the decoded foreground image and the decoded transparency mask.
8. The method of claim 7 wherein the image data stream is encoded according to ITU Recommendation H.264.
9. The method of claim 8 wherein the image data stream is in a NAL unit format.
10. The method of claim 9 wherein the image data stream is in a byte stream format.
11. The method of claim 10 wherein there is one and only one transparency mask for each foreground image.
12. The method of claim 10 wherein computing a displayed image as a function of the decoded foreground image and the decoded transparency mask further comprises computing the displayed image as a function of a background image.
13. The method of claim 12 wherein the background image is received separately from the foreground image and transparency mask.
14. The method of claim 12 wherein the background image is created at a decoder and is not received.
15. The method of claim 7 , wherein the video codec device comprises hardware and software.
16. A method of receiving and processing an image data stream, the method comprising:
receiving, by a video codec device, an image data stream comprising one or more syntax structures corresponding to an encoded foreground image and one or more syntax structures corresponding to an encoded transparency mask, wherein the one or more syntax structures corresponding to the transparency mask are delimited from and are located after the syntax structures corresponding to the foreground image in the data stream;
decoding, by the video codec device, the syntax structures corresponding to the encoded foreground image;
discarding, by the video codec device, the syntax structures corresponding to the transparency mask; and
computing, by the video codec device, a displayed image as a function of the decoded foreground image and not as a function of the discarded transparency mask.
17. The method of claim 16 wherein the image data is encoded according to ITU Recommendation H.264.
18. The method of claim 17 wherein the image data stream is in a NAL unit format.
19. The method of claim 18 wherein the image data stream is in a byte stream format.
20. The method of claim 16 wherein there is one and only one transparency mask for each foreground image.
21. The method of claim 16 , wherein the video codec device comprises hardware and software.