Support of full resolution graphics, menus, and subtitles in frame compatible 3D delivery
Full resolution graphic overlays (e.g., graphics, menus, arrows, buttons, captions, banners, picture in picture information) and subtitles in frame compatible 3D delivery for a scalable system are described.
1. A method for embedding subtitles and/or graphic overlays in a frame compatible 3D video encoding system comprising a 3D base layer and at least one 3D enhancement layer, the method comprising:
providing video content associated with the subtitles and/or graphic overlays separately for the 3D base layer and the at least one 3D enhancement layer;
embedding the subtitles and/or graphic overlays separately for the 3D base layer and the at least one 3D enhancement layer to the video content, wherein the subtitles and/or graphic overlays provided for the at least one 3D enhancement layer are copies of the subtitles and/or graphic overlays provided for the 3D base layer or interpolated from the subtitles and/or graphic overlays provided for the 3D base layer, and wherein the subtitles and/or graphic overlays for the 3D base layer and the at least one 3D enhancement layer are at a lower resolution; and
combining, subsequent to the embedding, the 3D base layer and the at least one 3D enhancement layer to form the video content and the subtitles and/or graphic overlays at a higher resolution than the 3D base layer resolution, wherein the subtitles and/or graphic overlays are embedded in the video content.
2. The method of claim 1 , wherein the subtitles and/or graphic overlays comprise depth information.
3. The method of claim 1 , wherein the 3D base layer is sampled according to a first sampling method and the at least one 3D enhancement layer is sampled according to a second sampling method, the method further comprising:
sampling the subtitles and/or graphic overlays for the 3D base layer according to the first sampling method; and
sampling the subtitles and/or graphic overlays for the at least one 3D enhancement layer according to the second sampling method,
wherein the second sampling method obtains samples not obtained by the first sampling method.
4. The method of claim 1 , wherein the subtitles and/or graphic overlays are provided independently for each layer.
5. The method of claim 1 , wherein:
each layer comprises at least a first view and a second view at the lower resolution,
the embedding the subtitles and/or graphic overlays separately is for the first view and the second view at each layer, and
the combining forms the first view, the second view, and the subtitles and/or graphic overlays on the first view and the second view at the higher resolution.
6. An authoring method comprising the method of claim 1 .
7. A system for embedding subtitles and/or graphic overlays in a frame compatible 3D video scalable system comprising a 3D base layer and one or more 3D enhancement layers, the 3D base layer and the at least one 3D enhancement layer comprising video content associated with the subtitles and/or graphic overlays, the system comprising:
a base layer subtitles and/or graphic overlays generator to provide base layer subtitles and/or graphic overlays at a lower resolution to the video content for the 3D base layer;
one or more enhancement layer subtitles and/or graphic overlays generators for the respective one or more enhancement layers, wherein each enhancement layer subtitles and/or graphic overlays generator provides enhancement layer subtitles and/or graphic overlays at a lower resolution to the video content for the at least one 3D enhancement layer; and
one or more combiners configured to combine the 3D base layer and the one or more 3D enhancement layers to form the video content and the subtitles and/or graphic overlays at a higher resolution than the 3D base layer resolution, wherein the subtitles and/or graphic overlays are embedded in the video content,
wherein subtitles and/or graphic overlays from the one or more enhancement layer subtitles and/or graphic overlays generators are copies of the subtitles and/or graphic overlays provided for the 3D base layer or interpolated from the subtitles and/or graphic overlays from the base layer subtitles and/or graphic overlays generator.
8. The system of claim 7 , wherein the 3D base layer comprises a base layer video decoder and the one or more 3D enhancement layers comprise respective enhancement layer video decoders and wherein:
the base layer subtitles and/or graphic overlays generator operates on a base layer graphics plane at the output of the base layer video decoder, and
each enhancement layer subtitles and/or graphic overlays generator for the one or more enhancement layers operates on an enhancement layer graphics plane at the output of a respective enhancement layer video decoder.
9. The system of claim 7 , wherein the subtitles and/or graphic overlays comprise depth information.
10. The system of claim 7 , wherein samples provided by the one or more enhancement layer subtitles and/or graphic overlays generators are different from samples provided by the base layer subtitles and/or graphic overlays generator.
11. The system of claim 7 , wherein:
each of the base layer and the one or more enhancement layers comprises at least a first view and a second view at the lower resolution, and
the one or more combiners are configured to combine the base layer and the one or more enhancement layers to form the first view, the second view, and the subtitles and/or graphic overlays on the first view and the second view at the higher resolution.
12. A method for embedding subtitles and/or graphic overlays in a frame compatible 3D video encoding system comprising a 3D base layer and at least one 3D enhancement layer, the method comprising:
providing video content associated with the subtitles and/or graphic overlays separately for the 3D base layer and the at least one 3D enhancement layer, wherein the 3D base layer is sampled according to a first sampling method and the at least one 3D enhancement layer is sampled according to a second sampling method, the method further comprising:
sampling the subtitles and/or graphic overlays for the 3D base layer according to the first sampling method; and
sampling the subtitles and/or graphic overlays for the at least one 3D enhancement layer according to the second sampling method, wherein the second sampling method obtains samples not obtained by the first sampling method;
embedding the subtitles and/or graphic overlays separately for the 3D base layer and the at least one 3D enhancement layer to the video content, wherein the subtitles and/or graphic overlays provided for the at least one 3D enhancement layer are copies of the subtitles and/or graphic overlays provided for the 3D base layer or interpolated from the subtitles and/or graphic overlays provided for the 3D base layer, and wherein the subtitles and/or graphic overlays for the 3D base layer and the at least one 3D enhancement layer are at a lower resolution; and
combining, subsequent to the embedding, the 3D base layer and the at least one 3D enhancement layer to form the video content and the subtitles and/or graphic overlays at a higher resolution than the 3D base layer resolution, wherein the subtitles and/or graphic overlays are embedded in the video content.