Advanced video data stream extraction and multi-resolution video transmission
A concept for a video data stream extraction is presented which is more efficient namely which is, for example, able to more efficiently deal with video content of a type unknown to the recipient with videos of different type differing, for instance, in view-port-to-picture-plane projection, etc., or which lessens the extraction process complexity. Further, a concept is described using which a juxtaposition of different versions of a video scene, the versions differing in scene resolution, may be provided more efficiently to a recipient.
1. A non-transitory digital storage medium storing a video data stream comprising
a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice is located which the respective slice portion has encoded thereinto;
extraction information indicating how to extract from the video data stream a reduced video data stream having encoded thereinto a spatially smaller video corresponding to a spatial section of the video by confining the video data stream to slice portions having encoded thereinto any slice within the spatial section and amending the slice address so as to relate to a decreased picture area of the spatially smaller video, the extraction information comprising
a first information defining the spatial section within the picture area, wherein none of the plurality of slices crosses borders of the spatial section; and
a second information signalling explicitly, as to how to amend the slice address of the slice portion of each slice within the spatial section so as to indicate, within the reduced video data stream, the location where, in the decreased picture area, the respective slice is located.
2. The video data stream according to claim 1 , wherein the first information defines the spatial section within the picture area as being composed of a set of at least two sectional regions within each of which the video is encoded into the video data stream independent from outside the respective sectional region, wherein none of the plurality of slices crosses borders of any of the at least two sectional regions.
3. The video data stream according to claim 2 , wherein
a first option of the plurality of options indicates that the video is a panoramic video showing a scene in a manner where different edge portions of the picture scenically abut each other and
a second option of the plurality of options indicates that the different edge portions do not scenically abut each other,
wherein the at least two sectional region form first and second zones which neighbor different ones of the different edge portions,
so that,
in case of the second information signaling the first option, the decreased picture area is composed by putting together the set of at least two sectional regions so that the first and second zones abut along the different edge portions and,
in case of the second information signaling the second option, the decreased picture area is composed by putting together the set of at least two sectional regions with the first and second zones having the different edge portions facing away from each other.
4. The video data stream according to claim 2 , wherein
the second information signals how to re-sort the slice portions of slices within the spatial section in extracting the reduced video data stream from the video data stream relative to how the slice portions are ordered in the sequence of slice portions of the video data stream, and
the slice address of each slice portion of the sequence of slice portions of the video data stream one-dimensionally indexes a position of a coding start of the slice encoded into the respective slice portion along a first coding scan order which traverses the picture area and along which the picture has been coded into the sequence of slice portions of the video data stream so that
the slice address of the slice portions of the sequence of slice portions within the video data stream monotonically increases, and
the amending the slice address in the extraction of the reduced video data stream from the video data stream is defined by sequentially placing the slices encoded into the slice portions to which the reduced video data stream is confined and which are re-reordered as signaled by the second information, along a second coding scan order which traverses the decreased picture area and setting the slice address of the slice portions to index the position of the coding start of the slices measured along the second coding scan order.
5. The video data stream according to claim 4 , wherein the first coding scan order traverses the picture area within each of the set of at least two sectional regions in a manner congruent to how the respective spatial region is traversed by the second coding scan order.
6. The video data stream according to claim 4 , wherein each of the set of at least two sectional regions is indicated by the first information as a subarray of rectangular tiles into rows and columns of which the picture is subdivided, wherein the first and second coding scan orders uses a row-wise tile raster scan with traversing a current tile completely before proceeding with a next tile.
7. The non-transitory digital storage medium according to claim 1 , wherein the second information signals, for each of at least a subset of the slice portions having any of the slices within the spatial section encoded thereinto, a substitute for the slice address.
8. The non-transitory digital storage medium according to claim 7 , wherein the slice address of each slice portion of the sequence of slice portions of the video data stream relates to the video's picture area, and the substitute for the slice address relates to the decreased picture area.
9. The video data stream according to claim 6 , wherein the slice address of each slice portion of the sequence of slice portions of the video data stream one-dimensionally indexes a position of a coding start of the slice encoded into the respective slice portion along a first coding scan order which traverses the picture area and along which the picture has been coded into the sequence of slice portions of the video data stream, and the substitute for the slice address one-dimensionally indexes the position of the coding start along a second coding scan order which traverses the decreased picture area.
10. The non-transitory digital storage medium according to claim 7 , wherein the subset of the slice portions excludes a first slice portion of the slice portions of the sequence of slice portions having any of the slices within the spatial section encoded thereinto, and wherein the second information sequentially provides a substitute for each of the subset of the slice portions following an order at which the slice portions occur in the video data stream.
11. The non-transitory digital storage medium according to claim 7 , wherein the first information defines the spatial section within the picture area as being composed of a set of at least two sectional regions within each of which the video is encoded into the video data stream independent from outside the respective sectional region, wherein none of the plurality of slices crosses borders of any of the first and second sectional regions.
12. The non-transitory digital storage medium according to claim 11 , wherein the subset of the slice portions comprises all slice portions of the sequence of slice portions having any of the slices within the spatial section encoded thereinto, and wherein the second information sequentially provides a substitute for each of the slice portions following an order at which the slice portions occur in the video data stream.
13. The non-transitory digital storage medium according to claim 12 , wherein
the second information further signals how to re-sort the slice portions of slices within the spatial section in extracting the reduced video data stream from the video data stream relative to how the slice portions are ordered in the sequence of slice portions of the video data stream, and
the second information sequentially provides a substitute for each of the subset of the slice portions following an order at which the slice portions occur in the reduced video data stream as resorted.
14. The non-transitory digital storage medium according to claim 1 , wherein
the sequence of slice portions comprised by the video data stream comprises slice portions having encoded thereinto a slice within the spatial section and slice portions having encoded thereinto a slice external to the spatial section, or
the sequence of slice portions comprised by the video data stream comprise slice portions having encoded thereinto a slice within the spatial section, but is free of slice portions having encoded thereinto a slice external to the spatial section.
15. The video data stream according to claim 1 , wherein the second information defines a shape and size of the decreased picture area.
16. The video data stream according to claim 1 , wherein the first information defines a shape and size of the decreased picture area by way of a size parameter in a parameter set substitute ought to be used to substitute a corresponding parameter set in the video data stream in the extracting from the video data stream the reduced video data stream.
17. An apparatus for generating a video data stream configured to
provide the video data stream with a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice which the respective slice portion has encoded thereinto is located;
provide the video data stream with extraction information indicating how to extract from the video data stream a reduced video data stream having encoded thereinto a spatially smaller video corresponding to a spatial section of the video by confining the video data stream to slice portions having encoded thereinto any slice within the spatial section and amending the slice address so as to relate to a decreased picture area of the spatially smaller video, the extraction information comprising
a first information defining the spatial section within the picture area within which the video is encoded into the video data stream independent from outside the spatial section, wherein none of the plurality of slices crosses borders of the spatial section; and
a second information explicitly signaling, as to how to amend the slice address of the slice portion of each slice within the spatial section so as to indicate, within the reduced video data stream, the location where, in the decreased picture area, the respective slice is located.
18. An apparatus for extracting from a video data stream having encoded thereinto the video a reduced video data stream having encoded thereinto a spatially smaller video, the video data stream comprising a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice which the respective slice portion has encoded thereinto is located, wherein the apparatus is configured to
read extraction information from the video data stream,
derive from the extraction information a spatial section within the picture area, wherein none of the plurality of slices crosses borders of the spatial section, and wherein the reduced video data stream is confined to slice portions having encoded thereinto any slice within the spatial section,
amend the slice address of the slice portion of each slice within the spatial section using
an explicit signaling of
the extraction information, so as to which indicates, within the reduced video data stream, the location where, in a decreased picture area of the spatially smaller video, the respective slice is located.
19. A method for generating a video data stream comprising
provide the video data stream with a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice which the respective slice portion has encoded thereinto is located;
provide the video data stream with extraction information indicating how to extract from the video data stream a reduced video data stream having encoded thereinto a spatially smaller video corresponding to a spatial section of the video by confining the video data stream to slice portions having encoded thereinto any slice within the spatial section and amending the slice address so as to relate to a decreased picture area of the spatially smaller video, the extraction information comprising
a first information defining the spatial section within the picture area within which the video is encoded into the video data stream independent from outside the spatial section, wherein none of the plurality of slices crosses borders of the spatial section; and
a second information explicitly signaling, as to how to amend the slice address of the slice portion of each slice within the spatial section so as to indicate, within the reduced video data stream, the location where, in the decreased picture area, the respective slice is located.
20. A method for extracting from a video data stream having encoded thereinto the video a reduced video data stream having encoded thereinto a spatially smaller video, the video data stream comprising a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice which the respective slice portion has encoded thereinto is located, wherein the method comprises
read extraction information from the video data stream,
derive from the extraction information a spatial section within the picture area, wherein none of the plurality of slices crosses borders of the spatial section, and wherein the reduced video data stream is confined to slice portions having encoded thereinto any slice within the spatial section,
amend the slice address of the slice portion of each slice within the spatial section using
an explicit signaling of
the extraction information, which indicates, within the reduced video data stream, the location where, in a decreased picture area of the spatially smaller video, the respective slice is located.
21. A non-transitory digital storage medium having a computer program stored thereon to perform the method for generating a video data stream comprising
provide the video data stream with a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice which the respective slice portion has encoded thereinto is located;
provide the video data stream with extraction information indicating how to extract from the video data stream a reduced video data stream having encoded thereinto a spatially smaller video corresponding to a spatial section of the video by confining the video data stream to slice portions having encoded thereinto any slice within the spatial section and amending the slice address so as to relate to a decreased picture area of the spatially smaller video, the extraction information comprising
a first information defining the spatial section within the picture area within which the video is encoded into the video data stream independent from outside the spatial section, wherein none of the plurality of slices crosses borders of the spatial section; and
a second information explicitly signaling, as to how to amend the slice address of the slice portion of each slice within the spatial section so as to indicate, within the reduced video data stream, the location where, in the decreased picture area, the respective slice is located,
when said computer program is run by a computer.
22. A non-transitory digital storage medium having a computer program stored thereon to perform the method for extracting from a video data stream having encoded thereinto the video a reduced video data stream having encoded thereinto a spatially smaller video, the video data stream comprising a sequence of slice portions, each slice portion having encoded thereinto a respective slice of a plurality of slices of a picture of a video, wherein each slice portion comprises a slice address indicating a location where, in a picture area of the video, the slice which the respective slice portion has encoded thereinto is located, wherein the method comprises
read extraction information from the video data stream,
derive from the extraction information a spatial section within the picture area, wherein none of the plurality of slices crosses borders of the spatial section, and wherein the reduced video data stream is confined to slice portions having encoded thereinto any slice within the spatial section,
amend the slice address of the slice portion of each slice within the spatial section using
an explicit signaling of
the extraction information which indicates, within the reduced video data stream, the location where, in a decreased picture area of the spatially smaller video, the respective slice is located,
when said computer program is run by a computer.