File format schemes allowing efficient ROI, stream access and parameter set handling
File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.
1. File format parser configured to
receive a file comprising a set of tracks onto which sub-streams of a video bitstream are distributed;
inspect descriptive data within the file whether the descriptive data indicates for a predetermined track of the set of tracks, that a parameter set present in the file for the predetermined track is to be ignored when jointly decoding sub-streams distributed onto more than the predetermined track of the set of tracks;
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set present in the file for the predetermined track are to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks, forwarding the sub-streams distributed onto the more than the predetermined track of the set of tracks to decoding without forwarding the parameter set, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set present in the file for the predetermined track are to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks, forwarding the parameters set along with the sub-streams distributed onto more than the predetermined track of the set of tracks to the decoding;
wherein
the parameter set is comprised by the predetermined track in-band within one or more sub-streams comprised by the predetermined track, and the file format parser is configured to
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set present in the predetermined track is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
strip the parameter set off the one or more sub-streams comprised by the predetermined track to yield a stripped version of the one or more sub streams comprised by the predetermined track and forward the stripped version along with one or more sub-streams comprised by any other track of the set of tracks to the decoding, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set present in the predetermined track is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding with the parameters set remaining in the one or more sub-streams comprised by the predetermined track, or
the parameter set is comprised by one or more boxes of the file and the file format parser is configured to
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding without the parameter set is, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub streams distributed onto the more than the predetermined track of the set of tracks, forward the one or more sub-streams comprised by the predetermined track
along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding and along with the parameters set present in the one or more boxes.
2. File format parser of claim 1 , configured to derive the descriptive data from a sample entry of the predetermined track.
3. File format parser of claim 1 , configured to derive the descriptive data from a track dependency box which, in addition to indicating whether the parameter set present in the file for the predetermined track are to be ignored when jointly decoding the sub-streams distributed onto the set of tracks, indicates for a further predetermined track of the set of tracks a dependency on the predetermined track.
4. File format parser of claim 1 , configured to derive the descriptive data from a sample entry of a further predetermined track of the set of tracks which is dependent on the predetermined track.
5. File format parser of claim 1 , configured to
Perform the inspection based on a type of the sample entry or based on a syntax element within a sample entry of the predetermined track.
6. File format parser of claim 1 , configured to
if the parameter set is comprised by the predetermined track in-band within the one or more sub-streams comprised by the predetermined track,
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
strip the parameter set off the one or more sub-streams comprised by the predetermined track to yield a stripped version of the one or more sub-streams comprised by the predetermined track and forward the stripped version along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding with the parameters set is remaining in the one or more sub-streams comprised by the predetermined track, and
if the parameter set is comprised by one or more boxes of the file
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding without the parameter set is, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more associated sub-streams comprised by any other track of the set of tracks to the decoding and along with the parameters set present in the one or more boxes.
7. File format parser of claim 1 , configured to
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
if the parameter set is comprised by the predetermined track in-band within the one or more sub-streams comprised by the predetermined track,
strip the parameter set off the one or more sub-streams comprised by the predetermined track to yield a stripped version of the one or more sub-streams comprised by the predetermined track and forward the stripped version along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding, and
if the parameter set is comprised by one or more boxes of the file,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding and along with the parameters set present in the one or more boxes and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
if the parameter set is comprised by the predetermined track in-band within the one or more sub-streams comprised by the predetermined track,
forward the one or more sub-streams comprised by the predetermined track along with the one or more associated sub-streams comprised by any other track of the set of tracks to the decoding with the parameters set is remaining in the one or more sub-streams comprised by the predetermined track, and
if the parameter set is comprised by one or more boxes of the file,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding and along with the parameters set present in the one or more boxes, OR
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
if the parameter set is comprised by the predetermined track in-band within the one or more sub-streams comprised by the predetermined track,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding with the parameters set is remaining in the one or more sub-streams comprised by the predetermined track, and
if the parameter set is comprised by one or more boxes of the file,
forward the one or more sub-streams comprised by the predetermined track along with the one or more associated sub-streams comprised by any other track of the set of tracks to the decoding without the parameter set is, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
if the parameter set is comprised by the predetermined track in-band within the one or more sub-streams comprised by the predetermined track,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding with the parameters set is remaining in the one or more sub-streams comprised by the predetermined track, and
if the parameter set is comprised by one or more boxes of the file,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding and along with the parameters set present in the one or more boxes.
8. File format parser of claim 6 , wherein the one or more boxes are comprised by a sample entry of the predetermined track or within a parameter set track associated with the predetermined track.
9. File format parser of claim 1 , wherein the parameter set relates to one or more of VPS, PPS, SPS and APS.
10. File format parser of claim 1 , wherein the parameter set is specified by the descriptive data in the file by NAL unit type.
11. File format parser of claim 1 , configured to derive from the descriptive data information whether no in-band parameter set is present in the file for the predetermined track or
information whether for the predetermined track in the file only parameter sets of a first set of one or more parameter set types are present in-band within the one or more sub-streams comprised by the predetermined block, while the parameter set is comprised by one or more boxes of the file and is of a parameter set type comprised by a second set of one or more parameter set types which is disjoint to the first set.
12. File format parser of claim 1 , wherein the set of tracks indicated to be linked to form the set of tracks by a assigning a common track group ID to the tracks of the set of tracks.
13. File format parser of claim 1 , configured to suppress the inspection and infer that the parameter set present in the file for the predetermined track is not to be ignored when jointly decoding the sub-streams distributed onto the set of tracks, if the predetermined track comprises at least one in band parameter set.
14. Method for processing a file, the method comprising:
receive the file, the file containing a set of tracks onto which sub-streams of a video bitstream are distributed;
inspect descriptive data within the file whether the descriptive data indicates for a predetermined track of the set of tracks, that a parameter set present in the file for the predetermined track is to be ignored when jointly decoding sub-streams distributed onto more than the predetermined track of the set of tracks;
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set present in the file for the predetermined track are to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks, forwarding the sub-streams distributed onto the more than the predetermined track of the set of tracks to decoding without forwarding the parameter set, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set present in the file for the predetermined track are to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks, forwarding the parameters set along with the sub-streams distributed onto more than the predetermined track of the set of tracks to the decoding;
wherein
the parameter set is comprised by the predetermined track in-band within one or more sub-streams comprised by the predetermined track, and the file format parser is configured to
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set present in the predetermined track is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
strip the parameter set off the one or more sub-streams comprised by the predetermined track to yield a stripped version of the one or more sub streams comprised by the predetermined track and forward the stripped version along with one or more sub-streams comprised by any other track of the set of tracks to the decoding, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set present in the predetermined track is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding with the parameters set remaining in the one or more sub-streams comprised by the predetermined track, or
the parameter set is comprised by one or more boxes of the file and the file format parser is configured to
if the descriptive data indicates for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub-streams distributed onto the more than the predetermined track of the set of tracks,
forward the one or more sub-streams comprised by the predetermined track along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding without the parameter set is, and
if the descriptive data does not indicate for the predetermined track of the set of tracks, that the parameter set is to be ignored when jointly decoding the sub streams distributed onto the more than the predetermined track of the set of tracks, forward the one or more sub-streams comprised by the predetermined track
along with the one or more sub-streams comprised by any other track of the set of tracks to the decoding and along with the parameters set present in the one or more boxes.