Method, device, and computer program for encapsulating partitioned timed media data
The invention relates to encapsulating tiled timed media data in a server and providing a timed media data bit-stream from encapsulated tiled timed media in a client device. The tiled timed media data comprises timed samples and each timed sample comprises a plurality of spatial subsamples. After having selected at least one spatial subsample from amongst the plurality of spatial subsamples of one of the timed samples, one tile track comprising the selected spatial subsample and one corresponding spatial subsample of each of the other timed samples is created for each selected spatial subsample. One composite track comprising at least one extractor identifying at least one of the created tile tracks is created. Each created track is independently encapsulated in at least one media segment file.
1. A method for processing video data based on a media file comprising a media data box and a metadata box according to an ISO BMFF compatible standard, the method comprising:
obtaining a media file in which a plurality of NAL (Network Abstraction Layer) units based on video data are contained in the media data box and tile information, which indicates information related to one or more spatial tiles corresponding to the plurality of NAL units contained in the media data box is described in the metadata box, and
processing video data corresponding to one or more NAL units within the media data box by using the tile information within the metadata box.
2. The method according to claim 1 , wherein the tile information includes:
tile identifier information for identifying each of a plurality of the spatial tiles of a sample of the video data,
tile width information for identifying a width of each of the plurality of the spatial tiles of a sample of the video data, and
tile height information for identifying a height of each of the plurality of the spatial tiles of a sample of the video data.
3. The method according to claim 2 , wherein the tile information includes:
tile offset information for identifying offset of each of the plurality of spatial tiles of a sample of the video data.
4. The method according to claim 2 , wherein the tile information further comprises a parameter to signal decoding dependencies of the one or more spatial tiles on other spatial tiles.
5. The method according to claim 4 , wherein said parameter is set to one value chosen from among the following values:
a first value to signal that the coding dependencies between the one or more spatial tiles and other tiles in the same sample or in previous samples are unknown;
a second value to signal that there are no spatial coding dependencies between the one or more spatial tiles and other tiles in the same sample but there can be coding dependencies between the one or more spatial tiles and a spatial tile having the same tile identifier in previous samples;
a third value to signal that there are no coding dependencies between the one or more spatial tile and other spatial tiles having a same tile identifier in the same sample or in previous samples; and
a fourth value to signal a reserved value.
6. The method according to claim 5 , wherein said parameter is a 2-bit parameter, and the first, second, third and fourth values are “0”, “1”, “2” and “3” respectively.
7. The method according to claim 1 , further comprising:
designating an ROI (Region Of Interest), and
determining one or more NAL units to be used to process video data of the ROI.
8. A device for processing video data based on a media file comprising a media data box and a metadata box according to an ISO BMFF compatible standard, the device comprising at least one processor configured for carrying out the steps of:
obtaining a media file in which a plurality of NAL (Network Abstraction Layer) units based on video data are contained in the media data box and tile information, which indicates information related to one or more spatial tiles corresponding to the plurality of NAL units contained in the media data box, is described in the metadata box, and
processing video data corresponding to one or more NAL units within the media data box by using the tile information within the metadata box.
9. The device according to claim 8 , wherein the tile information includes:
tile identifier information for identifying each of a plurality of the spatial tiles of a sample of the video data,
tile width information for identifying a width of each of the plurality of the spatial tiles of a sample of the video data, and
tile height information for identifying a height of each of the plurality of the spatial tiles of a sample of the video data.
10. The device according to claim 9 , wherein the tile information includes:
tile offset information for identifying offset of each of the plurality of spatial tiles of a sample of the video data.
11. The device according to claim 9 , wherein the tile information further comprises a parameter to signal decoding dependencies of the one or more spatial tiles on other spatial tiles in the same samples and/or previous samples.
12. The device according to claim 11 , wherein the processor is further configured for setting said parameter to one value chosen from among the following values:
a first value to signal that the coding dependencies between the one or more spatial tiles and other tiles in the same sample or in previous samples are unknown;
a second value to signal that there are no spatial coding dependencies between the one or more spatial tiles and other tiles in the same sample but there can be coding dependencies between the one or more spatial tiles and a spatial tile having the same tile identifier in previous samples;
a third value to signal that there are no coding dependencies between the one or more spatial tile and other spatial tiles having a same tile identifier in the same sample or in previous samples; and
a fourth value to signal a reserved value.
13. The device according to claim 12 , wherein said parameter is a 2-bit parameter, and the first, second, third and fourth values are “0”, “1”, “2” and “3” respectively.
14. The device according to claim 8 , further comprising:
designating an ROI (Region Of Interest), and
determining one or more NAL units to be used to process video data of the ROI.