Method of processing disordered frame portion data units
A method of encapsulating data units of at least one encoded video frame into a data stream, said data units representing frame portions of the video frame, wherein said data stream is associated with an ordering information indicating the compliance of the order of the data units with a nominal data unit decoding order. Embodiments of the invention provide flexible transmission with robust and flexible decoders.
1. A method of encapsulating data units of at least one encoded video frame into a data stream, said data units representing frame portions of the video frame, the method comprising the following steps:
determining whether said data units are capable of being decoded by a receiver according to an order of the data units different from a nominal data unit decoding order, and
encapsulating said data units into said data stream,
wherein said data stream is associated with an ordering information indicating the compliance of the order of the data units with said nominal data unit decoding order, the ordering information being set as follows:
a first value when the video stream conforms to the nominal data unit decoding order;
a second value when the ordering of the frame portions conforms with the nominal decoding order but not with the ordering of the data units within a frame portion; and
a third value when the ordering of the data units and the ordering of the frame portions do not conform with the nominal data unit decoding order.
2. A method according to claim 1 , wherein said determining step is based on a partitioning configuration according to which said at least one encoded video frame has been partitioned into frame portions.
3. A method according to claim 1 , wherein said determining step is based on an output order of said data units from a parallel encoding process.
4. A method according to claim 1 , wherein said determining step is based on at least one network condition parameter of a network over which said data stream is to be transmitted.
5. A method according to claim 1 , wherein said frame portions comprise slices and wherein said nominal data unit decoding order is a slice decoding order of the frame specified in an image compression format with which the encoded video frame is compliant.
6. A method according to claim 1 , wherein said frame portions comprise slice segments and wherein said nominal data unit decoding order is an order of the slice segments within a slice.
7. A method according to claim 1 , wherein said frame portions comprise tiles and wherein said nominal data unit decoding order is a tiling order.
8. A method according to claim 1 , wherein the encoded video frame is of the high efficiency video coding (HEVC) image compression format type.
9. A method according to claim 1 , wherein the data units are encapsulated according to a protocol of the real-time transport protocol (RTP) transport protocol type.
10. A method according to claim 9 , wherein said ordering information is incorporated as a parameter of a session description protocol (SDP) document.
11. A method according to claim 10 , wherein said parameter comprises reordering information for reordering said data units by a receiver to process the video stream.
12. A method according to claim 10 , wherein said parameter comprises buffering information for buffering said data units by a receiver to process the video stream.
13. A method according to claim 10 , wherein said parameter comprises structure information relating to a partitioning of said video frame for reordering said data units by a receiver to process the video stream.
14. A method according to claim 11 , wherein said parameter is part of a session description protocol (SDP) document transmitted in response to a message from said receiver indicating its ability to process said video stream.
15. A method according to claim 1 , wherein the data units are encapsulated according to an International Standards Organization (ISO) base media file (BMF) format.
16. A method according to claim 15 , wherein said ordering information is put in header information of an ISO Base Media file.
17. A method according to claim 15 wherein said ordering information is incorporated as a decoder configuration parameter of an ISO Base Media file.
18. A method according to claim 15 wherein said ordering information is incorporated as a sub sample information parameter.
19. A method according to claim 18 , wherein said parameter comprises reordering information for reordering said data units by a receiver to process the video stream.
20. A method according to claim 18 , wherein said parameter comprises buffering information for buffering said data units by a receiver to process the video stream.
21. A method according to claim 18 , wherein said parameter comprises structure information relating to a partitioning of said video frame for reordering said data units by a receiver to process the video stream.
22. A method for processing a data stream having encapsulated therein data units representing frame portions of a video frame, said data units being encapsulated according to claim 1 , the method comprising the following steps:
parsing an ordering information indicating the compliance of the order of the data units with said nominal data unit decoding order, and
performing a processing of the data stream based on said ordering information,
wherein the ordering information is set as follows:
a first value when the video stream conforms to the nominal data unit decoding order;
a second value when the ordering of the frame portions conforms with the nominal decoding order but not with the ordering of the data units within a frame portion; and
a third value when the ordering of the data units and the ordering of the frame portions do not conform with the nominal data unit decoding order.
23. A method according to claim 22 , wherein said processing comprises discarding the data units in case said ordering information is not compatible with decoding capabilities of a receiver receiving said data stream.
24. A method according to claim 22 , wherein said processing comprises reordering the data units according to said ordering information.
25. A method according to claim 22 , wherein said processing comprises initiating a negotiation process for determining decoding parameters to be set by a receiver receiving said data stream.
26. A non-transitory information storage means readable by a computer or a microprocessor storing instructions of a computer program, for implementing a method according to claim 1 , when the program is loaded and executed by the computer or microprocessor.
27. A receiving device for processing a data stream having encapsulated therein data units representing frame portions of a video frame, said data units being encapsulated according to claim 1 , the device comprising:
a memory,
a processor coupled to the memory which executes the following:
parse an ordering information indicating the compliance of the order of the data units with said nominal data unit decoding order, and
perform a processing of the data stream based on said ordering information,
wherein the ordering information is set as follows:
a first value when the video stream conforms to the nominal data unit decoding order;
a second value when the ordering of the frame portions conforms with the nominal decoding order but not with the ordering of the data units within a frame portion; and
a third value when the ordering of the data units and the ordering of the frame portions do not conform with the nominal data unit decoding order.
28. A transmitting device for encapsulating data units of at least one encoded video frame into a data stream, said data units representing frame portions of the video frame, the transmitting device comprising:
a memory;
a processor coupled to the memory which executes the following:
determining whether said data units are capable of being decoded by a receiver according to an order of the data units different from a nominal data unit decoding order, and to encapsulate said data units into said data stream,
wherein said data stream is associated with an ordering information indicating the compliance of the order of the data units with said nominal data unit decoding order, the ordering information being set as follows:
a first value when the video stream conforms to the nominal data unit decoding order;
a second value when the ordering of the frame portions conforms with the nominal decoding order but not with the ordering of the data units within a frame portion; and
a third value when the ordering of the data units and the ordering of the frame portions do not conform with the nominal data unit decoding order.
29. A transmitting device according to claim 28 , further comprising encapsulating data units of at least one encoded video frame into a data stream, said data units representing frame portions of the video frame, determining whether said data units are capable of being decoded by a receiver according to an order of the data units different from a nominal data unit decoding order, and encapsulating said data units into said data stream, wherein said data stream is associated with an ordering information indicating the compliance of the order of the data units with said nominal data unit decoding order, wherein said determining step is based on a partitioning configuration according to which said at least one encoded video frame has been partitioned into frame portions.