Streaming of volumetric point cloud content based on session description protocols and real time protocols

1. A method for real time protocol (RTP) data streaming, the method comprising:

receiving, from a receiver in a RTP extension message, data indicative of a viewport that is associated with the receiver;

generating, based on the data indicative of the viewport, a plurality of codec bitstreams, each codec bitstream being configured to include encoded information that includes one of occupancy map data, geometry data, or attribute data for a volumetric video;

generating, for each codec bitstream of the plurality of codec bitstreams, a dedicated RTP stream, the dedicated RTP stream including a RTP payload format based on the respective codec bitstream for that RTP stream;

multiplexing each dedicated RTP stream into a result RTP stream for the volumetric video;

generating one or more session description protocol (SDP) attributes to indicate capabilities for carriage of point cloud video as part of the result RTP stream, the one or more SDP attributes for the result RTP stream indicating an ability to carry point cloud metadata information as part of the RTP payload format; and

sending, to the receiver, the one or more SDP attributes and the result RTP stream that includes data representing the viewport of the volumetric video in the result RTP stream.

2. The method of claim 1 , further comprising:

performing video-based point cloud coding (V-PCC) using the result RTP stream.

3. The method of claim 1 , wherein each codec bitstream includes a high efficiency video coding (HEVC) bitstream.

4. The method of claim 1 , further comprising:

generating an additional dedicated RTP stream including a compressed patch sequence sub-stream; and

multiplexing the additional RTP stream into the result RTP stream for V-PCC video.

5. The method of claim 1 , further comprising:

generating an RTP header extension of the result RTP stream, the RTP header extension configured to include a compressed patch sequence substream.

6. The method of claim 1 , wherein the one or more SDP attributes for the result RTP stream indicate each of:

an ability to carry encoded point cloud information on occupancy map data, geometry data, attribute data and patch sequence data in dedicated RTP streams;

an ability to carry the dedicated RTP streams on point cloud information such as occupancy map data, geometry data, attribute data, and patch sequence data in a single multiplexed RTP stream;

an ability to carry a sequence parameter set (SPS) unit type information in an RTP header extension;

and

an ability to support codec capabilities to satisfy a minimum quality requirement for point cloud video.

7. The method of claim 6 , wherein the RTP payload format comprises at least one supplemental information enhancement (SEI) message, wherein data carried in a point cloud video specific SEI message are used in a rendering phase at a receiver.

8. The method of claim 1 , wherein the one or more Session Description Protocol (SDP) attributes indicate at least one of:

an ability to signal a desired viewport using an RTCP feedback message; and

an ability to signal an actually transmitted viewport using an RTP header extension message.

9. The method of claim 1 , wherein each dedicated RTP stream includes a distinct media type.

10. The method of claim 1 , wherein the method is performed by a user equipment (UE), a networked device, or an access node (AN).

11. A method for real time protocol (RTP) data streaming, the method comprising:

receiving, from a sender in a RTP extension message, data indicative of a viewport that is associated with a volumetric video in an RTP stream representing the volumetric video;

receiving, from the sender, one or more session description protocol (SDP) attributes to indicate capabilities for carriage of point cloud video as part of the RTP stream, the one or more SDP attributes for the RTP stream indicating an ability to carry point cloud metadata information as part of an RTP payload format;

de-multiplexing, into a plurality of codec bitstreams, the RTP stream representing the volumetric video;

decoding, from the plurality of codec bitstreams, based on the one or more SDP attributes, and based on the data indicative of the viewport, texture data comprising occupancy map data, geometry data, and attribute data for the volumetric video;

generating, from the texture data and the SDP attributes, a point cloud reconstruction for the volumetric video; and

rendering the volumetric video based on the point cloud reconstruction.

12. The method of claim 11 , further comprising:

decoding, from the plurality of codec bitstreams, one or more supplemental information enhancement (SEI) messages including metadata for rendering the volumetric video.

13. The method of claim 11 , further comprising decoding, from the plurality of codec bitstreams, patch sequence data, wherein generating the point cloud reconstruction is based on the patch sequence data.

14. The method of claim 11 , wherein rendering the volumetric video comprises:

receiving, from a sensor associated with a device configured to display the volumetric video, sensor data indicative of a position of the display; and

rendering the volumetric video based on the sensor data indicative of the position.

15. The method of claim 11 , wherein each codec bitstream includes a high efficiency video coding (HEVC) bitstream.

16. The method of claim 11 , further comprising:

receiving an RTP header extension of the RTP stream, the RTP header extension configured to include a compressed patch sequence substream.

17. The method of claim 11 , further comprising:

receiving data including one or more session description protocol (SDP) attributes to indicate capabilities for carriage of point cloud video as part of the RTP stream.

18. The method of claim 17 , wherein the one or more SDP attributes for the RTP stream indicate at least one of:

an ability to carry encoded point cloud information on occupancy map data, geometry data, attribute data and patch sequence data in dedicated RTP streams;

an ability to carry the dedicated RTP streams on point cloud information such as occupancy map data, geometry data, attribute data, and patch sequence data in a single multiplexed RTP stream;

an ability to carry a sequence parameter set (SPS) unit type information in an RTP header extension;

an ability to carry point cloud metadata information as part of a RTP payload format; and

an ability to support codec capabilities to satisfy a minimum quality requirement for point cloud video.

19. The method of claim 17 , wherein the one or more Session Description Protocol (SDP) attributes indicate at least one of:

an ability to signal a desired viewport using an RTCP feedback message; and

an ability to signal an actually transmitted viewport using an RTP header extension message.

20. The method of claim 11 , wherein each codec bitstream includes a distinct media type.