Methods and apparatus for point cloud compression bitstream format
Methods, apparatus, systems, architectures and interfaces for encoding and/or decoding point cloud bitstreams including coded point cloud sequences are provided. Included among such methods, apparatuses, systems, architectures, and interfaces is an apparatus that may include a processor and memory. A method may include any of: mapping components of the point cloud bitstream into tracks; generating information identifying any of geometry streams or texture streams according to the mapping of the components; generating information associated with layers corresponding to respective geometry component streams; and generating information indicating operation points associated with the point cloud bitstream.
1. A method of conveying decoding information for a point cloud (PC) bitstream of coded PC sequences, the method comprising:
mapping a metadata component bitstream of the PC bitstream into a first restricted video track of an International Organization for Standardization/International Electrotechnical Commission Base Media File Format (ISOBMFF), wherein the first restricted video track of the ISOBMFF comprises one or more access units of the metadata component bitstream;
mapping a geometry sub-bitstream of the PC bitstream into a second restricted video track of the ISOBMFF, wherein the second restricted video track of the ISOBMFF comprises one or more access units of the geometry sub-bitstream;
mapping an occupancy sub-bitstream of the PC bitstream into a third restricted video track of the ISOBMFF, wherein the third restricted video track of the ISOBMFF comprises one or more access units of the occupancy sub-bitstream, wherein the first restricted video track comprises indications of one or more component bitstreams of the PC bitstream that are encoded in the ISOBMFF, and wherein the one or more component bitstreams of the PC bitstream include the geometry sub-bitstream and the occupancy sub-bitstream;
adding a restricted scheme information box to the first restricted video track, the second restricted video track, and the third restricted video track, the restricted scheme information box indicating that the respective video track is a restricted video track; and
generating an ISOBMFF container to transmit the metadata component bitstream mapping, the geometry sub-bitstream mapping, and the occupancy sub-bitstream mapping for the PC bitstream.
2. The method of claim 1 , wherein the
first restricted video track comprises a plurality of samples associated with the metadata component bitstream of the PC bitstream, the second restricted video track comprises a plurality of second samples associated with the geometry sub-stream of the PC bitstream, and the third restricted video track comprises a plurality of third samples associated with the occupancy sub-bitstream of the PC bitstream.
3. The method of claim 1 , wherein the second restricted video track and the third restricted video track comprise an indication of one or more layers of the PC bitstream.
4. The method of claim 3 , wherein each of the one or more layers is associated with a respective depth with respect to a depth image plane.
5. The method of claim 1 , further comprising mapping an attribute sub-bitstream of the PC bitstream into a fourth restricted video track of the ISOBMFF, wherein the fourth restricted video track of the ISOBMFF comprises one or more access units of the attribute sub-bitstream.
6. The method of claim 1 , wherein the first restricted video track, the second restricted video track, and the third restricted video track in one coded PC sequence are signaled in a single location of the ISOBMFF.
7. The method of claim 5 , wherein the attribute sub-stream is associated with an attribute type that comprises a color, a transparency, a time of acquisition, or another material property.
8. The method of claim 1 , wherein the metadata component bitstream comprises one or more of PC header information and global header information.
9. The method of claim 1 , further comprising generating one or more timed-metadata component bitstreams, wherein samples associated with the timed-metadata component bitstreams are included in a MediaDataBox.
10. The method of claim 1 , wherein an ISOBMFF track reference tool is used to link the metadata component bitstream of the PC bitstream to the first restricted video track, the second restricted video track, and the third restricted video track.
11. An apparatus comprising circuitry for conveying decoding information for a point cloud (PC) bitstream of coded PC sequences, the circuitry including any of a transmitter, a receiver, a processor and memory, configured to:
map a metadata component bitstream of the PC bitstream into a first restricted video track of an International Organization for Standardization/International Electrotechnical Commission Base Media File Format (ISOBMFF), wherein the first restricted video track of the ISOBMFF comprises one or more access units of the metadata component bitstream;
map a geometry sub-bitstream of the PC bitstream into a second restricted video track of the ISOBMFF, wherein the second restricted video track of the ISOBMFF comprises one or more access units of the geometry sub-bitstream;
map an occupancy sub-bitstream of the PC bitstream into a third restricted video track of the ISOBMFF, wherein the third restricted video track of the ISOBMFF comprises one or more access units of the occupancy sub-bitstream, wherein the first restricted video track comprises indications of one or more component bitstreams of the PC bitstream that are encoded in the ISOBMFF, and wherein the one or more component bitstreams of the PC bitstream include the geometry sub-bitstream and the occupancy sub-bitstream;
add a restricted scheme information box to the first restricted video track, the second restricted video track, and the third restricted video track, the restricted scheme information box indicating that the respective video track is a restricted video track; and
generate an ISOBMFF container to transmit the metadata component bitstream mapping, the geometry sub-bitstream mapping, and the occupancy sub-bitstream mapping for the PC bitstream.
12. The apparatus of claim 11 , wherein the
first restricted video track comprises a plurality of samples associated with the metadata component bitstream of the PC bitstream, the second restricted video track comprises a plurality of second samples associated with the geometry sub-stream of the PC bitstream, and the third restricted video track comprises a plurality of third samples associated with the occupancy sub-bitstream of the PC bitstream, and
wherein the second restricted video track and the third restricted video track comprise an indication of one or more layers of the PC bitstream.
13. The apparatus of claim 12 , wherein each of the one or more layers is associated with a respective depth with respect to a depth image plane.
14. The apparatus of claim 11 , wherein the processor is further configured to map an attribute sub-bitstream of the PC bitstream into a fourth restricted video track of the ISOBMFF, wherein the fourth restricted video track of the ISOBMFF comprises one or more access units of the attribute sub-bitstream container.
15. The apparatus of claim 14 , wherein the attribute sub-stream is associated with an attribute type that comprises a color, a transparency, a time of acquisition, or another material property.
16. The apparatus of claim 11 , wherein the processor is further configured to generate one or more timed-metadata component bitstreams, wherein samples associated with the timed-metadata component bitstreams are included in a MediaDataBox.
17. The apparatus of claim 11 , wherein an ISOBMFF track reference tool is used to link the metadata component bitstream of the PC bitstream to the first restricted video track, the second restricted video track, and the third restricted video track.
18. The apparatus of claim 11 , wherein the metadata component bitstream comprises one or more of PC header information and global header information.
19. The apparatus of claim 11 , wherein the first restricted video track, the second restricted video track, and the third restricted video track in one coded PC sequence are signaled in a single location of the ISOBMFF.