Partitioning of coded point cloud data
Systems and methods for encoding a video stream are provided. A method includes signaling partitioning information in a coded bitstream that is based on a point cloud. The coded bitstream may be a coded video stream that includes a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation; frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures; and 3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames.
1. A method performed by at least one processor, the method comprising:
encoding a video stream, the encoded video stream including:
a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation,
frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and
3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames; and
sending the encoded video stream to a decoder,
wherein the frame partition information, of the encoded video stream, includes 2D bounding box information that specifies at least one among a position and boundary of the sub-frame in the frame,
the frame partition information further includes a syntax element that indicates whether a 2D bounding box specified in the 2D bounding box information includes only one tile, and
the 3D bounding box information specifies a 3D position of the 2D bounding box specified in the 2D bounding box information.
2. The method according to claim 1 , wherein
the frame partition information further includes a syntax element that indicates whether an ID of the 2D bounding box specified in the 2D bounding box information is signaled.
3. The method according to claim 1 , wherein
the encoding the video stream comprises generating the encoded video stream, including the 3D bounding box information, based on a point cloud.
4. The method according to claim 3 , wherein
the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.
5. The method according to claim 1 , wherein the encoding the video stream comprises generating the encoded video stream, including the 3D bounding box information, based on a point cloud.
6. The method according to claim 5 , wherein
the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.
7. The method according to claim 1 , wherein the encoding the video stream comprises signaling in the encoded video stream whether the sub-frame may be independently decoded from other sub-frames of the plurality of sub-frames.
8. The method according to claim 1 , wherein
the encoded video stream includes a frame parameter set that includes the frame partition information and the 3D bounding box information.
9. The method according to claim 1 , wherein
the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.
10. The method according to claim 1 , wherein
the encoded video stream further includes an additional frame of a plurality of 2D pictures that are layers of the additional frame, each of the plurality of 2D pictures of the additional frame having a respective attribute of a same additional 3D representation, and
the frame partition information indicates that the additional frame is partitioned into a plurality of sub-frames.
11. A system comprising:
memory configured to store computer program code; and
at least one processor configured to access the computer program code, and operate as instructed by the computer program code, wherein
the computer program code, when executed by the at least one processor, causes the at least one processor to encode a video stream and send the encoded video stream to a decoder, and
the encoded video stream includes:
a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation,
frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and
3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames,
wherein the frame partition information, of the encoded video stream, includes 2D bounding box information that specifies at least one among a position and boundary of the sub-frame in the frame,
the frame partition information further includes a syntax element that indicates whether a 2D bounding box specified in the 2D bounding box information includes only one tile, and
the 3D bounding box information specifies a 3D position of the 2D bounding box specified in the 2D bounding box information.
12. The system according to claim 11 , wherein
the frame partition information further includes a syntax element that indicates whether an ID of the 2D bounding box specified in the 2D bounding box information is signaled.
13. The system according to claim 11 , wherein
the computer program code, when executed by the at least one processor, further causes the at least one processor to generate the encoded video stream, including the 3D bounding box information, based on a point cloud.
14. The system according to claim 13 , wherein
the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.
15. The system according to claim 11 , wherein
the computer program code, when executed by the at least one processor, further causes the at least one processor to generate the encoded video stream, including the 3D bounding box information, based on a point cloud.
16. The system according to claim 15 , wherein
the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.
17. The system according to claim 11 , wherein
the computer program code, when executed by the at least one processor, further causes the at least one processor to signal in the encoded video stream whether the sub-frame may be independently decoded from other sub-frames of the plurality of sub-frames.
18. The system according to claim 11 , wherein
the encoded video stream includes a frame parameter set that includes the frame partition information and the 3D bounding box information.
19. The system according to claim 11 , wherein
the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.
20. A non-transitory computer-readable medium storing computer instructions that, when executed by at least one processor, cause the at least one processor to:
encode a video stream that includes:
a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same 3D representation,
frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and
3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames; and
send the encoded video stream to a decoder,
wherein the frame partition information, of the encoded video stream, includes 2D bounding box information that specifies at least one among a position and boundary of the sub-frame in the frame,
the frame partition information further includes a syntax element that indicates whether a 2D bounding box specified in the 2D bounding box information includes only one tile, and
the 3D bounding box information specifies a 3D position of the 2D bounding box specified in the 2D bounding box information.