Point cloud and mesh compression using image/video codecs

1. A decoding device for point cloud decoding, the decoding device comprising:

a communication interface configured to receive a compressed bitstream; and

a processor operably coupled to the communication interface, wherein the processor is configured to:

decode the compressed bitstream into two-dimensional frames, wherein the two-dimensional frames include at least a first frame that indicates geometric locations of points in a three-dimensional point cloud and a second frame that indicates attribute information of the points in the three-dimensional point cloud, wherein the first frame and the second frame include valid pixels that correspond to the points of the three-dimensional point cloud and invalid pixels that do not represent any of the points of the three-dimensional point cloud, and

decode an occupancy map from the compressed bitstream that indicates locations of the valid pixels and the invalid pixels in the two-dimensional frames;

identify from the occupancy map the valid pixels in the two-dimensional frames that represent each point in the three-dimensional point cloud, and the invalid pixels in the two-dimensional frames that do not represent any of the points of the three-dimensional point cloud; and

reconstruct the three-dimensional point cloud from the valid pixels of the two-dimensional frames, as identified by the occupancy map.

2. The decoding device of claim 1 , wherein to reconstruct the three-dimensional point cloud, the processor is further configured to:

map a location of the valid pixels in the first frame to reconstruct the points of the three-dimensional point cloud; and

after reconstructing the geometric locations of the points, map the attribute information of the valid pixels in the second frame to the points of the three-dimensional point cloud,

wherein one of the valid pixels at a location in the second frame provides the attribute information of a point that is represented by a pixel at a corresponding location in the first frame.

3. The decoding device of claim 1 , wherein to decode the compressed bitstream, the processor is further configured to:

decompress a first series of frames, each representing the geometric locations of the points of the three-dimensional point cloud, to generate the first frame; and

decompress a second series of frames, each representing the attribute information of the points of the three-dimensional point cloud, to generate the second frame.

4. The decoding device of claim 1 , wherein, the processor is further configured to identify auxiliary information to relate the valid pixels in the first frame and the valid pixels in the second frame to the points of the three-dimensional point cloud, the auxiliary information indicates the geometric locations and the attribute information of the points in the three-dimensional point cloud to each row in the first and second frame.

5. The decoding device of claim 1 , wherein to reconstruct the three-dimensional point cloud, the processor is further configured to:

analyze a row of the first frame to identify a first axis, wherein the valid pixels that are positioned in the row of the first frame correspond to the points of the three-dimensional point cloud along the first axis; and

generate the three-dimensional point cloud by positioning the points in three-dimensional space corresponding to the first axis, a second axis, and a third axis, based on a location of the valid pixels that within the row of the first frame.

6. The decoding device of claim 5 , wherein the processor is configured to:

identify that a longest dimension of the three-dimensional point cloud is the first axis; and

generate the three-dimensional point cloud by positioning the points that correspond to the row of the first frame along the longest dimension of the three-dimensional point cloud.

7. The decoding device of claim 1 , wherein the processor is further configured to identify color values representing the points of the three-dimensional point cloud as three components in the second frame.

8. An encoding device for point cloud encoding, the encoding device comprising:

a processor configured to:

generate, from a three-dimensional point cloud, multiple two-dimensional frames, the two-dimensional frames including at least a first frame that indicates geometric locations of points in the three-dimensional point cloud and a second frame that indicates attribute information of the points in the three-dimensional point cloud, wherein the first frame and the second frame include valid pixels that correspond to the points of the three-dimensional point cloud and invalid pixels that do not represent any of the points of the three-dimensional point cloud;

generate an occupancy map indicating locations of the valid pixels and the invalid pixels in the two-dimensional frames; and

encode the two-dimensional frames and the occupancy map to generate a compressed bitstream; and

a communication interface operably coupled to the processor, wherein the communication interface is configured to transmit the compressed bitstream.

9. The encoding device of claim 8 , wherein to generate the two-dimensional frames, the processor is further configured to:

map a location of each of the points in the three-dimensional point cloud onto the first frame to indicate the geometric locations of the points in the three-dimensional point cloud; and

map the attribute information of each of the points in the three-dimensional point cloud onto the second frame to indicate the attribute information associated with the points,

wherein the attribute information associated with a first point in the three-dimensional point cloud is mapped to a location in the second frame that matches the location of the geometric location of the first point in the first frame.

10. The encoding device of claim 8 , wherein to encode the two-dimensional frames, the processor is further configured to:

compress a first series of frames, each representing the geometric locations of the points of the three-dimensional point cloud, to generate a first compressed frame that includes the geometric locations of the points; and

compress a second series of frames, each representing the attribute information of the points of the three-dimensional point cloud, to generate a second compressed frame that includes the attribute information of the points.

11. The encoding device of claim 8 , wherein the processor is further configured to generate auxiliary information to relate the geometric location of the points and the attribute information associated with the points in the three-dimensional point cloud to the multiple two-dimensional frames, the auxiliary information indicates the geometric location and the attribute information of the points in the three-dimensional point cloud to each row in the first and second frame.

12. The encoding device of claim 8 , wherein to generate the multiple two-dimensional frames, the processor is further configured to:

analyze the three-dimensional point cloud at a plurality of positions along a first axis; and

store a representation of the points of the three-dimensional point cloud that are located along a second and third axis and positioned along the first axis,

wherein the points are stored in a row of the first frame that corresponds the position along the first axis.

13. The encoding device of claim 12 , wherein the processor is further configured to:

determine a longest dimension of the three-dimensional point cloud;

analyze the three-dimensional point cloud at the plurality of positions along the longest dimension; and

store, in the row of the first frame, the representation of the points of the three-dimensional point cloud that are located along the second and third axis and positioned along the longest dimension of the three-dimensional point cloud.

14. The encoding device of claim 8 , wherein:

the second frame representing the attribute information of the points indicates a color of each of the points of the three-dimensional point cloud, and

the processor is further configured to store a value representing the color as three components in the second frame.

15. A method for point cloud encoding, the method comprising:

generating, from a three-dimensional point cloud, multiple two-dimensional frames, the two-dimensional frames including at least a first frame that indicates geometric locations of points in the three-dimensional point cloud and a second frame that indicates attribute information of the points in the three-dimensional point cloud, wherein the first frame and the second frame include valid pixels that correspond to the points of the three-dimensional point cloud and invalid pixels that do not represent any of the points of the three-dimensional point cloud;

generating an occupancy map indicating locations of the valid pixels and the invalid pixels in the two-dimensional frames; and

encoding the two-dimensional frames and the occupancy map to generate a compressed bitstream; and

transmitting the compressed bitstream.

16. The method of claim 15 , wherein generating the two-dimensional frames, the method comprises:

mapping a location of each of the points in the three-dimensional point cloud onto the first frame to indicate the geometric locations of the points in the three-dimensional point cloud; and

mapping the attribute information of each of the points in the three-dimensional point cloud onto the second frame to indicate the attribute information associated with the points,

wherein the attribute information associated with a first point in the three-dimensional point cloud is mapped to a location in the second frame that matches the location of the geometric location of the first point in the first frame.

17. The method of claim 15 , wherein encoding the two-dimensional frames, the method comprises:

compressing a first series of frames, each representing the geometric locations of the points of the three-dimensional point cloud, to generate a first compressed frame that includes the geometric locations of the points; and

compressing a second series of frames, each representing the attribute information of the points of the three-dimensional point cloud, to generate a second compressed frame that includes the attribute information of the points.

18. The method of claim 15 , further comprises generating auxiliary information to relate the geometric location of the points and the attribute information associated with the points in the three-dimensional point cloud to the multiple two-dimensional frames, the auxiliary information indicates the geometric location and the attribute information of the points in the three-dimensional point cloud to each row in the first and second frame.

19. The method of claim 15 , wherein generating the multiple two-dimensional frames, the method comprises:

analyzing the three-dimensional point cloud at a plurality of positions along a first axis; and

storing a representation of the points of the three-dimensional point cloud that are located along a second and third axis and positioned along the first axis,

wherein the points are stored in a row of the first frame that corresponds the positions along the first axis.

20. The method of claim 19 , further comprises:

determining a longest dimension of the three-dimensional point cloud;

analyzing the three-dimensional point cloud at the plurality of positions along the longest dimension; and

storing, in the row of the first frame, the representation of the points of the three-dimensional point cloud that are located along the second and third axis and positioned along the longest dimension of the three-dimensional point cloud.