Systems and methods for signal-based point cloud representation
Disclosed is an encoding and decoding system and associated methods for producing a compressed waveform that encodes data points of a point cloud in a format and size that may be transmitted over a data network, decompressed, decoded, and rendered on a remote device without the buffering or lag associated with transmitting and rendering an uncompressed point cloud. The encoder receives a request from a remote device to access the point cloud, encodes a set of data points from the point cloud as one or more signals derived from values defined for the positional and non-positional elements of each data point from the set of data points, generates one or more compressed waveforms from compressing the one or more signals and transmits the one or more compressed waveforms to the remote device in response to the request for decompression, decoding, and image rendering.
1. A method comprising:
issuing a request for a three-dimensional (“3D”) visualization;
receiving a waveform comprising one or more fluctuating signals in response to the request for the 3D visualization, wherein the one or more fluctuating signals encode a frequency domain representation for x, y, and z positional coordinates of a plurality of points forming the 3D visualization;
decoding different combinations of the x, y, and z positional coordinates from different positions along the one or more fluctuating signals based on a conversion of different frequency domain values represented at the different positions along the one or more fluctuating signals to the different combinations of the x, y, and z positional coordinates;
defining the plurality of points in a 3D space at the different combinations of x, y, and z positional coordinates; and
generating the 3D visualization by rendering the plurality of points.
2. The method of claim 1 , wherein decoding the different combinations comprises:
decoding x and y positional coordinate combinations from the different positions along a first fluctuating signal of the one or more fluctuating signals; and
decoding y and z positional coordinate combinations from the different positions along a second fluctuating signal of the one or more fluctuating signals.
3. The method of claim 1 , wherein decoding the different combinations comprises:
decoding the different combinations of x, y, and z positional coordinates from the different positions along at least a first fluctuating signal of the one or more fluctuating signals; and
decoding visual characteristics for the plurality of points positioned at the different combinations of the x, y, and z positional coordinates from the different positions along at least a second fluctuating signal of the one or more fluctuating signals.
4. The method of claim 3 further comprising:
defining colors of the plurality of points based on the visual characteristics that are decoded from the different positions along at least the second fluctuating signal.
5. The method of claim 1 , wherein decoding the different combinations comprises:
decoding a first x, y, and z positional coordinate from a first peak of the one or more fluctuating signals; and
decoding a second x, y, and z positional coordinate from a second peak of the one or more fluctuating signals having a different amplitude than the first peak.
6. The method of claim 1 , wherein decoding the different combinations comprises:
decoding the different combinations of x, y, and z positional coordinates based on a changing amplitude of the one or more fluctuating signals.
7. The method of claim 1 , wherein decoding the different combinations comprises:
decoding a first positional coordinate for a particular point of the plurality of points from a particular position about a first fluctuating signal of the one or more fluctuating signals;
decoding a second positional coordinate for the particular point from the particular position about a second fluctuating signal of the one or more fluctuating signals; and
decoding a third positional coordinate for the particular point from the particular position about a third fluctuating signal of the one or more fluctuating signals.
8. The method of claim 7 , wherein defining the plurality of points comprises:
generating the particular point at the first positional coordinate, the second positional coordinate, and the third positional coordinate in the 3D space.
9. The method of claim 1 , wherein generating the 3D visualization comprises:
generating a 3D shape of an object from rendering the plurality of points in the 3D space at the different combinations of x, y, and z positional coordinates.
10. The method of claim 1 , wherein decoding the different combinations comprises:
mapping the different positions along the one or more fluctuating signals to different x, y, and z positional coordinates.
11. The method of claim 1 , wherein one or more files or data packets storing the plurality of points have a larger size than one or more files or data packets storing the waveform.
12. The method of claim 1 , wherein decoding the different combinations comprises:
extracting original positional coordinates that are defined for the plurality of points of the 3D visualization from the waveform without data loss.
13. The method of claim 1 , wherein receiving the waveform comprises:
receiving a first fluctuating signal at a first time and a second fluctuating signal at a second time that is after the first time, wherein the first fluctuating signal encodes the different combinations of x, y, and z positional coordinates for a first set of the plurality of points that form a first field-of-view, and wherein the second fluctuating signal encodes the different combinations of x, y, and z positional coordinates for a second set of the plurality of points that form a different second field-of-view that is presented after the first field-of-view.
14. The method of claim 1 , wherein decoding different combinations comprises:
applying an inverse transform function to the one or more fluctuating signals; and
obtaining the different combinations of x, y, and z positional coordinates in response to applying the inverse transform function.
15. A decoding system comprising:
one or more hardware processors configured to:
issue a request for a three-dimensional (“3D”) visualization;
receive a waveform comprising one or more fluctuating signals in response to the request for the 3D visualization, wherein the one or more fluctuating signals encode a frequency domain representation for x, y, and z positional coordinates of a plurality of points forming the 3D visualization;
decode different combinations of the x, y, and z positional coordinates from different positions along the one or more fluctuating signals based on a conversion of different frequency domain values represented at the different positions along the one or more fluctuating signals to the different combinations of the x, y, and z positional coordinates;
define the plurality of points in a 3D space at the different combinations of x, y, and z positional coordinates; and
generate the 3D visualization by rendering the plurality of points.
16. The decoding system of claim 15 , wherein decoding the different combinations comprises:
decoding x and y positional coordinate combinations from the different positions along a first fluctuating signal of the one or more fluctuating signals; and
decoding y and z positional coordinate combinations from the different positions along a second fluctuating signal of the one or more fluctuating signals.
17. The decoding system of claim 15 , wherein decoding the different combinations comprises:
decoding the different combinations of x, y, and z positional coordinates from the different positions along at least a first fluctuating signal of the one or more fluctuating signals; and
decoding visual characteristics for the plurality of points positioned at the different combinations of the x, y, and z positional coordinates from the different positions along at least a second fluctuating signal of the one or more fluctuating signals.
18. The decoding system of claim 15 , wherein decoding the different combinations comprises:
decoding a first x, y, and z positional coordinate from a first peak of the one or more fluctuating signals; and
decoding a second x, y, and z positional coordinate from a second peak of the one or more fluctuating signals having a different amplitude than the first peak.
19. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a decoding system, cause the decoding system to perform operations comprising:
issuing a request for a three-dimensional (“3D”) visualization;
receiving a waveform comprising one or more fluctuating signals in response to the request for the 3D visualization, wherein the one or more fluctuating signals encode a frequency domain representation for x, y, and z positional coordinates of a plurality of points forming the 3D visualization;
decoding different combinations of the x, y, and z positional coordinates from different positions along the one or more fluctuating signals based on a conversion of different frequency domain values represented at the different positions along the one or more fluctuating signals to the different combinations of the x, y, and z positional coordinates;
defining the plurality of points in a 3D space at the different combinations of x, y, and z positional coordinates; and
generating the 3D visualization by rendering the plurality of points.
20. The method of claim 1 further comprising:
generating new points that are not originally part of the 3D visualization based on x, y, and z positional coordinates that are derived from positions along the one or more fluctuating signals that are between positions representing x, y, and z positional coordinates of two or more points that are originally part of the 3D visualization.