IP Library Granted Patent US 11,893,684
Granted Patent B1
US 11,893,684 · App. 18/364,576 · Granted Feb 6, 2024

Systems and methods for signal-based point cloud representation

Inventors: Robert Monaghan (Ventura, CA); Fatemeh Jamalidinan (Los Angeles, CA); Mark Weingartner (Woodland Hills, CA); Dwayne Elahie (Los Angeles, CA); Kevin Edward Dean (Greenwood, IN)
Assignee: Illuscio, Inc.
G06T17/005G06T15/20G06T2210/36G06T2210/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,893,684
App. No.
18/364,576
Granted
Feb 6, 2024
Kind
B1
Abstract

Disclosed is an encoding and decoding system and associated methods for producing a compressed waveform that encodes data points of a point cloud in a format and size that may be transmitted over a data network, decompressed, decoded, and rendered on a remote device without the buffering or lag associated with transmitting and rendering an uncompressed point cloud. The encoder receives a request from a remote device to access the point cloud, encodes a set of data points from the point cloud as one or more signals derived from values defined for the positional and non-positional elements of each data point from the set of data points, generates one or more compressed waveforms from compressing the one or more signals and transmits the one or more compressed waveforms to the remote device in response to the request for decompression, decoding, and image rendering.

Claims (77)

1. A method comprising:

receiving a file that is defined with a plurality of data points that collectively produce a three-dimensional (“3D”) scene, wherein each data point of the plurality of data points is defined with x, y, and z positional coordinates and one or more visual characteristics;

mapping the x, y, and z positional coordinates and the one or more visual characteristics of each data point from the plurality of data points to one or more frequency domains based on differing frequencies with which the x, y, and z positional coordinates and the one or more visual characteristics are defined in the plurality of data points;

generating a waveform as a fluctuating signal that fluctuates according to the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points in the one or more frequency domains, wherein the waveform encodes the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points with fewer bits than the file; and

transmitting the fluctuating signal over a data network in response to a request from a remote device for the 3D scene.

2. The method of claim 1 further comprising:

receiving the request to access the file; and

wherein transmitting the fluctuating signal comprises streaming the waveform over the data network in response to the request.

3. The method of claim 1 , wherein generating the waveform comprises:

performing a lossless encoding that preserves the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points as the fluctuating signal that fluctuates according to the differing frequencies with which the x, y, and z positional coordinates and the one or more visual characteristics are defined in the plurality of data points.

4. The method of claim 1 further comprising:

receiving a request for a first part of the 3D scene from a device;

partitioning the plurality of data points into different sets of data points that produce different visualizations for different parts of the 3D scene; and

wherein generating the waveform comprises:

determining a particular set of data points from the different sets of data points that produce a visualization of the first part of the 3D scene identified in the request; and

generating a first waveform based on the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the particular set of data points in the one or more frequency domains.

5. The method of claim 4 further comprising:

distributing the first waveform to the device in response to the request;

determining a next set of data points from the different sets of data points that produce a visualization of a second part of the 3D scene;

generating a second waveform based on the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the next set of data points in the one or more frequency domains; and

distributing the second waveform to the device after distributing the first waveform to the device.

6. The method of claim 1 ,

wherein mapping the x, y, and z positional coordinates and the one or more visual characteristics comprises:

mapping different combinations of the x, y, and z positional coordinates and the one or more visual characteristics from each data point of the plurality of data points to frequencies in a different frequency domain of a plurality of frequency domains; and

wherein generating the waveform comprises:

encoding the frequencies from each frequency domain of the plurality of frequency domains to one or more signals of the waveform.

7. The method of claim 1 ,

wherein mapping the x, y, and z positional coordinates and the one or more visual characteristics comprises:

mapping a first subset of the x, y, and z positional coordinates and the one or more visual characteristics from each data point of the plurality of data points to frequencies in a first frequency domain; and

mapping a different second subset of the x, y, and z positional coordinates and the one or more visual characteristics from each data point of the plurality of data points to frequencies in a second frequency domain; and

wherein generating the waveform comprises:

generating a first encoding based on the frequencies in the first frequency domain; and

generating a second encoding based on the frequencies in the second frequency domain.

8. The method of claim 7 , wherein generating the waveform comprises:

combining the first encoding with the second encoding in the waveform.

9. The method of claim 8 , wherein combining the first encoding with the second encoding comprises:

defining a phase offset for the second encoding that does not interfere with the first encoding; and

generating the waveform with the first encoding being non-destructively combined with the second encoding using the phase offset.

10. The method of claim 1 ,

wherein mapping the x, y, and z positional coordinates and the one or more visual characteristics comprises:

generating a different frequency domain representation for each of the x, y, and z positional coordinates and the one or more visual characteristics of each data point from the plurality of data points; and

wherein generating the waveform comprises:

encoding the different frequency domain representation for each of the x, y, and z positional coordinates and the one or more visual characteristics as a separate waveform.

11. The method of claim 10 , wherein generating the waveform further comprises:

combining each separate waveform into a single signal.

12. The method of claim 1 further comprising:

generating a compressed waveform in response to applying signal compression to the waveform.

13. The method of claim 1 further comprising:

generating a leaf node layer for a tree-based representation of the 3D scene from the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points in the one or more frequency domains; and

generating a parent node layer for the tree-based representation that is above the leaf node layer from subsampling the differing frequencies.

14. The method of claim 1 further comprising:

generating a leaf node layer for a tree-based representation of the 3D scene from the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points in the one or more frequency domains;

applying a signal filter to the waveform; and

generating a parent node layer for the tree-based representation that is above the leaf node layer based on a subset of plurality of data points that are decoded from the waveform using the signal filter.

15. An encoding system comprising:

one or more hardware processors configured to:

receive a file that is defined with a plurality of data points that collectively produce a three-dimensional (“3D”) scene, wherein each data point of the plurality of data points is defined with x, y, and z positional coordinates and one or more visual characteristics;

map the x, y, and z positional coordinates and the one or more visual characteristics of each data point from the plurality of data points to one or more frequency domains based on differing frequencies with which the x, y, and z positional coordinates and the one or more visual characteristics are defined in the plurality of data points;

generate a waveform as a fluctuating signal that fluctuates according to the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points in the one or more frequency domains, wherein the waveform encodes the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points with fewer bits than the file; and

transmitting the fluctuating signal over a data network in response to a request from a remote device for the 3D scene.

16. The encoding system of claim 15 , wherein the one or more hardware processors are further configured to:

receive the request to access the file; and

wherein transmitting the fluctuating signal comprises streaming the waveform over the data network in response to the request.

17. The encoding system of claim 15 , wherein generating the waveform comprises:

performing a lossless encoding that preserves the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points as the fluctuating signal that fluctuates according to the differing frequencies with which the x, y, and z positional coordinates and the one or more visual characteristics are defined in the plurality of data points.

18. The encoding system of claim 15 , wherein the one or more hardware processors are further configured to:

receive a request for a first part of the 3D scene from a device;

partition the plurality of data points into different sets of data points that produce different visualizations for different parts of the 3D scene; and

wherein generating the waveform comprises:

determining a particular set of data points from the different sets of data points that produce a visualization of the first part of the 3D scene identified in the request; and

generating a first waveform based on the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the particular set of data points in the one or more frequency domains.

19. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of an encoding system, cause the encoding system to perform operations comprising:

receiving a file that is defined with a plurality of data points that collectively produce a three-dimensional (“3D”) scene, wherein each data point of the plurality of data points is defined with x, y, and z positional coordinates and one or more visual characteristics;

mapping the x, y, and z positional coordinates and the one or more visual characteristics of each data point from the plurality of data points to one or more frequency domains based on differing frequencies with which the x, y, and z positional coordinates and the one or more visual characteristics are defined in the plurality of data points;

generating a waveform as a fluctuating signal that fluctuates according to the differing frequencies representing the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points in the one or more frequency domains, wherein the waveform encodes the x, y, and z positional coordinates and the one or more visual characteristics of the plurality of data points with fewer bits than the file; and

transmitting the fluctuating signal over a data network in response to a request from a remote device for the 3D scene.

20. The method of claim 1 , wherein the fluctuating signal fluctuates between different peaks and valleys, and wherein the different peaks and valleys encode the x, y, and z positional coordinates and the one or more visual characteristics for different sets of the plurality of data points.

Assignments (2)
CHANGE OF NAME Recorded Sep 18, 2025
From: ILLUSCIO, INC.
To: MIRIS, INC.
Reel/Frame 072896/0406 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2023
From: MONAGHAN, ROBERT; JAMALIDINAN, FATEMEH; WEINGARTNER, MARK; ELAHIE, DWAYNE; DEAN, KEVIN E
To: ILLUSCIO, INC.
Reel/Frame 064480/0212 →
Continuity (1)
Continuation 18168673 · Feb 14, 2023