Driver visualization and semantic monitoring of a vehicle using LiDAR data

1. A method using a light ranging system of a vehicle, the light ranging system comprising a control unit communicatively coupled with one or more light ranging devices installed on the vehicle, the one or more light ranging devices providing ranging data that includes a plurality of distance vectors between the one or more light ranging devices and a plurality of environmental surfaces, each distance vector of the plurality of distance vectors corresponding to a pixel of a three-dimensional image stream, the method comprising performing by a computing system:

receiving the ranging data from the one or more light ranging devices via one or more communication channels;

identifying a first pose of a virtual camera relative to the one or more light ranging devices, the first pose defining a first field of view of the virtual camera, wherein the one or more light ranging devices are respectively separated from the first pose by one or more first vectors;

translating a first portion of the plurality of distance vectors using the one or more first vectors, thereby obtaining first translated distance vectors that are within the first field of view of the virtual camera;

determining first colors associated with the first translated distance vectors;

displaying, on a display device of the computing system, first pixels of the three-dimensional image stream using the first colors at first pixel positions specified by the first translated distance vectors;

receiving an indication of a change in the virtual camera;

in response to the indication of the change in the virtual camera, identifying a second pose of the virtual camera relative to the one or more light ranging devices, the second pose defining a second field of view of the virtual camera, wherein the one or more light ranging devices are respectively separated from the second pose by one or more second vectors;

translating a second portion of the plurality of distance vectors using the one or more second vectors, thereby obtaining second translated distance vectors that are within the second field of view of the virtual camera;

determining second colors associated with the second translated distance vectors; and

displaying, on the display device of the computing system, second pixels of the three-dimensional image stream using the second colors at second pixel positions specified by the second translated distance vectors.

2. The method of claim 1 , wherein the indication of the change in the virtual camera is received at a user interface that receives user input corresponding to the indication of the change in the virtual camera.

3. The method of claim 2 , wherein the user interface comprises a touch sensitive display.

4. The method of claim 2 , wherein the user input specifies a particular one of a plurality of virtual poses of the virtual camera, and wherein the plurality of virtual poses include the first pose and the second pose.

5. The method of claim 4 , wherein the plurality of virtual poses are pre-defined, and wherein separation vectors between the one or more light ranging devices and the plurality of virtual poses are stored in a memory of the computing system.

6. The method of claim 1 , wherein the indication of the change in the virtual camera is received at a trajectory processor that:

determines a trajectory of the vehicle;

determines that a current pose of the virtual camera is to change based on the trajectory; and

determines a new pose of the virtual camera based on the trajectory.

7. The method of claim 6 , wherein the trajectory processor is configured to receive trajectory data from the vehicle, the trajectory data providing the indication of a change in the virtual camera, and wherein the trajectory processor is configured to determine the trajectory of the vehicle using the trajectory data.

8. The method of claim 7 , wherein the trajectory data includes a transmission setting of the vehicle.

9. The method of claim 6 , wherein the trajectory processor is configured to analyze the plurality of distance vectors to determine the trajectory of the vehicle, the ranging data providing the indication of a change in the virtual camera.

10. The method of claim 1 , wherein a color of a pixel is dependent on a distance of a corresponding translated distance vector.

11. The method of claim 1 , wherein a color of a pixel is dependent on an intensity of a detected signal.

12. The method of claim 1 , wherein the indication of the change in the virtual camera is received at a proximity processor that:

detects a proximity breach of the plurality of environmental surfaces to a primary model of an exterior of the vehicle.

13. The method of claim 1 , wherein the first colors are different from the second colors.

14. A method using a light ranging system of a vehicle, the light ranging system comprising a control unit communicatively coupled with one or more light ranging devices installed on the vehicle, the method comprising:

storing a model of an exterior of the vehicle in a memory of the control unit, the model comprising a set of three-dimensional points corresponding to a plurality of regions on the exterior of the vehicle;

for each region of the plurality of regions on the exterior of the vehicle:

storing, in the memory, a semantic label in association with a subset of points of the model that define the region;

surveying an environment around the vehicle using the one or more light ranging devices to generate ranging data, the environment comprising a plurality of environmental surfaces, wherein the ranging data comprise distance vectors between the one or more light ranging devices and the plurality of environmental surfaces;

detecting a proximity breach when a distance vector to an environmental surface indicates that the environmental surface is within a threshold distance of a first point of the model;

determining the first point is within a first region of the plurality of regions;

access the memory to retrieve a first semantic label associated with the first region; and

provide a notification including the first sematic label.

15. The method of claim 14 , wherein the model includes one or more model positions of the one or more light ranging devices.

16. The method of claim 14 , wherein the plurality of regions are non-overlapping.

17. The method of claim 14 , wherein the notification is provided to one or more of: a driver's mobile device, a local memory, or a server computer over a network.

18. A method using a light ranging system, the light ranging system comprising a control unit communicatively coupled with one or more light ranging devices, the method comprising:

storing a primary model of an exterior of a vehicle in a memory of the control unit, the primary model comprising a set of three-dimensional points corresponding to a plurality of regions on the exterior of the vehicle;

for each region of the plurality of regions on the exterior of the vehicle:

storing, in the memory, a semantic label in association with a subset of points of the primary model that define the region;

performing, using the one or more light ranging devices, one or more measurements of the exterior of the vehicle to generate ranging data that includes distances from the exterior of the vehicle to the one or more light ranging devices;

constructing, by the control unit, one or more secondary models of the exterior of the vehicle using the ranging data; and

comparing, by the control unit, the one or more secondary models with the primary model to detect a first point having a change in the exterior of the vehicle;

determining the first point is within a first region of the plurality of regions;

access the memory to retrieve a first semantic label associated with the first region; and

provide a notification including the first sematic label.

19. The method of claim 18 , wherein the primary model includes one or more model positions of the one or more light ranging devices.

20. The method of claim 18 , wherein the plurality of regions are non-overlapping.