Monitoring of vehicles using light ranging systems
Methods, systems, and devices are provided for calibrating a light ranging system and using the system to track environmental objects. In embodiments, the approach involves installing light ranging devices, such as lidar devices, on the vehicle exterior. The light ranging system may be calibrated using a calibration device to scan the vehicle exterior and construct a three-dimensional model of the vehicle exterior comprising the positions of the installed light ranging devices on the vehicle exterior. The calibrated light ranging system may use the model in conjunction with ranging data collected by the installed light ranging devices to track objects in the environment. In this way, the light ranging system may detect a proximity of environmental objects and help a driver of the vehicle avoid potential collisions. The light ranging system may further measure the vehicle exterior and thereby detect changes to the vehicle exterior.
1. A method for using ranging data collected from a light ranging system installed on a vehicle, the method comprising performing, by a computer system:
receiving sensor data corresponding to a risk breach for the vehicle determined using the light ranging system of the vehicle, wherein the sensor data includes a ranging data stream measured by the light ranging system of an environment around the vehicle at an amount of time before and after the risk breach was detected;
receiving, at a user interface, user input indicating that a reconstruction of the risk breach is to be played; and
in response to the user input:
displaying the ranging data stream as a reconstructed model of the environment around the vehicle in a first window of the user interface.
2. The method of claim 1 , further comprising:
receiving position data for the vehicle during a time interval associated with the risk breach; and
in response to the user input, displaying, in another window of the user interface, positions of the vehicle on a map at times synchronized with the ranging data stream.
3. The method of claim 1 , further comprising:
obtaining a series of values of a variable determined from the ranging data stream, wherein the series of values span a time interval associated with the risk breach; and
displaying the series of values in another window of the user interface.
4. The method of claim 3 , wherein the variable is speed, velocity, or acceleration.
5. The method of claim 4 , wherein the computer system determines the series of values for the variable from the ranging data stream.
6. The method of claim 1 , wherein the sensor data further includes a video data stream obtained from a camera installed on the vehicle, the method further comprising:
synchronizing the ranging data stream and the video data stream by determining a time in the ranging data stream that corresponds to a time in the video data stream; and
in response to the user input:
displaying the video data stream in a second window of the user interface.
7. The method of claim 6 , further comprising:
obtaining a series of values of a variable determined from the video data stream, wherein the series of values span a time interval associated with the risk breach; and
displaying the series of values in another window of the user interface, wherein the variable measures distraction of a driver of the vehicle and is determined using the video data stream.
8. The method of claim 6 , wherein the user interface includes an interface element that allows a user to move time forward and backward such that the reconstructed model of the environment around the vehicle displayed in the first window and the video data stream displayed in the second window are played forward and backward in synchronization.
9. The method of claim 1 , further comprising:
displaying a profile of a driver or a group of drivers;
displaying one or more safety events;
receiving a selection of a safety event from the one or more safety events; and
in response to receiving the selection of the safety event, displaying the user interface indicating that the reconstruction of the risk breach is to be played.
10. The method of claim 1 , while displaying the reconstructed model of the ranging data stream changing a perspective view of the reconstructed model.
11. The method of claim 1 , wherein displaying the ranging data stream as the reconstructed model includes:
displaying environmental objects a different color than ground.
12. The method of claim 1 , wherein the first window is refreshed at a same rate the ranging data stream was measured.
13. A computer product comprising a non-transitory computer readable medium storing a plurality of instructions that, when executed on one or more processors of a computer system, control the computer system to perform operations for using ranging data collected from a light ranging system installed on a vehicle, the operations comprising:
receiving sensor data corresponding to a risk breach for the vehicle determined using the light ranging system of the vehicle, wherein the sensor data includes a ranging data stream measured by the light ranging system of an environment around the vehicle at an amount of time before and after the risk breach was detected;
receiving, at a user interface, user input indicating that a reconstruction of the risk breach is to be played; and
in response to the user input:
displaying the ranging data stream as a reconstructed model of the environment around the vehicle in a first window of the user interface.
14. The computer product of claim 13 , wherein the operations further comprise:
receiving position data for the vehicle during a time interval associated with the risk breach; and
in response to the user input, displaying, in another window of the user interface, positions of the vehicle on a map at times synchronized with the ranging data stream.
15. The computer product of claim 13 , wherein the operations further comprise:
obtaining a series of values of a variable determined from the ranging data stream, wherein the series of values span a time interval associated with the risk breach; and
displaying the series of values in another window of the user interface.
16. The computer product of claim 15 , wherein the variable is speed, velocity, or acceleration.
17. The computer product of claim 16 , wherein the computer system determines the series of values for the variable from the ranging data stream.
18. The computer product of claim 13 , wherein the sensor data further includes a video data stream obtained from a camera installed on the vehicle, and wherein the operations further comprise:
synchronizing the ranging data stream and the video data stream by determining a time in the ranging data stream that corresponds to a time in the video data stream; and
in response to the user input:
displaying the video data stream in a second window of the user interface.
19. The computer product of claim 18 , wherein the operations further comprise:
obtaining a series of values of a variable determined from the video data stream, wherein the series of values span a time interval associated with the risk breach; and
displaying the series of values in another window of the user interface, wherein the variable measures distraction of a driver of the vehicle and is determined using the video data stream.
20. The computer product of claim 18 , wherein the user interface includes an interface element that allows a user to move time forward and backward such that the reconstructed model of the environment around the vehicle displayed in the first window and the video data stream displayed in the second window are played forward and backward in synchronization.
21. The computer product of claim 13 , wherein the operations further comprise:
displaying a profile of a driver or a group of drivers;
displaying one or more safety events;
receiving a selection of a safety event from the one or more safety events; and
in response to receiving the selection of the safety event, displaying the user interface indicating that the reconstruction of the risk breach is to be played.
22. The computer product of claim 13 , while displaying the reconstructed model of the ranging data stream changing a perspective view of the reconstructed model.
23. The computer product of claim 13 , wherein the first window is refreshed at a same rate the ranging data stream was measured.