Systems and methods for remote viewing of self-driving vehicles
A system for remote viewing and control of self-driving vehicles includes: an execution subsystem for deployment at an execution location containing a self-driving vehicle. The execution subsystem includes: a capture assembly to capture multimedia data depicting the execution location, and a server to receive the multimedia data and transmit the multimedia data for presentation at an operator location remote from the execution location. The server relays operational commands and operational status data between the self-driving vehicle and the operator location. The system includes an operator subsystem for deployment at the operator location, including: a display assembly, and a computing device to: (a) establish a connection with the server; (b) receive the multimedia data from the server and control the display assembly to present the multimedia data; and (c) receive control commands and transmit the control commands to the server for execution by the self-driving vehicle.
1. A system for remote viewing and control of one or more self-driving vehicles, the system comprising:
an execution subsystem at an execution location at which a self-driving vehicle is operating, the execution subsystem configured to:
receive, from a capture assembly, data associated with at least one of the execution location and the self-driving vehicle; and
transmit the data received from the capture assembly to an operator location remote from the execution location; and
an operator subsystem at the operator location, the operator subsystem comprising:
a display assembly; and
a processor configured to:
receive the data from the execution subsystem;
operate the display assembly to generate a visual representation for at least one subset of the data received from the execution subsystem, the visual representation comprising an overlay representing the self-driving vehicle; and
transmit operational commands to the execution subsystem for execution by the self-driving vehicle.
2. The system of claim 1 , wherein the data received from the capture assembly data is associated with a location of at least one of the self-driving vehicle and one or more obstacles at the execution location.
3. The system of claim 2 , wherein the processor is configured to automatically identify the location of the at least one of the self-driving vehicle and the one or more obstacles from the data received from the capture assembly.
4. The system of claim 2 , wherein the processor is configured to generate the visual representation by applying a transformation between coordinates corresponding to the location of the at least one of the self-driving vehicle and the one or more obstacles, and coordinates corresponding to the display assembly at the operator location.
5. The system of claim 1 , wherein the data from the execution subsystem comprises a status data associated with the one or more self-driving vehicles.
6. The system of claim 1 , wherein the capture assembly comprises a camera.
7. The system of claim 1 , wherein the operator subsystem comprises an operator enclosure for supporting the display assembly.
8. The system of claim 1 , wherein the display assembly comprises a plurality of display devices operable by the processor for presenting the at least one subset of the data.
9. The system of claim 1 , wherein the visual representation comprises an overlay representing a path being executed by the self-driving vehicle.
10. A method for remote viewing and control of one or more self-driving vehicles, the method comprising:
at an execution location at which a self-driving vehicle is operating, controlling a capture assembly of an execution subsystem to capture data associated with at least one of the execution location and the self-driving vehicle;
receiving, at the execution subsystem, the data associated with the at least one of the execution location and the self-driving vehicle;
transmitting the data associated with the at least one of the execution location and the self-driving vehicle to an operator location remote from the execution location; and
at an operator subsystem at the operator location, operating a processor to:
receive the data from the execution subsystem;
operate the display assembly to generate a visual representation for at least a subset of the data received from the execution subsystem, the visual representation comprising an overlay representing the self-driving vehicle; and
transmit operational commands to the execution subsystem for execution by the self-driving vehicle.
11. The method of claim 10 , wherein the data received from the capture assembly data is associated with a location of at least one of the self-driving vehicle and one or more obstacles at the execution location.
12. The method of claim 11 , wherein the processor is configured to automatically identify the location of the at least one of the self-driving vehicle and the one or more obstacles from the data received from the capture assembly.
13. The method of claim 11 , wherein the processor is configured to generate the visual representation by applying a transformation between coordinates corresponding to the location of the at least one of the self-driving vehicle and the one or more obstacles, and coordinates corresponding to the display assembly at the operator location.
14. The method of claim 10 , wherein the data from the execution subsystem comprises a status data associated with the one or more self-driving vehicles.
15. The method of claim 10 , wherein the capture assembly comprises a camera.
16. The method of claim 10 , wherein the operator subsystem comprises an operator enclosure for supporting the display assembly.
17. The method of claim 10 , wherein the display assembly comprises a plurality of display devices operable by the processor for presenting the at least one subset of the data.
18. The method of claim 10 , wherein the visual representation comprises an overlay representing a path being executed by the self-driving vehicle.