IP Library Granted Patent US 11,144,051
Granted Patent B2
US 11,144,051 · App. 16/288,228 · Granted Oct 12, 2021

Systems and methods for remote viewing of self-driving vehicles

Inventor: Ryan Christopher Gariepy (Kitchener, CA)
Assignee: Clearpath Robotics Inc.
G05D1/0038G05D1/0231G05D1/0276H04N5/272H04N7/183H04N7/185G05D2201/0216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,144,051
App. No.
16/288,228
Granted
Oct 12, 2021
Kind
B2
Abstract

A system for remote viewing and control of self-driving vehicles includes: an execution subsystem for deployment at an execution location containing a self-driving vehicle. The execution subsystem includes: a capture assembly to capture multimedia data depicting the execution location, and a server to receive the multimedia data and transmit the multimedia data for presentation at an operator location remote from the execution location. The server relays operational commands and operational status data between the self-driving vehicle and the operator location. The system includes an operator subsystem for deployment at the operator location, including: a display assembly, and a computing device to: (a) establish a connection with the server; (b) receive the multimedia data from the server and control the display assembly to present the multimedia data; and (c) receive control commands and transmit the control commands to the server for execution by the self-driving vehicle.

Claims (41)

1. A system for remote viewing and control of self-driving vehicles, comprising:

an execution subsystem for deployment at an execution location containing a self-driving vehicle, the execution subsystem including:

(i) a capture assembly configured to capture multimedia data depicting the execution location;

(ii) a server configured to receive the multimedia data and to transmit the multimedia data for presentation at an operator location remote from the execution location; the server further configured to relay operational commands and operational status data between the self-driving vehicle and the operator location; and

an operator subsystem for deployment at the operator location, the operator subsystem including:

(i) a display assembly;

(ii) an operator enclosure supporting the display assembly; and

(iii) a computing device configured to:

(a) establish a connection with the server;

(b) receive the multimedia data from the server and control the display assembly to present the multimedia data on the interior of the operator enclosure; and

(c) receive the operational commands and transmit the operational commands to the server for execution by the self-driving vehicle.

2. The system of claim 1 , wherein the capture assembly includes a camera.

3. The system of claim 1 , wherein the operator subsystem further comprises an input device; the computing device configured to receive the operational commands via the input device.

4. The system of claim 3 , wherein the operator subsystem further comprises a command device including the input device.

5. The system of claim 4 , wherein the command device includes a tablet computer configured to receive the status data from the computing device and configured to receive the operational commands for transmission to the computing device.

6. The system of claim 1 , the server configured to receive the status data from the self-driving vehicles and to relay the status data to the computing device.

7. The system of claim 1 , wherein the display assembly includes a plurality of display devices controllable by the computing device.

8. The system of claim 7 , wherein the plurality of display devices include an auxiliary display device mounted on an exterior wall of the operator enclosure.

9. The system of claim 8 , wherein controlling the display assembly further comprises controlling the auxiliary display to present a portion of the multimedia data.

10. The system of claim 1 , the computing device further configured to generate an overlay corresponding to the self-driving vehicle and present the overlay with the multimedia data via the display assembly.

11. The system of claim 1 , wherein the capture assembly includes a microphone.

12. A method for remote viewing and control of self-driving vehicles, comprising:

at an execution location containing a self-driving vehicle, controlling a capture assembly of an execution subsystem to capture multimedia data depicting the execution location;

transmitting the multimedia data from a server of the execution subsystem, for presentation at an operator location remote from the execution location;

at a computing device of an operator subsystem at the operator location, establishing a connection with the server, receiving the multimedia data from the server and controlling a display assembly of the operator subsystem to present the multimedia data on an interior of an operator enclosure of the operator subsystem, the operator enclosure supporting the display assembly;

at the computing device, receiving operational commands and transmitting the operational commands to the server;

at the server, receiving the operational commands and deploying the operational commands to the self-driving vehicle.

13. The method of claim 12 , wherein the capture assembly includes a camera.

14. The method of claim 12 , wherein the operator subsystem further comprises an input device; and wherein receiving the operational commands includes receiving the operational commands via the input device.

15. The method of claim 14 , wherein the operator subsystem further comprises a command device including the input device.

16. The method of claim 15 , further comprising:

receiving the status data from the computing device at the command device;

receiving the operational commands at the input device; and

transmitting the operational commands to the computing device.

17. The method of claim 12 , further comprising: receiving the status data at the server from the self-driving vehicles; and

relaying the status data to the computing device.

18. The method of claim 12 , wherein the display assembly includes an auxiliary display device mounted on an exterior wall of the operator enclosure; and

wherein controlling the display assembly further comprises controlling the auxiliary display to present a portion of the multimedia data.

19. The method of claim 12 , further comprising:

at the computing device, generating an overlay corresponding to the self-driving vehicle and presenting the overlay with the multimedia data via the display assembly.

20. The method of claim 12 , wherein the display assembly includes a plurality of display devices.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY'S NAME FROM CLEARPATH ROBOTICS, INC. TO CLEARPATH ROBOTICS INC. (WITHOUT THE COMMA) PREVIOUSLY RECORDED ON REEL 67944 FRAME 916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 25, 2024
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 068233/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: CLEARPATH ROBOTICS, INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 067944/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: ROCKWELL AUTOMATION, INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 067944/0982 →
NUNC PRO TUNC ASSIGNMENT Recorded Sep 18, 2020
From: GARIEPY, RYAN CHRISTOPHER
To: CLEARPATH ROBOTICS INC.
Reel/Frame 053814/0308 →
Continuity (2)
Provisional Application 62636245 · Feb 28, 2018
Related Publication 20190265693A1 · Aug 29, 2019