IP Library Granted Patent US 12,099,354
Granted Patent B2
US 12,099,354 · App. 18/471,626 · Granted Sep 24, 2024

Systems and methods for monitoring a self-driving vehicle

Inventors: Anthony William Tod (St. Agatha, CA); Ryan Christopher Gariepy (Kitchener, CA)
Assignee: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
G05D1/0038G05D1/0016G05D1/0291H04N7/183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,099,354
App. No.
18/471,626
Granted
Sep 24, 2024
Kind
B2
Abstract

Systems and methods for monitoring a self-driving vehicle are presented. The system comprises a camera, a processor, a communications transceiver, a computer-readable medium, and a display device. The processor can be configured to receive an image of a self-driving vehicle from the camera, and vehicle information from the self-driving vehicle. A graphic comprising the image of the self-driving vehicle and a visual representation of the vehicle information is then displayed on the display device. The vehicle information may comprise any or all of vehicle-status information, vehicle-mission information, vehicle-metric information, and vehicle-environment information.

Claims (48)

1. A device for monitoring a plurality of self-driving vehicles, comprising:

a processor;

a camera in communication with the processor;

a communications transceiver in communication with the processor for communicating with the plurality of self-driving vehicles;

a computer-readable medium in communication with the processor;

a display device in communication with the processor, the display device being adjacent to the camera;

the computer-readable medium storing instructions that, when executed, configure the processor to:

receive an image of at least one unidentified self-driving vehicle of the plurality of self-driving vehicles, the image captured by the camera;

identify the at least one unidentified self-driving vehicle based on the image captured by the camera;

determine an orientation of the at least one identified self-driving vehicle relative to the camera based on the image captured by the camera;

receive vehicle information associated with the at least one identified self-driving vehicle;

generate a graphic comprising at least one visual representation of the vehicle information, wherein the at least one visual representation of the vehicle information is oriented within the graphic based on the orientation of the at least one identified self-driving vehicle relative to the camera; and

display the graphic on the display device.

2. The device of claim 1 , wherein the at least one visual representation of the vehicle information comprises a plurality of visual representations of the vehicle information.

3. The device of claim 1 , wherein the vehicle information comprises component information associated with one or more components of the identified self-driving vehicle.

4. The device of claim 3 , wherein the component information comprises at least one motor speed of the at least one identified self-driving vehicle.

5. The device of claim 3 , wherein the component information comprises at least one motor temperature of the at least one identified self-driving vehicle.

6. The device of claim 3 , wherein the component status information comprises a chassis condition of the at least one identified self-driving vehicle.

7. The device of claim 1 , wherein the at least one visual representation of the vehicle information comprises at least one non-textual visual representation.

8. A method for monitoring a plurality of self-driving vehicles, comprising:

capturing an image of at least one unidentified self-driving vehicle of the plurality of self-driving vehicles using a monitoring device in communication with the plurality of self-driving vehicles;

identifying the at least one unidentified self-driving vehicle based on the image captured by the monitoring device;

determining an orientation of the at least one identified self-driving vehicle relative to the monitoring device based on the image captured by the monitoring device;

receiving vehicle information associated with the at least one identified self-driving vehicle using the monitoring device;

generating a graphic comprising at least one visual representation of the vehicle information, wherein the at least one visual representation of the vehicle information is oriented within the graphic based on the orientation of the at least one identified self-driving vehicle relative to the monitoring device; and

displaying the graphic at the monitoring device.

9. The method of claim 8 , wherein the at least one visual representation of the vehicle information comprises a plurality of visual representations of the vehicle information.

10. The method of claim 8 , wherein the vehicle information comprises component information associated with one or more components of the identified self-driving vehicle.

11. The method of claim 10 , wherein the component information comprises at least one motor speed of the at least one identified self-driving vehicle.

12. The method of claim 10 , wherein the component information comprises at least one motor temperature of the at least one identified self-driving vehicle.

13. The method of claim 10 , wherein the component status information comprises a chassis condition of the at least one identified self-driving vehicle.

14. The method of claim 8 , wherein the at least one visual representation of the vehicle information comprises at least one non-textual visual representation.

15. A system for monitoring a plurality of self-driving vehicles, comprising:

a fleet-management system for communicating with the plurality of self-driving vehicles;

a display terminal in communication with the fleet-management system;

one or more cameras in communication with the display terminal, at least one camera of the one or more cameras being adjacent to the display terminal; the display terminal having a display device, a processor, and a computer-readable medium storing instructions that, when executed, configure the processor to:

receive an image of at least one unidentified self-driving vehicle of the plurality of self-driving vehicles, the image captured by the at least one camera;

identify the at least one unidentified self-driving vehicle based on the image captured by the at least one camera;

determine an orientation of the at least one identified self-driving vehicle relative to the at least one camera based on the image captured by the at least one camera;

receive vehicle information associated with the at least one identified self-driving vehicle;

generate a graphic comprising at least one visual representation of the vehicle information, wherein the at least one visual representation of the vehicle information is oriented within the graphic based on the orientation of the at least one identified self-driving vehicle relative to the at least one camera; and

display the graphic on the display device.

16. The system of claim 15 , wherein the at least one visual representation of the vehicle information comprises a plurality of visual representations of the vehicle information.

17. The system of claim 15 , wherein the vehicle information comprises component information associated with one or more components of the identified self-driving vehicle.

18. The system of claim 17 , wherein the component information comprises at least one motor speed of the at least one identified self-driving vehicle.

19. The system of claim 17 , wherein the component information comprises at least one motor temperature of the at least one identified self-driving vehicle.

20. The system of claim 17 , wherein the component status information comprises a chassis condition of the at least one identified self-driving vehicle.

21. The system of claim 15 , wherein the at least one visual representation of the vehicle information comprises at least one non-textual visual representation.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY'S NAME FROM CLEARPATH ROBOTICS, INC. TO CLEARPATH ROBOTICS INC. (WITHOUT THE COMMA) PREVIOUSLY RECORDED ON REEL 67944 FRAME 916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 25, 2024
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 068233/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: CLEARPATH ROBOTICS, INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 067944/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: ROCKWELL AUTOMATION, INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 067944/0982 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2023
From: TOD, ANTHONY; GARIEPY, RYAN CHRISTOPHER
To: CLEARPATH ROBOTICS INC.
Reel/Frame 064985/0429 →
Continuity (4)
Continuation 17400433 · Aug 12, 2021
Continuation 16044598 · Jul 25, 2018
Provisional Application 62537195 · Jul 26, 2017
Related Publication 20240045423A1 · Feb 8, 2024