IP Library Granted Patent US 11,975,955
Granted Patent B2
US 11,975,955 · App. 18/296,788 · Granted May 7, 2024

Autonomous material transport vehicles, and systems and methods of operating thereof

Inventors: Nolan Lunscher (Kitchener, CA); Enrique Fernandez Perdomo (Girona, ES); James Servos (Kitchener, CA); Ryan Christopher Gariepy (Kitchener, CA)
Assignee: CLEARPATH ROBOTICS INC.
B66F9/063B66F9/0755G05D1/0223G05D1/0238G06N3/08G06T7/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,975,955
App. No.
18/296,788
Granted
May 7, 2024
Kind
B2
Abstract

The various embodiments described herein generally relate to an autonomous material transport vehicle, and systems and methods for operating an autonomous material transport vehicle. The autonomous material transport vehicle comprises: a sensing system operable to monitor an environment of the vehicle; a drive system for operating the vehicle; a processor operable to: receive a location of a load; initiate the drive system to navigate the vehicle to the location; following initiation of the drive system, operate the sensing system to monitor for one or more objects within a detection range; and in response to the sensing system detecting the one or more objects within the detection range, determine whether the load is within the detection range; and when the load is within the detection range, operate the drive system to position the vehicle for transporting the load, otherwise, determine a collision avoidance operation to avoid the one or more objects.

Claims (63)

1. An autonomous material transport vehicle comprising:

a sensing system operable to monitor an environment of the vehicle, the sensing system comprising a sensing processor and one or more sensors;

a drive system for operating the vehicle;

a vehicle processor in communication with the sensing system and the drive system, the vehicle processor being operationally independent from the sensing processor, and the vehicle processor being operable to:

receive a location of a load;

initiate the drive system to navigate the vehicle to the location;

operate the sensing processor to determine whether one or more objects detected within a detection range comprises the load, and in response to determining the one or more objects comprises the load, alerting the vehicle processor of the load and ceasing operation of the sensing system, otherwise,

receive one or more sensor inputs from the one or more sensors; and

initiate a collision avoidance control operation based on one or more of the one or more sensor inputs to control the drive system to avoid the one or more objects and a user input directing the drive system to avoid the one or more objects, the collision avoidance control operation overriding control of the drive system by the vehicle processor; and

automatically operate the drive system for transporting the load in response to receiving an alert from the sensing processor indicating the one or more objects comprises the load.

2. The vehicle of claim 1 , wherein one or more of the vehicle processor and the sensing processor is operable to terminate power supply to the drive system to avoid the one or more objects.

3. The vehicle of claim 1 , wherein one or more of the vehicle processor and the sensing processor is operable to stop the drive system from navigating the vehicle in order to avoid the one or more objects.

4. The vehicle of claim 1 , wherein one or more of the vehicle processor and the sensing processor is operable to determine an avoidance maneuver that avoids the one or more object.

5. The vehicle of claim 4 , wherein the avoidance maneuver comprises operating the drive system to follow an alternative path to the location.

6. The vehicle of claim 4 , wherein the one or more of the vehicle processor and the sensing processor is operable to adjust an operating speed of the vehicle to accommodate the determination of the avoidance maneuver.

7. The vehicle of claim 1 , wherein one or more of the vehicle processor and the sensing processor is operable to:

determine a depth and an angular sweep for the detection range.

8. The vehicle of claim 1 , wherein one or more of the vehicle processor and the sensing processor is operable to:

determine an operating speed of the vehicle; and

define the detection range based at least on the operating speed of the vehicle.

9. The vehicle of claim 1 , wherein the detection range comprises two or more regions.

10. The vehicle of claim 1 , wherein the vehicle processor is operable to:

initiate the sensing system to collect image data of the environment of the vehicle following initiation of the drive system; and

determine from the collected image data whether the load is within the detection range.

11. The vehicle of claim 10 , wherein the sensing processor is operable to:

conduct image segmentation to the collected image data to determine whether the load is within the detection range.

12. The vehicle of claim 11 , wherein the sensing processor is operable to:

conduct the image segmentation based on a load dataset developed from applying a neural network to a load training dataset related to the load, the load dataset being stored in a data storage accessible by the processor.

13. The vehicle of claim 1 , wherein one or more of the vehicle processor and the sensing processor is operable to determine whether the load is within the detection range based on a location of the vehicle.

14. The vehicle of claim 1 , wherein the vehicle processor is operable to position the vehicle for transporting the load by:

operating the sensing system to collect image data of the environment of the vehicle;

conducting image segmentation on the collected image data to identify the load; and

determining a load receiving maneuver for positioning the vehicle into a load receiving position based on the segmented image data of the load.

15. The vehicle of claim 14 , wherein the vehicle processor is operable to:

conduct the image segmentation based on a load dataset developed from applying a neural network to a load training dataset related to the load, the load dataset being stored in a data storage accessible by one or more of the vehicle processor and the sensing processor.

16. The vehicle of claim 1 , wherein the sensing processor is operable to control the drive system when determining the collision avoidance operation, and to return control of the drive system to the vehicle processor when the collision avoidance operation is complete.

17. The vehicle of claim 1 , wherein the sensing system comprises at least one of an optical sensor and a time-of-flight sensor.

18. The vehicle of claim 1 comprises a forklift.

19. A method of operating an autonomous material transport vehicle having a vehicle processor, the method comprising operating the vehicle processor to:

receive a location of a load;

initiate a drive system in communication with the vehicle processor to navigate the vehicle to the location;

operate a sensing system in communication with the vehicle processor to determine whether one or more objects detected within a detection range comprises the load, the sensing system being operable to monitor an environment of the vehicle and comprising a sensing processor and one or more sensors, the vehicle processor being operationally independent from the sensing processor, and in response to determining the one or more objects comprises the load, operating the sensing system to alert the vehicle processor of the load and to cease operation of the sensing system, otherwise, operating the sensing system to:

receive one or more sensor inputs from the one or more sensors; and

initiate a collision avoidance control operation based on one or more of the one or more sensor inputs to control the drive system to avoid the one or more objects and a user input directing the drive system to avoid the one or more objects, the collision avoidance control operation overriding control of the drive system by the vehicle processor; and

automatically operate the drive system for transporting the load in response to receiving an alert from the sensing processor indicating the one or more objects comprises the load.

20. The method of claim 19 further comprises operating one or more of the vehicle processor and the sensing processor to adjust an operating speed of the vehicle to accommodate the determination of the avoidance maneuver.

21. The method of claim 19 further comprises operating one or more of the vehicle processor and the sensing processor to:

determine an operating speed of the vehicle; and

define the detection range based at least on the operating speed of the vehicle.

22. The method of claim 19 further comprises operating the vehicle processor to:

initiate the sensing system to collect image data of the environment of the vehicle following initiation of the drive system; and

determine from the collected image data whether the load is within the detection range.

23. The method of claim 22 comprises operating the sensing processor to:

conduct image segmentation to the collected image data to determine whether the load is within the detection range.

24. The method of claim 23 comprises operating the sensing processor to:

conduct the image segmentation based on a load dataset developed from applying a neural network to a load training dataset related to the load, the load dataset being stored in a data storage accessible by the processor.

25. The method of claim 19 comprises operating the vehicle processor to position the vehicle for transporting the load by:

operating the sensing system to collect image data of the environment of the vehicle;

conducting image segmentation on the collected image data to identify the load; and

determining a load receiving maneuver for positioning the vehicle into a load receiving position based on the segmented image data of the load.

26. The method of claim 25 comprises operating the vehicle processor to:

conduct the image segmentation based on a load dataset developed from applying a neural network to a load training dataset related to the load, the load dataset being stored in a data storage accessible by one or more of the vehicle processor and the sensing processor.

27. The method of claim 19 comprises operating the sensing processor to control the drive system when determining the collision avoidance operation, and to return control of the drive system to the vehicle processor when the collision avoidance operation is complete.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY'S NAME FROM CLEARPATH ROBOTICS, INC. TO CLEARPATH ROBOTICS INC. (WITHOUT THE COMMA) PREVIOUSLY RECORDED ON REEL 67944 FRAME 916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 25, 2024
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 068233/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: CLEARPATH ROBOTICS, INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 067944/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: ROCKWELL AUTOMATION, INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 067944/0982 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2023
From: LUNSCHER, NOLAN; PERDOMO, ENRIQUE FERNANDEZ; SERVOS, JAMES; GARIEPY, RYAN CHRISTOPHER
To: CLEARPATH ROBOTICS INC.
Reel/Frame 063508/0792 →
Continuity (3)
Continuation 17021406 · Sep 15, 2020
Provisional Application 62903292 · Sep 20, 2019
Related Publication 20230382701A1 · Nov 30, 2023