IP Library Granted Patent US 11,906,961
Granted Patent B2
US 11,906,961 · App. 17/220,111 · Granted Feb 20, 2024

Systems and methods for unmanned vehicles having self-calibrating sensors and actuators

Inventors: Ryan Christopher Gariepy (Kitchener, CA); Kareem Shehata (Kitchener, CA); Prasenjit Mukherjee (Mississauga, CA); Anthony Tod (St. Agatha, CA); Teyvonia Thomas (Kitchener, CA); Yan Ma (Waterloo, CA)
Assignee: CLEARPATH ROBOTICS INC.
G05D1/0011G05D1/024G05D1/0246G05D2201/0216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,906,961
App. No.
17/220,111
Granted
Feb 20, 2024
Kind
B2
Abstract

Systems and methods of unmanned vehicles having self-calibrating sensors and actuators are provided. The unmanned vehicle comprises a communication interface and a processor for controlling a propulsion system of the vehicle and receiving sensor data from one or more sensors of the vehicle. The processor is configured to operate in a guided calibration mode by controlling the propulsion system according to commands received from an external guided control system, while processing the sensor data to determine a degree of certainty on a calibration the sensor data and a position of the vehicle. The processor determines that the degree of certainty is above a threshold value associated with safe operation of the propulsion system in an autonomous calibration mode, and subsequently switch operation of the propulsion system to the autonomous calibration mode based on the determination that the degree of certainty is above the threshold value.

Claims (61)

1. An unmanned vehicle comprising:

a chassis;

a processor for controlling a propulsion system of the unmanned vehicle and receiving sensor data from one or more sensors of the unmanned vehicle, the processor is configured to:

prior to entering an autonomous calibration mode, enumerate unmanned vehicle capabilities, by one or more of: receiving a weight of the unmanned vehicle; receiving one or more dimensions of the unmanned vehicle; autodetecting each of the one or more sensors; receiving a list of the one or more sensors; and using a scanner to scan one or more graphical identifiers of the one or more sensors;

operate the propulsion system in the autonomous calibration mode by:

automatically controlling the propulsion system to move the chassis;

collecting the sensor data from the one or more sensors;

selecting one or more uncertainty propagation models from a plurality of uncertainty propagation models based on at least one of i.) one or more unmanned vehicle capabilities and ii.) the sensor data; and

processing the sensor data using the one or more uncertainty propagation models to determine at least one degree of certainty on a calibration of one or more of the sensor data and a position of the chassis;

determine that the degree of certainty is above a threshold value; and

subsequently switch operation of the propulsion system to an operational mode based on the determination that the degree of certainty is above the threshold value.

2. The unmanned vehicle of claim 1 , wherein selecting the one or more uncertainty propagation models comprises selecting one or more kinematic models, dynamic models, and/or extrinsic models.

3. The unmanned vehicle of claim 1 , wherein the processor is further configured to determine that the enumerated unmanned vehicle capabilities support a performance level threshold, and subsequently enable the autonomous calibration mode based on the determination that the one or more enumerated unmanned vehicle capabilities satisfies the performance level threshold.

4. The unmanned vehicle of claim 1 , wherein the processor is further configured to process the sensor data using one or more uncertainty propagation models to determine the degree of certainty of one or more of: a respective calibration of a relationship between uncertainty on sensor measurements with respect to the position of the chassis; a respective location of each of the one or more sensors with respect to the chassis; a respective orientation of each of the one or more sensors with respect to the chassis; and, one or more of respective shapes and respective location of sensed features.

5. The unmanned vehicle of claim 1 , wherein the one or more sensors comprise one or more of: cameras, LIDAR (Light Detection and Ranging) devices, laser sensing devices, radar devices, accelerometers, and magnetometers.

6. The unmanned vehicle of claim 1 , wherein the threshold value comprises a respective constraint on one or more of: a control algorithm, a mapping algorithm, a localization algorithm, at least one performance capability, and at least one current probability distribution.

7. An unmanned vehicle comprising:

a chassis;

a processor for controlling a propulsion system of the unmanned vehicle and receiving sensor data from one or more sensors of the unmanned vehicle, the processor is configured told:

enumerate one or more unmanned vehicle capabilities by querying one or more of the propulsion system and the one or more sensors of the unmanned vehicle;

operate the propulsion system in an autonomous calibration mode by:

automatically controlling the propulsion system to move the chassis;

collecting the sensor data from the one or more sensors;

selecting one or more uncertainty propagation models from a plurality of uncertainty propagation models based on at least one of i.) one or more unmanned vehicle capabilities and ii.) the sensor data; and

processing the sensor data using the one or more uncertainty propagation models to determine at least one degree of certainty on a calibration of one or more of the sensor data and a position of the chassis;

determine that the degree of certainty is above a threshold value; and

subsequently switch operation of the propulsion system to an operational mode based on the determination that the degree of certainty is above the threshold value.

8. The unmanned vehicle of claim 7 , wherein the enumerating the one or more unmanned vehicle capabilities comprises one or more of: receiving sensor capability data; and autodetecting sensor capability data.

9. The unmanned vehicle of claim 7 , wherein the processor is further configured to determine that the enumerated unmanned vehicle capabilities support a performance level threshold, and subsequently enable the autonomous calibration mode based on the determination that the one or more enumerated unmanned vehicle capabilities satisfies the performance level threshold.

10. An unmanned vehicle comprising:

a chassis;

a communication interface; and

a processor for controlling a propulsion system of the unmanned vehicle and receiving sensor data from one or more sensors of the unmanned vehicle, the processor is configured to:

prior to entering an guided calibration mode, enumerate unmanned vehicle capabilities, by one or more of: receiving a weight of the unmanned vehicle; receiving one or more dimensions of the unmanned vehicle; autodetecting each of the one or more sensors; receiving a list of the one or more sensors; and using a scanner to scan one or more graphical identifiers of the one or more sensors;

in the guided calibration mode, while controlling the propulsion system according to commands received via the communications interface from an external guided control system, select one or more uncertainty propagation models from a plurality of uncertainty propagation models based on at least one of i.) one or more unmanned vehicle capabilities and ii.) the sensor data and, process the sensor data using the one or more uncertainty propagation models to determine at least one degree of certainty on a calibration of one or more of the sensor data and a position of the chassis;

determine that the degree of certainty is above a threshold value associated with a safe operation of the propulsion system in an autonomous calibration mode; and

subsequently switch operation of the propulsion system to the autonomous calibration mode based on the determination that the degree of certainty is above the threshold value.

11. The unmanned vehicle of claim 10 , wherein selecting the one or more uncertainty propagation models comprises selecting one or more kinematic models, dynamic models, and/or extrinsic models.

12. The unmanned vehicle of claim 10 , wherein the processor is further configured to determine that the enumerated unmanned vehicle capabilities support a performance level threshold, and subsequently enable the guided calibration mode based on the determination that the enumerated unmanned vehicle capabilities satisfies the performance level threshold.

13. The unmanned vehicle of claim 10 , wherein the processor is further configured to process the sensor data using one or more uncertainty propagation models to determine the degree of certainty of one or more of: a respective calibration of a relationship between uncertainty on sensor measurements with respect to the position of the chassis; a respective location of each of the one or more sensors with respect to the chassis; a respective orientation of each of the one or more sensors with respect to the chassis; and, one or more of respective shapes and respective location of sensed features.

14. The unmanned vehicle of claim 10 , wherein the one or more sensors comprise on or more of: cameras, LIDAR (Light Detection and Ranging) devices, laser sensing devices, radar devices, accelerometers, and magnetometers.

15. The unmanned vehicle of claim 10 , wherein the threshold value comprises a respective constraint on one or more of: a control algorithm, a mapping algorithm, a localization algorithm, at least one performance capability, and at least one current probability distribution.

16. An unmanned vehicle comprising:

a chassis;

a communication interface; and

a processor for controlling a propulsion system of the unmanned vehicle and receiving sensor data from one or more sensors of the unmanned vehicle, the processor is configured to:

enumerate one or more unmanned vehicle capabilities by querying one or more of the propulsion system and the one or more sensors of the unmanned vehicle;

in the guided calibration mode, while controlling the propulsion system according to commands received via the communications interface from an external guided control system, select one or more uncertainty propagation models from a plurality of uncertainty propagation models based on at least one of i.) one or more unmanned vehicle capabilities and ii.) the sensor data and, process the sensor data using the one or more uncertainty propagation models to determine at least one degree of certainty on a calibration of one or more of the sensor data and a position of the chassis;

determine that the degree of certainty is above a threshold value associated with a safe operation of the propulsion system in an autonomous calibration mode; and

subsequently switch operation of the propulsion system to the autonomous calibration mode based on the determination that the degree of certainty is above the threshold value.

17. The unmanned vehicle of claim 16 , wherein the enumerating the unmanned vehicle capabilities comprises one or more of: receiving sensor capability data; and autodetecting sensor capability data.

18. The unmanned vehicle of claim 16 , wherein the processor is further configured to determine that the enumerated one or more unmanned vehicle capabilities support a performance level threshold, and subsequently enable the guided calibration mode based on the determination that the enumerated one or more unmanned vehicle capabilities satisfies the performance level threshold.

19. An unmanned vehicle comprising:

a chassis;

a communication interface; and

a processor for controlling a propulsion system of the unmanned vehicle and receiving sensor data from one or more sensors of the unmanned vehicle, the processor configured to:

in a guided calibration mode, while controlling the propulsion system according to commands received via the communications interface from an external guided control system, select one or more uncertainty propagation models from a plurality of uncertainty propagation models based on at least one of i.) one or more unmanned vehicle capabilities and ii.) the sensor data and, process the sensor data using the one or more uncertainty propagation models to determine at least one degree of certainty on a calibration of one or more of the sensor data and a position of the chassis;

automatically switch operation of the propulsion system to an autonomous calibration mode when the degree of certainty is above a first threshold value associated with a safe operation of the propulsion system in the autonomous calibration mode;

in an autonomous calibration mode, while automatically controlling the propulsion system to move the chassis, collecting the sensor data from the one or more sensors; and further processing the sensor data using the one or more uncertainty propagation models to determine at least one further degree of certainty on the calibration; and

automatically switch operation of the propulsion system to an operational mode when the further degree of certainty is above a second threshold value greater than the first threshold value.

20. The unmanned vehicle of claim 19 , wherein selecting the one or more uncertainty propagation models comprises selecting one or more kinematic models, dynamic models, and/or extrinsic models.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY'S NAME FROM CLEARPATH ROBOTICS, INC. TO CLEARPATH ROBOTICS INC. (WITHOUT THE COMMA) PREVIOUSLY RECORDED ON REEL 67944 FRAME 916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 25, 2024
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 068233/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: CLEARPATH ROBOTICS, INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 067944/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: ROCKWELL AUTOMATION, INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 067944/0982 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: GARIEPY, RYAN CHRISTOPHER; SHEHATA, KAREEM; MUKHERJEE, PRASENJIT; TOD, ANTHONY; THOMAS, TEYVONIA; MA, YAN
To: CLEARPATH ROBOTICS INC.
Reel/Frame 057979/0968 →
Continuity (5)
Continuation 16011760 · Jun 19, 2018
Continuation 15691643 · Aug 30, 2017
Continuation 14879210 · Oct 9, 2015
Provisional Application 62076569 · Nov 7, 2014
Related Publication 20210286351A1 · Sep 16, 2021