IP Library Granted Patent US 11,209,277
Granted Patent B2
US 11,209,277 · App. 16/829,395 · Granted Dec 28, 2021

Systems and methods for electronic mapping and localization within a facility

Inventors: Adel Fakih (Kitchener, CA); Ryan Christopher Gariepy (Kitchener, CA)
Assignee: Clearpath Robotics Inc.
G01C21/206G01C21/32G01C21/367G05D1/0246G05D1/0274G06F30/13G06F30/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,209,277
App. No.
16/829,395
Granted
Dec 28, 2021
Kind
B2
Abstract

Systems and methods for electronically mapping a facility are presented. The method comprises obtaining a CAD file that includes graphical representations of a facility. An occupancy-map image is generated based on the CAD file. A sensor, such as a sensor on a self-driving vehicle, is used to detect a sensed feature within the facility. Based on the sensed feature, the occupancy-map image can be updated, since the sensed feature was not one of the known features in the CAD file prior to the sensed feature being detected by the sensor.

Claims (52)

1. A method for electronically mapping a facility, the method comprising:

obtaining, by a processor, a CAD file from at least one non-transitory computer-readable medium, the CAD file having graphical representations representing at least one known feature of the facility;

generating, by the processor, a keyframe graph based on the CAD file;

storing a map file on the at least one non-transitory computer-readable medium, wherein the map file comprises the keyframe graph;

detecting, by the processor, a sensed feature in the facility with at least one sensor;

updating, by the processor, the keyframe graph based on the sensed feature, wherein the sensed feature is not a feature of the at least one known feature of the facility prior to the processor detecting the sensed feature; and

mapping the facility based on the updated keyframe graph.

2. The method of claim 1 , wherein generating the keyframe graph based on the sensed feature comprises determining a plurality of poses based on a range of the at least one sensor.

3. The method of claim 1 , wherein the keyframe graph comprises a plurality of keyframes, each keyframe associated with a pose.

4. The method of claim 1 , further comprising:

detecting the at least one known feature of the facility with the at least one sensor; and

locating the at least one sensor relative to the keyframe graph based on the detecting the at least one known feature.

5. The method of claim 4 , wherein locating the at least one sensor relative to the keyframe graph comprises determining a pose of the at least one sensor associated with a keyframe matching the at least one known, feature.

6. The method of claim 5 , wherein determining the pose of the at least one sensor associated with the keyframe matching the at least one known feature comprises:

identifying the matched keyframe from a plurality of keyframes, each keyframe being associated with a pose.

7. The method of claim 1 , wherein the at least one sensor is in communication with a control system of a self-driving vehicle; and the method further comprising:

navigating the self-driving vehicle based on the keyframe graph.

8. The method of claim 1 , wherein the at least one sensor comprises a LiDAR device.

9. The method of claim 1 , wherein the at least one sensor comprises a vision system.

10. A system for electronically mapping a facility, the system comprising:

at least one non-transitory computer-readable medium;

at least one sensor; and

a processor operable to:

obtain a CAD file from the at least one non-transitory computer-readable medium, the CAD file having graphical representations representing at least one known feature of the facility;

generate a keyframe graph based on the CAD file;

store a map file on the at least one non-transitory computer-readable medium, wherein the map file comprises the keyframe graph;

detect a sensed feature in the facility with the at least one sensor;

update the keyframe graph based on the sensed feature; wherein the sensed feature is not a feature of the at least one known feature of the facility prior to the processor detecting the sensed feature; and

map the facility based on the updated keyframe graph.

11. The system of claim 10 wherein the processor is operable to:

generate the keyframe graph by determining a plurality of poses based on a range of the at least one sensor.

12. The system of claim 10 wherein the keyframe graph comprises a plurality of keyframes, each keyframe associated with a pose.

13. The system of claim 10 wherein the processor is operable to:

detect the at least one known feature of the facility with the at least one sensor; and locate the at least one sensor relative to the keyframe graph based on the detecting the at least one known feature.

14. The system of claim 13 wherein the processor is operable to:

determine a pose of the at least one sensor associated with a keyframe matching the at least one known feature.

15. The system of claim 14 , wherein the processor is operable to identify the matched keyframe from a plurality of keyframes, each keyframe being associated with a pose.

16. The system of claim 10 , wherein:

the at least one sensor is in communication with a control system of a self-driving vehicle; and

the processor is operable to navigate the self-driving vehicle based on the keyframe graph.

17. The system of claim 10 , wherein the at least one sensor comprises a LiDAR device.

18. The system of claim 10 , wherein the at least one sensor comprises a vision system.

19. A non-transitory computer-readable medium comprising instructions executable on a processor for implementing a method for electronically mapping a facility, the method comprising operating the processor to:

obtain a CAD file from at least one non-transitory computer-readable medium, the CAD file having graphical representations representing at least one known feature of the facility;

generate a keyframe graph based on the CAD file;

store a map file on the at least one non-transitory computer-readable medium, wherein the map file comprises the keyframe graph;

detect a sensed feature in the facility with at least one sensor;

update the keyframe graph based on the sensed feature, wherein the sensed feature is not a feature of the at least one known feature of the facility prior to the processor detecting the sensed feature; and

map the facility based on the updated keyframe graph.

20. The non-transitory computer-readable medium of claim 19 wherein the method further comprises operating the processor to:

detect the at least one known feature of the facility with the at least one sensor; and

locate the at least one sensor relative to the keyframe graph based on the detecting the at least one known feature.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY'S NAME FROM CLEARPATH ROBOTICS, INC. TO CLEARPATH ROBOTICS INC. (WITHOUT THE COMMA) PREVIOUSLY RECORDED ON REEL 67944 FRAME 916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 25, 2024
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 068233/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: CLEARPATH ROBOTICS, INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 067944/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: ROCKWELL AUTOMATION, INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 067944/0982 →
NUNC PRO TUNC ASSIGNMENT Recorded Apr 14, 2020
From: FAKIH, ADEL; GARIEPY, RYAN CHRISTOPHER
To: CLEARPATH ROBOTICS INC.
Reel/Frame 052387/0907 →
Continuity (3)
Continuation 16000331 · Jun 5, 2018
Provisional Application 62515744 · Jun 6, 2017
Related Publication 20200292319A1 · Sep 17, 2020