IP Library Granted Patent US 12,298,146
Granted Patent B2
US 12,298,146 · App. 17/864,623 · Granted May 13, 2025

Stand-alone self-driving material-transport vehicle

Inventors: Ryan Christopher Gariepy (Kitchener, CA); Jason Scharlach (Kitchener, CA); Andrew Clifford Blakey (Kitchener, CA); Simon Drexler (Kitchener, CA); James Dustin Servos (Kitchener, CA)
Assignee: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
G01C21/3626G01C21/3885G05D1/0027G05D1/0088G05D1/02G06Q10/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,298,146
App. No.
17/864,623
Granted
May 13, 2025
Kind
B2
Abstract

Systems and methods for a stand-alone self-driving material-transport vehicle are provided. A method includes: displaying a graphical map on a graphical user-interface device based on a map stored in a storage medium of the vehicle, receiving a navigation instruction based on the graphical map, and navigating the vehicle based on the navigation instruction. As the vehicle navigates, it senses features of an industrial facility using its sensor system, and locates the features relative to the map. Subsequently, the vehicle stores the updated map including the feature on the vehicle's storage medium. The map can then be shared with other vehicles or a fleet-management system.

Claims (62)

1. A method for operating one or more self-driving vehicles in an industrial facility for completing at least one recurring task, the method comprising:

operating a self-driving vehicle of the one or more self-driving vehicles, in one of a semi-autonomous mode and a guided mode, to complete one or more tasks that involve operating the self-driving vehicle to engage a feature location in the industrial facility,

wherein in the semi-autonomous mode, the self-driving vehicle is operated based on control instructions received from both user inputs and a control system of the self-driving vehicle, and in the guided mode, the self-driving vehicle is operated based on control instructions received only from user inputs;

during operation of the self-driving vehicle, recording the control instructions received in respect of the one or more tasks;

determining, based at least on the feature location and one or more characteristics of the one or more tasks, that the one or more tasks comprises the at least one recurring task for the one or more self-driving vehicles;

in response to determining that the one or more tasks comprise the at least one recurring task, generating a recipe that can be used by the one or more self-driving vehicles for subsequent operation to complete the at least one recurring task, the recipe comprising a subset of the user-provided control instructions and corresponding to a reduced amount of user-provided control instructions, wherein the recipe is generated by:

deriving one or more task instructions from the recorded control instructions to identify user-provided control instructions necessary for engaging the feature location;

evaluating the recorded control instructions to identify one or more redundant control instructions which comprise navigation instructions that can be autonomously generated by the self-driving vehicle when executing the one or more task, instructions during the subsequent operation; and

generating the recipe to include the one or more task instructions while excluding the one or more redundant control instructions; and

at a subsequent time, autonomously operating at least one of the one or more self-driving vehicles to complete the at least one recurring task according to the recipe and one or more navigation instructions autonomously generated in accordance with the recipe.

2. The method of claim 1 , wherein the one or more tasks involve operating the self-driving vehicle to navigate to one or more locations within the facility, and the control instructions comprise navigation instructions for navigating the self-driving vehicle towards the one or more locations.

3. The method of claim 2 , further comprising:

sensing a salient feature at at least one of the one or more locations using a sensor system of the self-driving vehicle;

storing an image of the salient feature in association with the at least one location; and

to complete the at least one recurring task at the subsequent time, navigating the at least one of the one or more self-driving vehicles to the at least one location in part based on the image.

4. The method of claim 1 , wherein engaging the feature location includes operating the self-driving vehicle to interact with a feature at the feature location, and the control instructions comprise one or more of: a direction of approach of the self-driving vehicle towards the feature, the self-driving vehicle's position relative to the feature upon arriving at the feature location, and an action performed by the self-driving vehicle in association with the feature.

5. The method of claim 1 , wherein the at least one of the one or more self-driving vehicles comprises one or more of:

the self-driving vehicle; and

a second self-driving vehicle, and the method further comprises transmitting the recipe to the second self-driving vehicle.

6. The method of claim 5 , wherein transmitting the recipe to the second self-driving vehicle comprises transmitting the recipe to a fleet-management system, and subsequently transmitting the recipe from the fleet-management system to the second self-driving vehicle.

7. The method of claim 1 , wherein the one or more redundant control instructions excluded from the recipe include control instructions related to navigation instructions for a path portion that is traversed at the subsequent time by the at least one of the one or more self-driving vehicles to complete the one or more tasks based on the recipe.

8. The method of claim 1 , wherein operating the self-driving vehicle to complete the one or more tasks further comprises operating the self-driving vehicle to map the facility, wherein the mapping comprises:

identifying an electronic map stored in a non-transient computer-readable medium of the self-driving vehicle, wherein the electronic map comprises a mapped area and an unmapped area separated from the mapped area by a boundary edge;

determining, based on a current location of the self-driving vehicle and the electronic map, whether the self-driving vehicle is within the mapped area;

in response to determining that the self-driving vehicle is within the mapped area, navigating the self-driving vehicle to a goal located within the unmapped area, wherein navigating the self-driving vehicle to the goal located within the unmapped area comprises:

operating the self-driving vehicle in an autonomous mode up to the boundary edge, wherein during operation in the autonomous mode, the control system of the self-driving vehicle autonomously operates a drive system of the self-driving vehicle to follow a path;

upon arrival at the boundary edge, switching the self-driving vehicle into the semi-autonomous mode to sense features within the unmapped area while navigating towards the goal;

while operating in the semi-autonomous mode, operating a sensor system of the self-driving vehicle to sense one or more features of the facility at a location in the unmapped area; and

updating the electronic map to include the one or more features within the unmapped area.

9. The method of claim 8 , wherein the self-driving vehicle autonomously navigates to perform the one or more tasks based on the updated electronic map.

10. A system for operating self-driving vehicles in an industrial facility for completing at least one recurring task, the system comprising:

a self-driving vehicle comprising a drive system for moving the self-driving vehicle, and a control system for controlling the drive system wherein the control system comprises a non-transient computer-readable medium, wherein

the control system of the self-driving vehicle being configured for:

operating the drive system, in one of a semi-autonomous mode and a guided mode, to complete one or more tasks that involve operating the self-driving vehicle to engage a feature location in the industrial facility,

wherein in the semi-autonomous mode, the drive system is operated based on control instructions received from both user inputs and the control system, and in the guided mode, the drive system is operated based on control instructions received only from user inputs;

during operation of the drive system, recording the control instructions received in respect of the one or more tasks;

determining, based at least on the feature location and one or more characteristics of the one or more tasks, that the one or more tasks comprises the at least one recurring task for the one or more self-driving vehicles;

in response to determining that the one or more tasks comprises the at least one recurring task, generating a recipe that can be used by the one or more self-driving vehicles for subsequent operation to complete the at least one recurring task, the recipe comprising a subset of the user-provided control instructions and corresponding to a reduced amount of user-provided control instructions, wherein the recipe is generated by:

deriving one or more task instructions from the recorded control instructions to identify user-provided control instructions necessary for engaging the feature location;

evaluating the recorded control instructions to identify one or more redundant control instructions which comprises navigation instructions that can be autonomously generated by the self-driving vehicle when executing the one or more task instructions during the subsequent operation; and

generating the recipe to include the one or more task instructions while excluding the one or more redundant control instructions; and

at a subsequent time, autonomously operating the drive system to complete the at least one recurring task according to the recipe and one or more navigation instructions autonomously generated in accordance with the recipe.

11. The system for operating self-driving vehicles of claim 10 , wherein the one or more tasks involve operating the drive system to navigate to one or more locations within the facility, and the control instructions comprise navigation instructions for navigating the self-driving vehicle towards the one or more locations.

12. The system for operating self-driving vehicles of claim 11 , wherein the self-driving vehicle further comprises a sensor system, and the control system is further configured for:

sensing a salient feature at at least one of the one or more locations using the sensor system;

storing, in the non-transient computer-readable medium, an image of the salient feature in association with the at least one location; and

to complete the at least one recurring task at the subsequent time, navigating the at least one self-driving vehicle to the at least one location in part based on the image.

13. The system for operating self-driving vehicles of claim 10 , wherein engaging the feature location includes operating the self-driving vehicle to interact with a feature at the feature location, and the control instructions comprise one or more of: a direction of approach of the self-driving vehicle towards the feature, the self-driving vehicle's position relative to the feature upon arriving at the feature location, and an action performed by the self-driving vehicle in association with the feature.

14. The system for operating self-driving vehicles of claim 10 , wherein the system further comprises a second self-driving vehicle, and the control system of the second vehicle being configured for:

receiving the recipe; and

autonomously operating a drive system of the second self-driving vehicle to complete the one or more tasks based on the recipe.

15. The system for operating self-driving vehicles of claim 14 , wherein the system further comprises a fleet-management system which receives the recipe from the self-driving vehicle, and transmits the recipe to the second self-driving vehicle.

16. The system for operating self-driving vehicles of claim 10 , wherein the one or more redundant control instructions excluded from the recipe include control instructions related to navigation instructions for a path portion that is traversed at the subsequent time to complete the one or more tasks based on the recipe.

17. The system for operating self-driving vehicles of claim 10 , wherein the self-driving vehicle further comprises a sensor system, and operating the self-driving vehicle to complete the one or more tasks further comprises operating the self-driving vehicle to map the facility, and wherein the mapping comprises the control system being further configured for:

identifying an electronic map stored in the non-transient computer-readable medium of the self-driving vehicle, wherein the electronic map comprises a mapped area and an unmapped area separated from the mapped area by a boundary edge;

determining, based on a current location of the self-driving vehicle and the electronic map, whether the self-driving vehicle is within the mapped area;

in response to determining that the self-driving vehicle is within the mapped area, navigating the self-driving vehicle to a goal located within the unmapped area, wherein navigating the self-driving vehicle to the goal located within the unmapped area comprises:

operating the drive system in an autonomous mode up to the boundary edge, wherein during operation in the autonomous mode, the control system of the self-driving vehicle autonomously operates the drive system of the self-driving vehicle to follow a path;

upon arrival at the boundary edge, switching the self-driving vehicle into the semi-autonomous mode to sense features within the unmapped area while navigating towards the goal;

while operating in the semi-autonomous mode, operating the sensor system to sense one or more features of the facility at a location in the unmapped area; and

updating the electronic map to include the one or more features within the unmapped area.

18. The system for operating self-driving vehicles of claim 17 , wherein the self-driving vehicle autonomously navigates to perform the one or more tasks based on the updated electronic map.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY'S NAME FROM CLEARPATH ROBOTICS, INC. TO CLEARPATH ROBOTICS INC. (WITHOUT THE COMMA) PREVIOUSLY RECORDED ON REEL 67944 FRAME 916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 25, 2024
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 068233/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: CLEARPATH ROBOTICS, INC.
To: ROCKWELL AUTOMATION, INC.
Reel/Frame 067944/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: ROCKWELL AUTOMATION, INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 067944/0982 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2022
From: GARIEPY, RYAN CHRISTOPHER; SCHARLACH, JASON; DREXLER, SIMON; SERVOS, JAMES DUSTIN
To: CLEARPATH ROBOTICS INC.
Reel/Frame 061548/0437 →
EMPLOYMENT AGREEMENT Recorded Oct 26, 2022
From: BLAKEY, ANDREW
To: CLEARPATH ROBOTICS INC.
Reel/Frame 061783/0928 →
Continuity (4)
Continuation 16539249 · Aug 13, 2019
Continuation PCTCA2018050464 · Apr 18, 2018
Provisional Application 62486936 · Apr 18, 2017
Related Publication 20220357174A1 · Nov 10, 2022
References Cited (127)
US 5023790A · Luke, Jr. · 1991 [cited by applicant]
US 6315513B1 · Harukawa et al. · 2001 [cited by applicant]
US 6463360B1 · Terada et al. · 2002 [cited by applicant]
US 7693757B2 · Zimmerman · 2010 [cited by applicant]
US 8190295B1 · Garretson et al. · 2012 [cited by applicant]
US 8634981B1 · Hyde et al. · 2014 [cited by applicant]
US 8694193B2 · Mäkeläet al. · 2014 [cited by applicant]
US 9114440B1 · Colucci · 2015 [cited by applicant]
US 9280153B1 · Palamarchuk et al. · 2016 [cited by applicant]
US 9351569B1 · Lucey et al. · 2016 [cited by applicant]
US 9358975B1 · Watts · 2016 [cited by applicant]
US 9465388B1 · Fairfield et al. · 2016 [cited by applicant]
US 9486917B2 · Reid et al. · 2016 [cited by applicant]
US 9487356B1 · Aggarwal · 2016 [cited by applicant]
US 9557738B2 · Enke · 2017 [cited by examiner]
US 9632502B1 · Levinson et al. · 2017 [cited by applicant]
US 9733646B1 · Nusser · 2017 [cited by applicant]
US 9928749B2 · Gil et al. · 2018 [cited by applicant]
US RE47108E · Jacobus et al. · 2018 [cited by applicant]
US 10112771B2 · D'Andrea et al. · 2018 [cited by applicant]
US 10317119B2 · Zou · 2019 [cited by applicant]
US 10328769B2 · Ferguson et al. · 2019 [cited by applicant]
US 10577199B2 · Lee et al. · 2020 [cited by applicant]
US 11167964B2 · Gariepy et al. · 2021 [cited by applicant]
US 11263579B1 · Siegel · 2022 [cited by applicant]
US 20020154974A1 · Fukuda et al. · 2002 [cited by applicant]
US 20040158355A1 · Holmqvist et al. · 2004 [cited by applicant]
US 20050216126A1 · Koselka et al. · 2005 [cited by applicant]
US 20070106306A1 · Bodduluri et al. · 2007 [cited by applicant]
US 20070294029A1 · D'Andrea et al. · 2007 [cited by applicant]
US 20080183599A1 · Hill et al. · 2008 [cited by applicant]
US 20090012667A1 · Matsumoto et al. · 2009 [cited by applicant]
US 20090043440A1 · Matsukawa et al. · 2009 [cited by applicant]
US 20100021272A1 · Ward et al. · 2010 [cited by applicant]
US 20100030417A1 · Fang et al. · 2010 [cited by applicant]
US 20100030466A1 · Rogers et al. · 2010 [cited by applicant]
US 20100049391A1 · Nakano · 2010 [cited by applicant]
US 20100063680A1 · Tolstedt et al. · 2010 [cited by applicant]
US 20100106356A1 · Trepagnier · 2010 [cited by examiner]
US 20100206651A1 · Nagasaka · 2010 [cited by applicant]
US 20100316470A1 · Lert et al. · 2010 [cited by applicant]
US 20100321489A1 · Chen et al. · 2010 [cited by applicant]
US 20120121161A1 · Eade et al. · 2012 [cited by applicant]
US 20120173018A1 · Allen · 2012 [cited by examiner]
US 20120197464A1 · Wang et al. · 2012 [cited by applicant]
US 20120296471A1 · Inaba et al. · 2012 [cited by applicant]
US 20130054129A1 · Wong et al. · 2013 [cited by applicant]
US 20130054133A1 · Lewis et al. · 2013 [cited by applicant]
US 20130086215A1 · Trotta et al. · 2013 [cited by applicant]
US 20130226340A1 · Buchstab · 2013 [cited by applicant]
US 20130231779A1 · Purkayastha et al. · 2013 [cited by applicant]
US 20140002439A1 · Lynch · 2014 [cited by applicant]
US 20140040431A1 · Rao et al. · 2014 [cited by applicant]
US 20140188324A1 · Waltz et al. · 2014 [cited by applicant]
US 20140229004A1 · Dooley · 2014 [cited by examiner]
US 20140244004A1 · Scott et al. · 2014 [cited by applicant]
US 20140277691A1 · Jacobus · 2014 [cited by applicant]
US 20140309833A1 · Ferguson · 2014 [cited by examiner]
US 20140350725A1 · LaFary et al. · 2014 [cited by applicant]
US 20140365113A1 · Mcgavran et al. · 2014 [cited by applicant]
US 20140365258A1 · Vestal et al. · 2014 [cited by applicant]
US 20150032252A1 · Galluzzo et al. · 2015 [cited by applicant]
US 20150088310A1 · Pinter · 2015 [cited by examiner]
US 20150197009A1 · Melikian · 2015 [cited by applicant]
US 20150217455A1 · Kikkeri et al. · 2015 [cited by applicant]
US 20150248131A1 · Fairfield et al. · 2015 [cited by applicant]
US 20150309485A1 · Nishi · 2015 [cited by applicant]
US 20150343638A1 · Mattern et al. · 2015 [cited by applicant]
US 20150352721A1 · Wicks et al. · 2015 [cited by applicant]
US 20160005229A1 · Lee et al. · 2016 [cited by applicant]
US 20160086494A1 · Anandayuvaraj et al. · 2016 [cited by applicant]
US 20160101940A1 · Grinnell et al. · 2016 [cited by applicant]
US 20160246301A1 · Kazama et al. · 2016 [cited by applicant]
US 20160271800A1 · Stubbs et al. · 2016 [cited by applicant]
US 20160327951A1 · Walton et al. · 2016 [cited by applicant]
US 20170039765A1 · Zhou et al. · 2017 [cited by applicant]
US 20170100837A1 · Zevenbergen et al. · 2017 [cited by applicant]
US 20170113352A1 · Lutz et al. · 2017 [cited by applicant]
US 20170116477A1 · Chen et al. · 2017 [cited by applicant]
US 20170122749A1 · Urano et al. · 2017 [cited by applicant]
US 20170168488A1 · Wierzynski · 2017 [cited by examiner]
US 20170308096A1 · Nusser et al. · 2017 [cited by applicant]
US 20170341236A1 · Patrick et al. · 2017 [cited by applicant]
US 20170351261A1 · Levinson et al. · 2017 [cited by applicant]
US 20180001474A1 · Sinyavskiy et al. · 2018 [cited by applicant]
US 20180009000A1 · Shang et al. · 2018 [cited by applicant]
US 20180058861A1 · Doria et al. · 2018 [cited by applicant]
US 20180060765A1 · Hance et al. · 2018 [cited by applicant]
US 20180086575A1 · Mccarthy et al. · 2018 [cited by applicant]
US 20180188045A1 · Wheeler et al. · 2018 [cited by applicant]
US 20180190046A1 · Levinson et al. · 2018 [cited by applicant]
US 20180264648A1 · Kim et al. · 2018 [cited by applicant]
US 20180305125A1 · Guo et al. · 2018 [cited by applicant]
US 20180336421A1 · Huang et al. · 2018 [cited by applicant]
US 20180362270A1 · Clucas et al. · 2018 [cited by applicant]
US 20190079537A1 · Yoshida et al. · 2019 [cited by applicant]
US 20190129425A1 · Drexler · 2019 [cited by applicant]
US 20190129431A1 · Yalla et al. · 2019 [cited by applicant]
US 20190133397A1 · Choe · 2019 [cited by applicant]
US 20190146500A1 · Yalla et al. · 2019 [cited by applicant]
US 20190179307A1 · Anderson et al. · 2019 [cited by applicant]
US 20190323845A1 · Agarwal · 2019 [cited by applicant]
US 20200047343A1 · Bal et al. · 2020 [cited by applicant]
US 20200050213A1 · Lim · 2020 [cited by applicant]
US 20200051443A1 · Zhao et al. · 2020 [cited by applicant]
US 20200082179A1 · Sugie · 2020 [cited by applicant]
US 20200089232A1 · Gdalyahu et al. · 2020 [cited by applicant]
US 20200104289A1 · Premawardena · 2020 [cited by applicant]
US 20200206928A1 · Denenberg et al. · 2020 [cited by applicant]
US 20220024047A1 · Bouchard et al. · 2022 [cited by applicant]
US 20220341906A1 · Lam et al. · 2022 [cited by applicant]
US 20220355495A1 · Rembisz et al. · 2022 [cited by applicant]
US 20220365533A1 · Drexler · 2022 [cited by applicant]
CA 2762743A1 · 2012 [cited by applicant]
CN 109187063A · 2019 [cited by applicant]
CN 108839025B · 2020 [cited by applicant]
DE 112018006030T5 · 2020 [cited by applicant]
EP 2385435A1 · 2011 [cited by applicant]
JP 2009031884A · 2009 [cited by applicant]
JP 2009123045A · 2009 [cited by applicant]
WO 2011146259A2 · 2011 [cited by applicant]
Shneier et al., “Literature Review of Mobile Robots for Manufacturing”, May 2015, NIST. (Year: 2015). [cited by applicant]
Takahashi et al., “Developing a mobile robot for transport applications in the hospital domain”, Mar. 2010, Robotics and Autonomous Systems 58 (2010). Year: 2010). [cited by applicant]
Hasan et al., “An Autonomous Robot for Intelligent Security Systems”, Aug. 2018, 9th IEEE Control and System Graduate Research Colloquium (ICSGRC 2018). (Year: 2018). [cited by applicant]
Bengel et al., “Mobile Robots for Offshore Inspection and Manipulation”, Oct. 2009, the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. (Year: 2009). [cited by applicant]
Wikipedia Vehicular Automation, https://web.archive.org/web/20140402022211/https://en.wikipedia.org/wiki/vehicular_automation, retrieved by Archive.org on Apr. 2, 2014 (Year: 2014) (3 pages). [cited by applicant]
http://www.digitalglobe.com/downloaded on May 6, 2014 (3 pages). [cited by applicant]