IP Library › Granted Patent US 12,654,320
Granted Patent B2
US 12,654,320 · App. 18/614,355 · Granted Jun 16, 2026

Learning abstractions for multi-robot path planning in unstructured environments

Inventors: Naman P. Shah (Tempe, AZ); Georgios Fainekos (Novi, MI); Bardh Hoxha (Canton, MI); Hideki Okamoto (Ann Arbor, MI); Danil V. Prokhorov (Canton, MI)
Assignees: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
B25J9/1664B25J9/161
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,654,320
App. No.
18/614,355
Filed
Mar 22, 2024
Granted
Jun 16, 2026
Kind
B2
Art Unit
3656
USPC
700/245
Abstract

A computing system may include a processor. The computing system may include a memory having a set of instructions, which when executed by the processor, cause the computing system to determine paths in an abstract state for a first robot to progress from an origin to a destination, determine a cost for each respective path of the paths based on a congestion measurement of the respective path and a measurement of the abstract state, select a selected path from the paths that is associated with a lowest cost from the costs, and compute a motion plan for the first robot to traverse the selected path.

Claims (52)

1 . A computing system comprising:

a processor; and

a memory having a set of instructions, which when executed by the processor, cause the computing system to:

determine paths in abstract states for a first robot to progress from an origin to a destination;

determine a cost for each respective path of the paths by normalizing a congestion measurement of a respective abstract state of the abstract states forming the respective path based on a size of the respective abstract state;

select a selected path from the paths that is associated with a lowest cost from the costs; and

compute a motion plan for the first robot to traverse the selected path.

2 . The computing system of claim 1 , wherein each of the congestion measurements includes a human congestion measurement of the respective path.

3 . The computing system of claim 2 , wherein the instructions of the memory, when executed, cause the computing system to:

receive a transmission from a second robot that indicates positions of humans; and

compute at least one of the human congestion measurements based on the positions of the humans.

4 . The computing system of claim 1 , wherein each of the congestion measurements includes a robot congestion measurement of the respective path.

5 . The computing system of claim 4 , wherein the instructions of the memory, when executed, cause the computing system to:

receive a transmission from a second robot that indicates positions of the second robot; and

compute at least one of the robot congestion measurements based on the positions of the second robot.

6 . The computing system of claim 1 ,

wherein to determine the cost for each respective path of the paths, the instructions of the memory, when executed, cause the computing system to determine the cost based on a length of the respective path in the abstract state.

7 . The computing system of claim 1 , wherein the instructions of the memory, when executed, cause the computing system to:

move the first robot along the selected path based on the motion plan.

8 . At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing device, cause the computing device to:

determine paths in abstract states for a first robot to traverse between an origin and a destination;

determine a cost for each respective path of the paths by normalizing a congestion measurement of a respective abstract state of the abstract states forming the respective path based on a size of the respective abstract state;

select a selected path from the paths that is associated with a lowest cost from the costs; and

compute a motion plan for the first robot to traverse the selected path.

9 . The at least one non-transitory computer readable storage medium of claim 8 , wherein each of the congestion measurements includes a human congestion measurement of the respective path.

10 . The at least one non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the computing device to:

receive a transmission from a second robot that indicate positions of humans; and

compute at least one of the human congestion measurements based on the positions of the humans.

11 . The at least one non-transitory computer readable storage medium of claim 8 , wherein each of the congestion measurements includes a robot congestion measurement of the respective path.

12 . The at least one non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed, cause the computing device to:

receive a transmission from a second robot that indicates positions of the second robot; and

compute at least one of the robot congestion measurements based on the positions of the second robot.

13 . The at least one non-transitory computer readable storage medium of claim 8 ,

wherein to determine the cost for each respective path of the paths, the instructions, when executed, cause the computing device to determine the cost based on a length of the respective path in the abstract state.

14 . The at least one non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the computing device to:

move the first robot along the selected path based on the motion plan.

15 . A method comprising:

determining paths in abstract states for a first robot to traverse between an origin and a destination;

determining a cost for each respective path of the paths by normalizing a congestion measurement of a respective abstract state of the abstract states forming the respective path based on a size of the respective abstract state;

selecting a selected path from the paths that is associated with a lowest cost from the costs; and

computing a motion plan for the first robot to traverse the selected path.

16 . The method of claim 15 , wherein each of the congestion measurements includes a human congestion measurement of the respective path.

17 . The method of claim 16 , further comprising:

receiving a transmission from a second robot that indicates positions of humans; and

computing at least one of the human congestion measurements based on the positions of the humans.

18 . The method of claim 15 , wherein each of the congestion measurements includes a robot congestion measurement of the respective path.

19 . The method of claim 18 , wherein the method further comprises:

receiving a transmission from a second robot that indicates positions of the second robot; and

computing at least one of the robot congestion measurements based on the positions of the second robot.

20 . The method of claim 15 , wherein:

the determining the cost for each respective path of the paths includes determining the cost based on a length of the respective path in the abstract state; and

the method further comprises moving the first robot along the selected path based on the motion plan.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2026
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 075444/0320 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2024
From: SHAH, NAMAN P.; FAINEKOS, GEORGIOS; HOXHA, BARDH; OKAMOTO, HIDEKI; PROKHOROV, DANIL V.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 066897/0778 →
Continuity (2)
Provisional Application 63590252 · Oct 13, 2023
Related Publication 20250121500A1 · Apr 17, 2025
References Cited (47)
US 10606269B2 · Millard · 2020 [cited by examiner]
US 10809734B2 · De Castro · 2020 [cited by examiner]
US 10845821B2 · Canoso · 2020 [cited by examiner]
US 11650591B1 · Millard · 2023 [cited by examiner]
US 11927965B2 · Ebrahimi Afrouzi · 2024 [cited by examiner]
US 12025985B2 · Van De Velde · 2024 [cited by examiner]
US 12333512B2 · Cella · 2025 [cited by examiner]
US 12367438B2 · Grant · 2025 [cited by examiner]
US 12420844B2 · Chen · 2025 [cited by examiner]
US 20180281191A1 · Sinyavskiy · 2018 [cited by examiner]
US 20190086934A1 · Canoso · 2019 [cited by examiner]
US 20190187703A1 · Millard · 2019 [cited by examiner]
US 20200042018A1 · Chiba · 2020 [cited by examiner]
US 20200293044A1 · Millard · 2020 [cited by examiner]
US 20200293049A1 · De Castro · 2020 [cited by examiner]
US 20200398428A1 · Murray · 2020 [cited by examiner]
US 20210046655A1 · Deyle · 2021 [cited by examiner]
US 20220066456A1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 20220105629A1 · Natarajan · 2022 [cited by examiner]
US 20220163969A1 · Li · 2022 [cited by examiner]
US 20220236736A1 · de la Guardia Gonzalez · 2022 [cited by examiner]
US 20220288781A1 · Schoessler · 2022 [cited by examiner]
US 20220306152A1 · Zhang · 2022 [cited by examiner]
US 20220307849A1 · Chattopadhyay · 2022 [cited by examiner]
US 20220382287A1 · Van De Velde · 2022 [cited by examiner]
US 20230202042A1 · Johnson · 2023 [cited by examiner]
US 20230386335A1 · Beaurepaire · 2023 [cited by examiner]
JP 2021501380A · 2021 [cited by applicant]
TW I804220B · 2023 [cited by applicant]
WO 2019234702A2 · 2019 [cited by applicant]
LaValle, “Rapidly-exploring random trees: A new tool for path planning”, Research Report 9811 (1998). [cited by applicant]
Kuffner et al., “RRT-connect: An efficient approach to single-query path planning”, https://ieeexplore.ieee.org/abstract/document/844730, Proceedings 2000 ICRA, Millennium Conference, IEEE International Conference on Ro… [cited by applicant]
Kavraki et al., “Probabilistic roadmaps for path planning in high-dimensional configuration spaces”, https://ieeexplore.ieee.org/abstract/document/508439, IEEE transactions on Robotics and Automation 12.4 (1996): 566-58… [cited by applicant]
Brock et al., “Decomposition-based Motion Planning: A Framework for Real-Time Motion Planning in High-Dimensional Configuration Spaces”, In Proc. ICRA, 2001, 6 pages. [cited by applicant]
Uwacu et al., “Hierarchical Planning With Annotated Skeleton Guidance”, https://ieeexplore.ieee.org/abstract/document/9851528, IEEE Robotics and Automation Letters 7.4 (2022) : 11055-11061, 7 pages. [cited by applicant]
Shah et al., “Using Deep Learning to Bootstrap Abstractions for Hierarchical Robot Planning”, https://arxiv.org/abs/2202.00907, 21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022, Inte… [cited by applicant]
Kottinger et al., “Conflict-based search for multi-robot motion planning with kinodynamic constraints”, https://ieeexplore.ieee.org/abstract/document/9982018, 2022 IEEE/RSJ International Conference on Intelligent Robots… [cited by applicant]
Phillips et al., “Sipp: Safe interval path planning for dynamic environments”, https://ieeexplore.ieee.org/abstract/document/5980306, 2011 IEEE international conference on robotics and automation. IEEE, 2011, 8 pages. [cited by applicant]
Street et al., “Multi-robot planning under uncertainty with congestion-aware models”, https://www.ifaamas.org/Proceedings/aamas2020/pdfs/p1314.pdf, (2020), 9 pages. [cited by applicant]
Cecchi et al. “Priority-based distributed coordination for heterogeneous multi-robot systems with realistic assumptions”, https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9461616, IEEE Robotics and Automation Letter… [cited by applicant]
Mannucci et al., “On provably safe and live multirobot coordination with online goal posting”, https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9448306, IEEE Transactions on Robotics 37.6 (2021): 1973-1991, 19 pages. [cited by applicant]
Molina et al., “Identifying Critical Regions for Motion Planning using Auto-Generated Saliency Labels with Convolutional Neural Networks”, Proc. ICRA, 2019, 6 pages. [cited by applicant]
Varambally, et al., “Which MAPF Model Works Best for Automated Warehousing?”, In Proceedings of the International Symposium on Combinatorial Search, vol. 15, No. 1, 2022, pp. 190-198. [cited by applicant]
Shah et al., “Multi-Task Option Learning and Discovery for Stochastic Path Planning”, arXiv preprint arXiv, 2210.00068, (2022). [cited by applicant]
Street et al., “Congestion-aware policy synthesis for multirobot systems”, IEEE Transactions on Robotics 38, No. 1 (2021) : pp. 262-280. [cited by applicant]
Shah et al., “Learning to Create Abstraction Hierarchies for Motion Planning under Uncertainty”, presented work supported by NSF under grant IIS 1942856, Arizona State University, Tempe, AZ, USA, (Jun. 2023) 14 pages. [cited by applicant]
Arul et al., “Dense Multi-Agent Navigation Using Voronoi Cells and Congestion Metric-based Replanning”, arXiv:2202.11334V1 [cs.RO], Feb. 23, 2022, 7 pages. [cited by applicant]