IP Library › Granted Patent US 12,547,175
Granted Patent B2
US 12,547,175 · App. 17/796,206 · Granted Feb 10, 2026

Planning in mobile robots

Inventors: Henry Pulver (Bristol, GB); Majd Hawasly (Bristol, GB); Subramanian Ramamoorthy (Bristol, GB); Francisco Eiras (Bristol, GB); Ludovico Carozza (Bristol, GB)
Assignee: Five AI Limited
G05D1/0214G05D1/0088G05D1/0217G05D1/0221G05D1/0238G05D1/0246
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,547,175
App. No.
17/796,206
Granted
Feb 10, 2026
Kind
B2
Abstract

A computer system for planning mobile robot trajectories, the computer system comprising: an input configured to receive a set of scenario description parameters describing a scenario and a desired goal for the mobile robot therein; a runtime optimizer configured to compute a final mobile robot trajectory that substantially optimizes a cost function for the scenario, subject to a set of hard constraints that the final mobile robot trajectory is guaranteed to satisfy; and a trained function approximator configured to compute, from the set of scenario description parameters, initialization data defining an initial mobile robot trajectory. The computer system is configured to initialize the runtime optimizer with the initialization data, in order to guide the optimizer from the initial mobile robot trajectory to the final mobile robot trajectory that satisfies the hard constraints, the function approximator having been trained on example sets of scenario description parameters and ground truth initialization data for the example sets of scenario description parameters.

Claims (33)

1 . A computer system for planning mobile robot trajectories, the computer system comprising one or more hardware processors configured to:

receive a set of scenario description parameters describing a scenario and a desired goal for a mobile robot in the scenario;

implement a runtime optimizer to compute a final mobile robot trajectory for the mobile robot that substantially optimizes a cost function for the desired goal in the scenario, subject to a set of hard constraints for the scenario that the final mobile robot trajectory is guaranteed to satisfy;

implement a function approximator to compute, from the set of scenario description parameters, initialization data defining an initial mobile robot trajectory for the mobile robot;

initialize the runtime optimizer with the initialization data;

guide the runtime optimizer from the initial mobile robot trajectory to the final mobile robot trajectory that satisfies the set of hard constraints, the function approximator having been trained on example sets of scenario description parameters and ground truth initialization data for the example sets of scenario description parameters;

generate a series of control signals for controlling the mobile robot to follow the final mobile robot trajectory; and

control motion of the mobile robot to follow the final mobile robot trajectory based on the series of control signals.

2 . The computer system of claim 1 , wherein the function approximator has been trained to approximate a reference planner, the ground truth initialization data having been generated by applying the reference planner to the example sets of scenario description parameters.

3 . The computer system of claim 1 , wherein the runtime optimizer is configured to determine a series of control actions, and compute the final mobile robot trajectory by applying a robot dynamics model to the series of control actions.

4 . The computer system of claim 3 , wherein the initialization data comprises an initial sequence of control actions defining the initial mobile robot trajectory.

5 . The computer system of claim 1 , wherein the set of hard constraints comprise one or more collision avoidance constraints for one or more static or moving obstacles in the scenario, and location(s) of the one or more static or moving obstacles are encoded in the set of scenario description parameters for use by the function approximator.

6 . The computer system of claim 1 , wherein the set of hard constraints comprise one or more permitted area constraints for keeping the mobile robot within a permitted area, and the permitted area is encoded in the set of scenario description parameters for use by the function approximator.

7 . The computer system of claim 1 , wherein the desired goal is defined relative to a reference path, and the cost function encourages achievement of the desired goal by penalizing at least one of lateral deviation from the reference path, and longitudinal deviation from a reference location on the reference path.

8 . The computer system of claim 7 , wherein the initial and final trajectories are represented in a frame of reference defined by the reference path.

9 . The computer system of claim 1 , wherein the function approximator has a convolutional neural network (CNN) architecture.

10 . The computer system of claim 9 , wherein the set of hard constraints comprise:

collision avoidance constraints for one or more static or moving obstacles in the scenario, wherein location(s) of the one or more static or moving obstacles are encoded in the set of scenario description parameters for use by the function approximator; or

one or more permitted area constraints for keeping the mobile robot within a permitted area, wherein the permitted area is encoded in the set of scenario description parameters for use by the function approximator;

wherein the computer system is configured to transform the set of scenario description parameters into an input tensor comprising one or more images visualizing the permitted area or the location(s) of the obstacles.

11 . The computer system of claim 10 , wherein the set of hard constraints comprise collision avoidance constraints for one or more static or moving obstacles in the scenario, wherein the input tensor comprises multiple images visualizing predicted locations of the obstacles at different time instants.

12 . The computer system of claim 10 , wherein the desired goal is defined relative to a reference path, and the cost function encourages achievement of the desired goal by penalizing at least one of lateral deviation from the reference path, and longitudinal deviation from a reference location on the reference path, and wherein the one or more images encode the reference path.

13 . The computer system of claim 12 , wherein the initial and final trajectories are represented in a frame of reference defined by the reference path, wherein the one or more images encode the reference path by visualizing the permitted area or the location(s) of the obstacles in the frame of reference defined by the reference path.

14 . The computer system of claim 1 , wherein the function approximator encodes the initial mobile robot trajectory as a set of smooth function parameters.

15 . The computer system of claim 1 , wherein the runtime optimizer is a non-linear optimizer.

16 . A computer program embodied on non-transitory computer-readable media for programming one or more computers to implement steps of:

receiving a set of scenario description parameters describing a scenario and a desired goal for a mobile robot in the scenario;

computing, by applying a function approximator to the set of scenario description parameters, initialization data defining an initial mobile robot trajectory for the mobile robot; and

computing, by applying a runtime optimizer, a final mobile robot trajectory for the mobile robot that substantially optimizes a cost function for the desired goal in the scenario, subject to a set of hard constraints for the scenario that the final mobile robot trajectory is guaranteed to satisfy,

initializing the runtime optimizer with the initialization data;

guiding the runtime optimizer from the initial mobile robot trajectory to the final mobile robot trajectory that satisfies the set of hard constraints, the function approximator having been trained on example sets of scenario description parameters and ground truth initialization data for the example sets of scenario description parameters;

generating a series of control signals for controlling the mobile robot to follow the final mobile robot trajectory; and

controlling motion of the mobile robot to follow the final mobile robot trajectory based on the series of control signals.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2022
From: PULVER, HENRY; HAWASLY, MAJD; RAMAMOORTHY, SUBRAMANIAN; EIRAS, FRANCISCO; CAROZZA, LUDOVICO
To: FIVE AI LIMITED
Reel/Frame 061430/0284 →
Priority Claims (4)
GB 2001200 · Jan 28, 2020 · national
GB 2001202 · Jan 28, 2020 · national
GB 2001277 · Jan 30, 2020 · national
GB 2017252 · Oct 30, 2020 · national
Continuity (1)
Related Publication 20230089978A1 · Mar 23, 2023
References Cited (62)
US 9315178B1 · Ferguson et al. · 2016 [cited by applicant]
US 9632502B1 · Levinson et al. · 2017 [cited by applicant]
US 10678247B2 · Jiang et al. · 2020 [cited by applicant]
US 10884422B2 · Zhang · 2021 [cited by examiner]
US 11912311B2 · Choi · 2024 [cited by examiner]
US 12019447B2 · Xia · 2024 [cited by examiner]
US 12061474B2 · Di Cairano · 2024 [cited by examiner]
US 20090240366A1 · Kaushal et al. · 2009 [cited by applicant]
US 20170277193A1 · Frazzoli et al. · 2017 [cited by applicant]
US 20180129203A1 · Tafti et al. · 2018 [cited by applicant]
US 20180292830A1 · Kazemi · 2018 [cited by examiner]
US 20180292834A1 · Kindo · 2018 [cited by examiner]
US 20190079523A1 · Zhu · 2019 [cited by examiner]
US 20190220015A1 · Phillips et al. · 2019 [cited by applicant]
US 20190220016A1 · Phillips et al. · 2019 [cited by applicant]
US 20190286151A1 · Palanisamy · 2019 [cited by examiner]
US 20190317511A1 · Xu · 2019 [cited by examiner]
US 20200134729A1 · Matsunaga et al. · 2020 [cited by applicant]
US 20200310446A1 · Zhu · 2020 [cited by examiner]
US 20200310451A1 · Zhu · 2020 [cited by examiner]
US 20200326719A1 · Tram et al. · 2020 [cited by applicant]
US 20210094569A1 · Febbo et al. · 2021 [cited by applicant]
US 20210114617A1 · Phillips · 2021 [cited by examiner]
US 20210118245A1 · Gyllenhammar et al. · 2021 [cited by applicant]
US 20210221386A1 · Quirynen et al. · 2021 [cited by applicant]
US 20210237769A1 · Ostafew · 2021 [cited by examiner]
US 20210240190A1 · Wray · 2021 [cited by examiner]
US 20210302974A1 · Di Cairano et al. · 2021 [cited by applicant]
US 20210394794A1 · Gyllenhammar et al. · 2021 [cited by applicant]
US 20210403034A1 · Lapin · 2021 [cited by examiner]
US 20220055651A1 · Baric · 2022 [cited by examiner]
US 20220121213A1 · Hsu · 2022 [cited by examiner]
US 20220371594A1 · Raffone et al. · 2022 [cited by applicant]
US 20230089978A1 · Pulver · 2023 [cited by examiner]
US 20230365131A1 · Do · 2023 [cited by examiner]
CN 102449623A · 2012 [cited by applicant]
CN 105573323A · 2016 [cited by applicant]
CN 108292134A · 2018 [cited by applicant]
CN 108604239A · 2018 [cited by applicant]
CN 109910018A · 2019 [cited by applicant]
CN 110271556A · 2019 [cited by applicant]
CN 110462670A · 2019 [cited by applicant]
WO 2017079474A2 · 2017 [cited by applicant]
WO 2017116594A1 · 2017 [cited by applicant]
WO 2020079066A1 · 2020 [cited by applicant]
WO 2020079074A1 · 2020 [cited by applicant]
WO 2020079698A1 · 2020 [cited by applicant]
Schwarting et al., “Safe Nonlinear Trajectory Generation for Parallel Autonomy With a Dynamic Vehicle Model,” IEEE Transactions on Intelligent Transportation Systems, IEEE, Sep. 2018, vol. 19, No. 9, pp. 2994-3008. [cited by examiner]
Pokorny et al., “Topological trajectory classification with filtrations of simplicial complexes and persistent homology,” The International Journal of Robotics Research, Aug. 21, 2015, vol. 35, Nos. 1-3, pp. 204-223. [cited by applicant]
International Search Report and Written Opinion mailed Apr. 9, 2021 in corresponding International PCT Patent Application No. PCT/EP2021/052036 (13 pages). [cited by applicant]
International Search Report and Written Opinion from the International Searching Authority from related PCT Application No. PCT/EP2021/052040, dated Mar. 29, 2021, (12 pages). [cited by applicant]
Salvado et al., “Motion Planning and Goal Assignment for Robot Fleets Using Trajectory Optimization,” 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Oct. 1-5, 2018, pp. 7939-7946. [cited by applicant]
Hult et al., “An MIQP-based heuristic for Optimal Coordination of Vehicles at Intersections,” 2018 IEEE Conference on Decision and Control (CDC), IEEE, Dec. 17-19, 2018, pp. 2783-2790. [cited by applicant]
Most, Thomas, “Approximation of complex nonlinear functions by means of neural networks,” 2nd Weimar Optimization and Stochastic Days, 2005, pp. 1-17. [cited by applicant]
Eiras et al., “A Two-Stage Optimization Approach to Safe-by-Design Planning for Autonomous Driving,” arXiv.org, arXiv.2002.02215v1, Feb. 6, 2020, pp. 1-10. [cited by applicant]
International Search Report and Written Opinion from the International Searching Authority from related PCT Application No. PCT/EP2021/080206, dated May 10, 2022, (16 pages). [cited by applicant]
U.S Office Action date Sep. 3, 2024, from related U.S. Appl. No. 17/796,209. [cited by applicant]
U.S Office Action date Dec. 17, 2024, from related U.S. Appl. No. 18/011,016. [cited by applicant]
U.S. Appl. No. 17/796,209, filed Jul. 28, 2022, Majd Hawasly. [cited by applicant]
U.S. Appl. No. 18/011,016, filed Dec. 16, 2022, Francisco Eiras. [cited by applicant]
Chinese Office Action dated Apr. 23, 2025, from related Chinese Patent Application 202180057120.3 (12 pages). [cited by applicant]
Extended European Search Report dated Nov. 6, 2024, from related European Patent Application 24194819.9 (6 pages). [cited by applicant]