IP Library Granted Patent US 11,794,731
Granted Patent B2
US 11,794,731 · App. 17/308,688 · Granted Oct 24, 2023

Waypoint prediction for vehicle motion planning

Inventors: Siddhesh Shyam Khandelwal (Vancouver, CA); William Junbo Qi (Pittsburgh, PA); Jagjeet Singh (Pittsburgh, PA); Andrew T. Hartnett (West Hartford, CT); Deva Ramanan (Pittsburgh, PA)
Assignee: Ford Global Technologies, LLC
B60W30/09B60W30/0953B60W30/0956B60W60/0015G06V20/56G06V40/25B60W2420/42B60W2420/52B60W2554/4029B60W2554/4044B60W2554/4045B60W2554/4046G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,794,731
App. No.
17/308,688
Granted
Oct 24, 2023
Kind
B2
Abstract

Systems and methods of determining trajectories of an actor in an environment in which a vehicle is operating are provided. The method includes, by an object detection system of a vehicle in an environment, detecting an actor that may move within a scene in the environment. The method further includes using context of the scene to determine a reference polyline for the actor and determining a kinematic history of the actor. The method additionally includes using the kinematic history to predict a waypoint, which is a predicted position of the actor at a conclusion of a waypoint time period, and identifying a segment of the reference polyline, the segment extending from a current location to a point along the reference polyline that is closest to the waypoint and determining a trajectory for the actor conditioned by the segment of the reference polyline.

Claims (46)

1. A method of determining trajectories of an actor in an environment in which a vehicle is operating, the method comprising:

by an object detection system of a vehicle in an environment, detecting an actor that may move within a scene in the environment;

using context of the scene to determine a reference polyline for the actor, wherein the reference polyline defines a path along which the actor may travel within the scene over a time period;

determining a kinematic history of the actor, wherein the kinematic history includes a measured path of movement of the actor;

using the kinematic history to predict a waypoint, wherein the waypoint is a predicted position of the actor at a conclusion of a waypoint time period;

identifying a segment of the reference polyline, the segment extending from a current location to a point along the reference polyline that is closest to the waypoint; and

determining a trajectory for the actor conditioned by the segment of the reference polyline.

2. The method of claim 1 , wherein using the context of the scene to determine the reference polylines for the actor comprises:

determining a plurality of lane segments along which the actor may travel; and

selecting the reference polyline, wherein the reference polyline corresponds to a lane segment in the plurality of lane segments that will not cause the actor to violate a scene context rule.

3. The method of claim 1 , further comprising, by the vehicle, using the determined trajectory to cause the vehicle to take one or more actions.

4. The method of claim 3 , wherein the one or more actions include one or more of the following:

altering a path of the vehicle;

altering a pose of the vehicle; or

altering a velocity of the vehicle.

5. A system for determining trajectories of an actor in an environment in which a vehicle is operating, the system comprising:

an object detection system configured to detect an actor that may move within a scene in an environment of a vehicle; and

a computer-readable storage medium comprising one or more programming instructions that, when executed, will cause the vehicle to:

use context of the scene to determine a reference polyline for the actor, wherein the reference polyline defines a path along which the actor may travel within the scene over a time period;

determine a kinematic history of the actor, wherein the kinematic history includes a measured path of movement of the actor;

use the kinematic history to predict a waypoint, wherein the waypoint is a predicted position of the actor at a conclusion of a waypoint time period;

identify a segment of the reference polyline, the segment extending from a current location to a point along the reference polyline that is closest to the waypoint; and

determine a trajectory for the actor conditioned by the segment of the reference polyline.

6. The system of claim 5 , wherein the instructions to use the context of the scene to determine the reference polylines for the actor comprise instructions to:

determine a plurality of lane segments along which the actor may travel; and

select the reference polyline, wherein the reference polyline corresponds to a lane segment in the plurality of lane segments that will not cause the actor to violate a scene context rule.

7. The system of claim 5 , wherein the computer-readable storage medium further includes one or more programming instructions that, when executed, will cause the vehicle to use the determined trajectory to take one or more actions.

8. The system of claim 7 , wherein the one or more actions include one or more of the following:

altering trajectory path of the vehicle;

altering a pose of the vehicle; or

altering a velocity of the vehicle.

9. A non-transitory computer-readable storage medium comprising one or more programming instructions that, when executed, will cause a processor to:

use an object detection system of a vehicle to detect an actor that may move within a scene in an environment around the vehicle;

use context of the scene to determine a reference polyline for the actor, wherein the reference polyline defines a path along which the actor may travel within the scene over a time period;

determine a kinematic history of the actor, wherein the kinematic history includes a measured path of movement of the actor;

use the kinematic history to predict a waypoint, wherein the waypoint is a predicted position of the actor at a conclusion of a waypoint time period;

identify a segment of the reference polyline, the segment extending from a current location to a point along the reference polyline that is closest to the waypoint; and

determine a trajectory for the actor conditioned by the segment of the reference polyline.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the instructions to use the context of the scene to determine the reference polylines for the actor comprise instructions to:

determine a plurality of lane segments along which the actor may travel; and

select the reference polyline, wherein the reference polyline corresponds to a lane segment in the plurality of lane segments that will not cause the actor to violate a scene context rule.

11. The non-transitory computer-readable storage medium of claim 9 , further comprising additional programming instructions that, when executed, will cause the vehicle to use the determined trajectory to take one or more actions.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the one or more actions include one or more of the following:

altering trajectory path of the vehicle;

altering a pose of the vehicle; or

altering a velocity of the vehicle.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2023
From: ARGO AI, LLC
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 063025/0346 →
CORRECTIVE ASSIGNMENT TO CORRECT THE FOURTH INVENTOR'S NAME PREVIOUSLY RECORDED AT REEL: 056147 FRAME: 0107. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded May 6, 2021
From: KHANDELWAL, SIDDHESH SHYAM; QI, WILLIAM JUNBO; SINGH, JAGJEET; HARTNETT, ANDREW T.; RAMANAN, DEVA
To: ARGO AI, LLC
Reel/Frame 056169/0868 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2021
From: KHANDELWAL, SIDDHESH SHYAM; QI, WILLIAM JUNBO; SINGH, JAGJEET; HARNETT, ANDREW T.; RAMANAN, DEVA
To: ARGO AI, LLC
Reel/Frame 056147/0107 →
Continuity (2)
Provisional Application 63064598 · Aug 12, 2020
Related Publication 20220048498A1 · Feb 17, 2022