IP Library Granted Patent US 12,304,487
Granted Patent B2
US 12,304,487 · App. 16/360,572 · Granted May 20, 2025

Safe autonomous overtaking with intention estimation

Inventors: Necmiye Ozay (Ann Arbor, MI); Vishnu S. Chipade (Ann Arbor, MI); Qiang Shen (Tempe, AZ); Lixing Huang (Ann Arbor, MI); Sze Zheng Yong (Mesa, AZ); Dimitra Panagou (Ann Arbor, MI)
Assignees: The Regents of the University of Michigan; AZ Brd Regents on Behalf of AZ State University
B60W30/18163B60W30/0956G05D1/0088G08G1/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,304,487
App. No.
16/360,572
Granted
May 20, 2025
Kind
B2
Abstract

The present disclosure provides a method in a data processing system that includes at least one processor and at least one memory. The at least one memory includes instructions executed by the at least one processor to implement a vehicle overtaking system. The method includes causing a vehicle control system in an ego vehicle to execute at least a portion of an input control sequence, receiving, from a first plurality of sensors coupled to the ego vehicle, lead vehicle data about a lead vehicle, estimating an intention of the lead vehicle based on the lead vehicle data, and causing the vehicle control system to perform a vehicle maneuver based on the intention of the lead vehicle.

Claims (69)

1. A method implemented by a data processing system comprising at least one processor and at least one memory, the at least one memory comprising a plurality of dynamics models and instructions executed by the at least one processor to implement a vehicle overtaking system, the method comprising:

determining, at a first time, an input control sequence for an ego vehicle, the input control sequence comprising a plurality of acceleration values of the ego vehicle, the plurality of acceleration values being determined to ensure that an observed trajectory of a lead vehicle over a finite time horizon is only consistent with one dynamics model of the plurality of dynamics models, wherein the first time is prior to the finite time horizon, wherein the input control sequence is designed to ensure that output trajectories of each of the plurality of dynamics models differ by a predetermined threshold in at least one time instance within a testing period. wherein the testing period is prior to the finite time horizon;

causing a vehicle control system in the ego vehicle to execute at least a first acceleration value of the plurality of acceleration values of the input control sequence;

receiving, from a first plurality of sensors coupled to the ego vehicle, lead vehicle data about the lead vehicle;

estimating an intention of the lead vehicle by selecting a dynamics model predictive of a maneuver of the lead vehicle that includes a physics-based parameter based on the lead vehicle data;

generating a desired location ahead of the lead vehicle based on the dynamics model corresponding to the estimated intention;

calculating, based on the desired location, a trajectory for the ego vehicle, the trajectory calculated to move the ego vehicle toward the desired position; and

causing the vehicle control system to perform a vehicle maneuver based on the calculated trajectory.

2. The method of claim 1 further comprising:

receiving, from a second plurality of sensors coupled to the ego vehicle, oncoming vehicle data about an oncoming vehicle; and

receiving, from a third plurality of sensors coupled to the ego vehicle, ego vehicle data about the ego vehicle.

3. The method of claim 2 , wherein at least one sensor of the first plurality of sensors belongs to the second plurality of sensors and the third plurality of sensors.

4. The method of claim 2 , wherein the input control sequence comprises a plurality of discrete time points and at least a portion of the ego vehicle data, lead vehicle data, and the oncoming vehicle data is associated with one of the discrete time points.

5. The method of claim 2 , wherein the vehicle maneuver comprises:

determining the ego vehicle is unable to overtake the lead vehicle while keeping the ego vehicle within a predetermined set of safety constraints based on at least one of the ego vehicle data, lead vehicle data, oncoming vehicle data, or the estimated intention of the lead vehicle; and

piloting the ego vehicle to follow behind the lead vehicle within the predetermined set of safety constraints.

6. The method of claim 5 , wherein the predetermined set of safety constraints comprises a predetermined headway separation distance between the ego vehicle and the lead vehicle.

7. The method of claim 2 , wherein the vehicle maneuver comprises:

determining the ego vehicle is able to overtake the lead vehicle while keeping the ego vehicle within a predetermined set of safety constraints based on at least one of the ego vehicle data, lead vehicle data, oncoming vehicle data, or the estimated intention of the lead vehicle; and

piloting the ego vehicle along a trajectory to overtake the lead vehicle within the predetermined set of safety constraints.

8. The method of claim 7 , wherein the method further comprises calculating the trajectory based on an ego vehicle speed, a lead vehicle speed, an ego vehicle location, and a lead vehicle location, wherein each of the ego vehicle speed, the lead vehicle speed, the ego vehicle location, and the lead vehicle location are based on at least one of the ego vehicle data and the lead vehicle data.

9. The method of claim 7 , wherein the determining the ego vehicle is able to overtake the lead vehicle while keeping the ego vehicle within the predetermined set of safety constraints is further based on at least one of an oncoming vehicle speed and an oncoming vehicle location, each of the oncoming vehicle speed and the oncoming vehicle location based on the oncoming vehicle data.

10. The method of claim 1 , wherein determining the intention of the lead vehicle comprises:

providing the lead vehicle data to a model selection algorithm;

receiving an output of the model selection algorithm;

determining a most likely intention of the lead vehicle based on the output of the model selection algorithm.

11. The method of claim 10 , wherein the lead vehicle data comprises a lead vehicle speed.

12. A driving control system for an ego vehicle, the driving control system comprising:

a first plurality of sensors coupled to the ego vehicle; and

a controller in electrical communication with the first plurality of sensors, the controller being configured to execute a program stored in the controller to:

determine, at a first time, an input control sequence for the ego vehicle, the input control sequence comprising a plurality of acceleration values of the ego vehicle, the plurality of acceleration values being determined to ensure that an observed trajectory of a lead vehicle is consistent with only one dynamics model of a plurality of dynamics models, wherein the input control sequence is designed to ensure that output trajectories of each of the plurality of dynamics models differ by a predetermined threshold in at least one time instance within a testing period;

for each dynamics model of the plurality of dynamics models, calculate at least one physics-based parameter based on at least a portion of the input control sequence;

cause a vehicle control system in the ego vehicle to execute at least a portion of the input control sequence;

receive, from a first plurality of sensors coupled to the ego vehicle, lead vehicle data about the lead vehicle;

estimate an intention of the lead vehicle by selecting a dynamics model from the plurality of dynamics models, the dynamics model being selected based on the lead vehicle data and the at least one physics-based parameter corresponding to the dynamics model;

generate a desired location based on the lead vehicle data and the selected dynamics model;

generate, based on the selected dynamics model and the desired location, a velocity vector field for the ego vehicle, the velocity vector field generated to guide the ego vehicle around the lead vehicle to the desired location; and

cause the vehicle control system to perform a vehicle maneuver based on the velocity vector field and the estimated intention of the lead vehicle.

13. The system of claim 12 further comprising:

a second plurality of sensors coupled to the ego vehicle; and

a third plurality of sensors coupled to the ego vehicle, and wherein the controller is further configured to:

receive, from the second plurality of sensors coupled to the ego vehicle, oncoming vehicle data about an oncoming vehicle; and

receive, from the third plurality of sensors coupled to the ego vehicle, ego vehicle data about the ego vehicle.

14. The system of claim 13 , wherein at least one sensor of the first plurality of sensors belongs to the second plurality of sensors and the third plurality of sensors.

15. The system of claim 13 , wherein the input control sequence comprises a plurality of discrete time points and at least a portion of the ego vehicle data, lead vehicle data, and the oncoming vehicle data is associated with one of the discrete time points.

16. The system of claim 13 , wherein the vehicle maneuver comprises additional steps in the program and the controller is further configured to:

determine the ego vehicle is unable to overtake the lead vehicle while keeping the ego vehicle within a predetermined set of safety constraints based at least one of the ego vehicle data, lead vehicle data, oncoming vehicle data, or the estimated intention of the lead vehicle; and

pilot the ego vehicle to follow behind the lead vehicle within the predetermined set of safety constraints.

17. The system of claim 16 , wherein the predetermined set of safety constraints comprises a predetermined headway separation distance between the ego vehicle and the lead vehicle.

18. The system of claim 13 , the vehicle maneuver comprises additional steps in the program and the controller is further configured to:

determine the ego vehicle is able to overtake the lead vehicle while keeping the ego vehicle within a predetermined set of safety constraints based on at least one of the ego vehicle data, lead vehicle data, oncoming vehicle data, or the estimated intention of the lead vehicle; and

pilot the ego vehicle along a trajectory to overtake the lead vehicle within the predetermined set of safety constraints.

19. The system of claim 18 , wherein the ego vehicle data comprises an ego vehicle speed and an ego vehicle location, the lead vehicle data comprises a lead vehicle speed and a lead vehicle location, wherein the controller is further configured to calculate the trajectory based on the ego vehicle speed, the lead vehicle speed, the ego vehicle location, and the lead vehicle location, and wherein the trajectory includes a desired location located ahead of the lead vehicle determined based on dynamics of the lead vehicle corresponding to the estimated intention.

20. The method of claim 1 , wherein the physics-based parameter includes a longitudinal velocity.

21. The method of claim 1 , wherein the physics-based parameter includes a longitudinal acceleration.

22. The method of claim 1 , wherein the physics-based parameter includes a lateral velocity.

23. The method of claim 1 , wherein the physics-based parameter includes a coefficient of drag.

24. The system of claim 12 , wherein the physics-based parameter includes at least one of a longitudinal velocity, a longitudinal acceleration, a lateral velocity, a coefficient of drag, or combinations thereof.

25. A driving control system for an ego vehicle, the driving control system comprising:

a first plurality of sensors coupled to the ego vehicle; and

a controller in electrical communication with the first plurality of sensors, the controller being configured to execute a program stored in the controller to:

determine, at a first time, an input control sequence for the ego vehicle, the input control sequence comprising a plurality of acceleration values of the ego vehicle, the plurality of acceleration values being determined to ensure that an observed trajectory of a lead vehicle is consistent with only one intention model of a plurality of intention models, wherein the input control sequence is designed to ensure that output trajectories of each of the plurality of intention models differ by a predetermined threshold in at least one time instance within a testing period;

for each intention model of a plurality of intention models, calculate at least one output trajectory for the lead vehicle based at least in part on the input control sequence;

cause a vehicle control system in the ego vehicle to execute at least a portion of the input control sequence;

receive, from the first plurality of sensors coupled to the ego vehicle, lead vehicle data about the lead vehicle;

estimate the intention of the lead vehicle by selecting an intention model from the plurality of intention models, the intention model being selected based on the lead vehicle data and the at least one output trajectory corresponding to the intention model;

generate a desired location for the ego vehicle based on the selected intention model;

generate, based on the desired location and the selected intention model, a vector field configured to guide the ego vehicle around the lead vehicle to the desired location; and

cause the vehicle control system to perform a vehicle maneuver based on the generated vector field.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2019
From: YONG, SZE ZHENG; SHEN, QIANG
To: AZ BRD REGENTS ON BEHALF OF AZ STATE UNIVERSITY
Reel/Frame 049063/0188 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2019
From: OZAY, NECIMIYE; CHIPADE, VISHNU S.; HUANG, LIXING; PANAGOU, DIMITRA
To: THE REGENTS OF THE UNIVERSITY OF MICHIGAN
Reel/Frame 050174/0586 →
Continuity (1)
Related Publication 20200298859A1 · Sep 24, 2020
References Cited (42)
US 9174672B2 · Zeng · 2015 [cited by examiner]
US 20060047402A1 · Irion · 2006 [cited by examiner]
US 20150057835A1 · Streubel · 2015 [cited by examiner]
US 20150367854A1 · Ezoe · 2015 [cited by examiner]
US 20160059858A1 · Heinrich · 2016 [cited by examiner]
US 20160318511A1 · Rangwala · 2016 [cited by examiner]
US 20170016740A1 · Cui · 2017 [cited by examiner]
US 20170080952A1 · Gupta · 2017 [cited by examiner]
US 20170101102A1 · Matei · 2017 [cited by examiner]
US 20170326981A1 · Masui · 2017 [cited by examiner]
US 20180012491A1 · Liu · 2018 [cited by examiner]
US 20180182245A1 · Takabayashi · 2018 [cited by examiner]
US 20180253976A1 · Inam · 2018 [cited by examiner]
US 20190054922A1 · Yalla · 2019 [cited by examiner]
US 20190163205A1 · Kodera · 2019 [cited by examiner]
US 20190375410A1 · Zinner · 2019 [cited by examiner]
US 20200012286A1 · Delp · 2020 [cited by examiner]
US 20200180636A1 · Oh · 2020 [cited by examiner]
US 20200233414A1 · Akella · 2020 [cited by examiner]
US 20200286392A1 · Miller · 2020 [cited by examiner]
US 20200298843A1 · Matsunaga · 2020 [cited by examiner]
GB 2558866A · 2018 [cited by applicant]
Carvalho, et al., Stochastic Predictive Control of Autonomous Vehicles in Uncertain Environments, In 12th International Symposium on Advanced Vehicle Control, 2014, pp. 712-719. [cited by applicant]
Cesari, et al., Scenario Model Predictive Control for Lane Change Assistance and Autonomous Driving on Highways, IEEE Intelligent Transportation Systems Magazine, 2017, 9(3):23-35. [cited by applicant]
Chebly, et al., Trajectory Planning and Tracking for Autonomous Vehicles Navigation, Automatic Control Engineering, Universite de Technologie de Compiegne, 2017, 218 pages. [cited by applicant]
Ding, et al., Optimal Input Design for Affine Model Discrimination with Applications in Intention-Aware Vehicles, In Proceedings of the 9th ACM/IEEE International Conference on Cyber-Physical Systems, IEEE Press, 2018, … [cited by applicant]
Fisac, et al., Hierarchical Game—Theoretic Planning for Autonomous Vehicles, In 2019 International Conference on Robotics and Automation (ICRA), IEEE, 2019, pp. 9590-9596. [cited by applicant]
Garg, et al., New Results on Finite-Time Stability: Geometric Conditions and Finite-Time Controllers, In 2018 Annual American Control Conference (ACC), IEEE, 2018, pp. 442-447. [cited by applicant]
Harirchi, et al., Active Model Discrimination with Applications to Fraud Detection in Smart Buildings, IFAC PapersOnLine, 2017, 50-1:9527-9534. [cited by applicant]
Katrakazas, et al., Real-Time Motion Planning Methods for Autonomous On-Road Driving: State-of-the-Art and Future Research Directions, Transportation Research Part C, 2015, 60:416-442. [cited by applicant]
Lefevre, et al., A Survey on Motion Prediction and Risk Assessment for Intelligent Vehicles, Robomech Journal, 2014, 1:1, 14 pages. [cited by applicant]
Murgovski, et al., Predictive Cruise Control with Autonomous Overtaking, In 2015 54th IEEE Conference on Decision and Control (CDC), IEEE, 2015, pp. 644-649. [cited by applicant]
Nikoukhah, et al., Auxiliary Signal Design for Active Failure Detection in Uncertain Linear Systems with a Priori Information, Automatica, 2006, 42:219-228. [cited by applicant]
Panagou, A Distributed Feedback Motion Planning Protocol for Multiple Unicycle Agents of Different Classes, IEEE Transactions on Automatic Control, 2016, 62(3):1178-1193. [cited by applicant]
Schwarting, et al., Planning and Decision-Making for Autonomous Vehicles, Annual Review of Control, Robotics and Autonomous Systems, 2018, 1:187-210. [cited by applicant]
Scott, et al., Input Design for Guaranteed Fault Diagnosis Using Zonotopes, Automatica, 2014, 50:1580-1589. [cited by applicant]
Singh, et al., Input Design for Nonlinear Model Discrimination via Affine Abstraction, IFAC PapersOnLine, 2018, 51(16):175-180. [cited by applicant]
Van Brummelen, et al., Autonomous Vehicle Perception: The Technology of Today and Tomorrow, Transportation Research Part C, 2018, 89:384-406. [cited by applicant]
Volpe, et al., Manipulator Control with Superquadric Artificial Potential Functions: Theory and Experiments, IEEE Transactions on Systems, Man, and Cybernetics, 1990, 20(6):1423-1436. [cited by applicant]
Wang, et al., Safe Distributed Lane Change Maneuvers for Multiple Autonomous Vehicles Using Buffered Input Cells, In IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2018, pp. 1-7. [cited by applicant]
Gurobi Optimization, Inc., Gurobi Optimizer Reference Manual, Version 7.0, Copyright 2017, 693 pages. [cited by applicant]
IBM ILOG CPLEX Optimization Studio CPLEX User's Manual, Version 12 Release 6, Copyright IBM Corporation 1987, 2015, 564 pages. [cited by applicant]
Cited By (1)
US 12,662,146