IP Library › Granted Patent US 12,296,845
Granted Patent B2
US 12,296,845 · App. 17/750,434 · Granted May 13, 2025

Vehicle path adjustment with control barrier function

Inventors: Michael Hafner (San Carlos, CA); Mohit Srinivasan (Ann Arbor, MI); Abhishek Sharma (West Bloomfield, MI); Mrdjan J. Jankovic (Birmingham, MI); Erol Dogan Sumer (Ann Arbor, MI); Alexander Jaeckel (Ann Arbor, MI); Aakar Mehra (Ann Arbor, MI)
Assignee: Ford Global Technologies, LLC
B60W60/001B60W10/18B60W10/20B60W2554/20B60W2554/402B60W2554/4041B60W2554/4044B60W2554/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,296,845
App. No.
17/750,434
Granted
May 13, 2025
Kind
B2
Abstract

A system for detecting a road surface includes a computer programmed to determine a virtual boundary for a vehicle body based on a shape of the vehicle body, upon identifying an object, to identify a plurality of points on the object based on received sensor data, to determine a barrier function based on each of the identified plurality of points, wherein the barrier function includes a barrier distance from a reference point of the virtual boundary of the vehicle to a respective one of the points on the object, based on (i) the determined barrier functions, (ii) the determined virtual boundary of the vehicle, and (iii) an input to at least one of propulsion, steering, or braking, to determine at least one of a braking override or a steering override, and based on the determination, to adjust at least one of a vehicle steering or a vehicle speed.

Claims (42)

1. A system for detecting a road surface, comprising a processor and a memory, the memory storing instructions executable by the processor to:

determine a virtual boundary for a vehicle body based on a shape of the vehicle body;

upon identifying an object, identify a plurality of points on the object based on received sensor data;

determine a barrier function based on each of the identified plurality of points, wherein the barrier function includes a barrier distance from a reference point of the virtual boundary of the vehicle to a respective one of the points on the object;

based on (i) the determined barrier function, (ii) the determined virtual boundary of the vehicle, and (iii) an input to at least one of propulsion, steering, or braking, determine at least one of a braking override or a steering override by solving an optimization problem including the barrier functions and one or more constraints including at least one of a maximum deceleration threshold, a maximum acceleration threshold, and a maximum steering angle; and

based on the determination, adjust at least one of a vehicle steering or a vehicle speed.

2. The system of claim 1 , wherein the object is a static object or a moving object.

3. The system of claim 1 , wherein the plurality of points includes points on edges of the object.

4. The system of claim 1 , wherein the instructions further include instructions to generate tracking data for the identified object and determine based on the generated tracking data whether the identified object is a static object.

5. The system of claim 1 , wherein the instructions further include instructions to determine the at least one of a braking override or a steering override by solving an optimization problem to identify a set of actuations of one or more vehicle actuators that satisfy the barrier functions.

6. The system of claim 1 , wherein the instructions further include instructions to:

determine a projection of the object on a ground surface based on the identified plurality of points; and

determine the at least one of a braking override or a steering override further based on the determined projection of the object.

7. The system of claim 1 , wherein the instructions further include instructions to:

determine a plurality of radial zones extending from the virtual boundary; and

upon determining that the object is a static object, identify the plurality of points on the static object based on received virtual sensor data from one or more radial zones.

8. The system of claim 7 , wherein the plurality of points is on more than one identified static object.

9. The system of claim 1 , wherein the instructions further include instructions to:

upon determining that the object is a moving object, generate tracking data for the plurality of points on the identified moving object;

determine a speed, a heading, and a location of each of the identified plurality of points of the moving object based on the vehicle sensor data; and

determine the barrier function further based on the determined state of each of the identified plurality of points.

10. The system of claim 9 , wherein the instructions further include instructions to determine a second virtual boundary for the identified object based on the plurality of points on the identified object.

11. The system of claim 10 , wherein the instructions further include instructions to determine the second virtual boundary based on data, received from a vehicle sensor or a remote computer, identifying a type of the identified object.

12. A method, comprising:

determining a virtual boundary for a vehicle body based on a shape of the vehicle body; upon identifying an object, identifying a plurality of points on the object based on received sensor data;

determining a barrier function based on each of the identified plurality of points, wherein the barrier function includes a barrier distance from a reference point of the virtual boundary of the vehicle to a respective one of the points on the object;

based on (i) the determined barrier functions, (ii) the determined virtual boundary of the vehicle, and (iii) an input to at least one of propulsion, steering, or braking, determining at least one of a braking override or a steering override by solving an optimization problem including the barrier functions and one or more constraints including at least one of a maximum deceleration threshold, a maximum acceleration threshold, and a maximum steering angle; and

based on the determination, adjusting at least one of a vehicle steering or a vehicle speed.

13. The method of claim 12 , further comprising generating tracking data for the identified object and determining based on the generated tracking data whether the identified object is a static object.

14. The method of claim 12 , further comprising determining the at least one of a braking override or a steering override by solving an optimization problem to identify a set of actuations of one or more vehicle actuators that satisfy the barrier functions.

15. The method of claim 12 , further comprising:

determining a projection of the object on a ground surface based on the identified first plurality of points; and

determining the at least one of a braking override or a steering override further based on the determined projection of the object.

16. The method of claim 12 , further comprising:

determining a plurality of radial zones extending from the virtual boundary; and

upon determining that the object is a static object, identifying the plurality of points on the static object based on received virtual sensor data from one or more radial zones.

17. The method of claim 12 , further comprising:

upon determining that the object is a moving object, generating tracking data for the plurality of points on the identified moving object;

determining a speed, a heading, and a location of each of the identified plurality of points of the moving object based on the vehicle sensor data; and

determining the barrier function further based on the determined state of each of the identified plurality of points.

18. The method of claim 17 , further comprising determining a second virtual boundary for the identified object based on the plurality of points on the identified object.

19. The method of claim 18 , further comprising determining the second virtual boundary based on data, received from a vehicle sensor or a remote computer, identifying a type of the identified object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2022
From: HAFNER, MICHAEL; SRINIVASAN, MOHIT; SHARMA, ABHISHEK; JANKOVIC, MRDJAN J.; SUMER, EROL DOGAN; JAECKEL, ALEXANDER; MEHRA, AAKAR
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 059978/0488 →
Continuity (2)
Continuation In Part 17527207 · Nov 16, 2021
Related Publication 20230150532A1 · May 18, 2023
References Cited (35)
US 9568915B1 · Berntorp et al. · 2017 [cited by applicant]
US 9964952B1 · Costa et al. · 2018 [cited by applicant]
US 9983306B2 · Zeng et al. · 2018 [cited by applicant]
US 10671076B1 · Kobilarov et al. · 2020 [cited by applicant]
US 20120025964A1 · Beggs et al. · 2012 [cited by applicant]
US 20150293216A1 · O'Dea · 2015 [cited by examiner]
US 20170315549A1 · Oppolzer · 2017 [cited by applicant]
US 20170345308A1 · Buburuzan et al. · 2017 [cited by applicant]
US 20170372618A1 · Xu et al. · 2017 [cited by applicant]
US 20180056998A1 · Benosman et al. · 2018 [cited by applicant]
US 20180074505A1 · Lv et al. · 2018 [cited by applicant]
US 20180150081A1 · Gross et al. · 2018 [cited by applicant]
US 20180364787A1 · Fukumoto · 2018 [cited by applicant]
US 20190025851A1 · Ebrahimi Afrouzi · 2019 [cited by applicant]
US 20190049968A1 · Dean et al. · 2019 [cited by applicant]
US 20200117200A1 · Akella et al. · 2020 [cited by applicant]
US 20200117206A1 · Egnor et al. · 2020 [cited by applicant]
US 20200225670A1 · Jankovic et al. · 2020 [cited by applicant]
US 20210053563A1 · Li et al. · 2021 [cited by applicant]
US 20210331676A1 · Wu · 2021 [cited by examiner]
US 20220204029A1 · Chen · 2022 [cited by examiner]
US 20220379478A1 · Raghunathan · 2022 [cited by examiner]
US 20230041031A1 · Baldan · 2023 [cited by examiner]
CN 110196599B · 2020 [cited by applicant]
CN 111791898B · 2021 [cited by applicant]
KR 100578942B1 · 2006 [cited by applicant]
WO 2017197170A1 · 2017 [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/527,207, filed Nov. 16, 2021, as issued by the USPTO Jun. 22, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/527,207, filed Nov. 16, 2021, as issued by the USPTO Nov. 30, 2023. [cited by applicant]
Kiangru Xu, “Constrained Control of Input-Output Linearizable Systems Using Control Sharing Barrier Functions”, Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI (2017) (7 … [cited by applicant]
Trautman, et. al., “Unfreezing the Robot: Navigation in Dense, Interacting Crowds”, IEEE/RSJ International Conference on Intelligent Robots and Systems (2010) (7 pages). [cited by applicant]
Snape, et. al., “The Hybrid Reciprocal Velocity Obstacle”, IEEE Transactions on Robotics, vol. 27, No. 4 (Aug. 2011) (pp. 696-706. [cited by applicant]
Kim, et. al., “Game Theory Based Autonomous Vehicles Operation”, International Journal of Vehicle Design (IJVD), vol. 65, No. 4 (2014) (24 pages). [cited by applicant]
Hassan, et. al., “A Fully-Distributed Heuristic Algorithm for Control of Autonomous Vehicle Movements at Isolated Intersections”, International Journal of Transportation Science and Technology, vol. 3, No. 4 (2014), pp.… [cited by applicant]
Borrmann, et. al., “Control Barrier Certificates for Safe Swarm Behavior”, IFAC PapersOnLine 48-27 (2015), pp. 68-73 (6 pages). [cited by applicant]