IP Library › Granted Patent US 12,275,404
Granted Patent B2
US 12,275,404 · App. 17/071,105 · Granted Apr 15, 2025

Behaviors that reduce demand on autonomous follower vehicles

Inventors: Michael David George (Pittsburgh, PA); Tekin Alp Meriçli (Pittsburgh, PA); Cetin Alp Meriçli (Pittsburgh, PA); Venkataramanan David Rajagopalan (Sewickley, PA); Alonzo James Kelly (Edgeworth, PA)
Assignee: Stack AV Co.
B60W30/165B60W30/12B60W30/18163B60W2420/403B60W2552/53B60W2554/4041B60W2554/4048B60W2554/801B60W2554/802
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,275,404
App. No.
17/071,105
Granted
Apr 15, 2025
Kind
B2
Abstract

Methods and apparatus that reduce demands on behavior of autonomous vehicles operating in a convoy, such as lane following or leader swap. A follower vehicle receives information regarding a path that a leader vehicle has followed. The follower generally follows the leader's path while being free to also observe its own lateral or lane constraints. In particular, lateral control of the follower, that is control of its relative location transverse to the road (e.g., its position relative to travel lanes) may deviate temporarily from the leader's path. This can make it easier for the follower to observe lane discipline, such as by eliminating the tendency, using line-of-sight distance, for the follower to speed up and close a gap to the leader while negotiating a curve.

Claims (84)

1. A system for operating a plurality of vehicles in a platoon, the vehicles including a leader and a follower, the system comprising one or more processors, memory, and one or more programs stored in the memory for execution by the one or more processors, the one or more programs including instructions that when executed by the one or more processors cause the system to:

at the follower,

detect a series of positions of the leader along a path (p1, p2, . . . , pn);

control longitudinal positions of the follower such that the follower arrives at the same corresponding longitudinal positions along the path as the leader;

detect attributes of a travel lane currently occupied by the follower;

further control a lateral position of the follower with respect to the travel lane using the detected travel lane attributes without regard to any detected lateral position of the leader along the path unless the follower either is informed of, or detects a condition that, the leader is deviating from its respective travel lane, and if so, then,

in accordance with determining the leader is deviating from its respective travel lane, position, by the follower, itself directly behind the leader such that the follower follows the same path as the leader, including the same lateral position that the leader followed, until the condition is no longer present.

2. The system of claim 1 wherein the one or more processors cause the system to:

detect the series of positions of the leader using one or more sensors.

3. The system of claim 1 wherein the condition further comprises that the leader is avoiding an obstacle.

4. The system of claim 1 wherein the condition is a lane change condition.

5. The system of claim 4 wherein the one or more processors further cause the system to:

at the follower,

detect one or more lane change conditions that the lane change may not be safe to execute at the follower, and then

either

inform the leader that the follower is vetoing the lane change; or

autonomously determine to not change lanes.

6. The system of claim 4 wherein the lane change condition includes one or more of:

whether there are available travel lanes for either the follower, the leader, or both;

whether there is blocking traffic ahead;

whether interfering vehicles or other obstacles are located to a side of the follower, the leader, or both;

whether traffic is from behind;

whether lane markings are visible to the follower's sensors; or

whether the follower's view of the leader is clear or obscured.

7. A system for operating a plurality of vehicles in a platoon, the vehicles including a leader and a follower, the system comprising one or more processors, memory, and one or more programs stored in the memory for execution by the one or more processors, the one or more programs including instructions that when executed by the one or more processors cause the system to:

at the follower,

detect a series of positions of the leader along a path (p1, p2, . . . , pn);

control its own longitudinal positions so as to arrive at the same longitudinal positions along the path as the leader;

detect one or more attributes of a travel lane; and

control its own lateral position within that lane, wherein controlling its own lateral position within the lane comprises:

in accordance with a first condition, using the detected lane attributes to determine an offset within the lane; and

in accordance with a second condition, mimicking a lateral position of the leader within the lane.

8. The system of claim 7 wherein the series of positions represent where a reference point on the leader is relative to the road; and

wherein the one or more processors cause the system to, when the follower reaches a corresponding longitudinal position, at the follower, further ensure a corresponding reference point of the follower is also in the same lateral position as the corresponding reference point of the leader when the leader was at the corresponding longitudinal position.

9. The system of claim 8 wherein the reference point is derived from a model of vehicle geometry of the first leader.

10. The system of claim 8 wherein the reference point is derived from a door to camera relative pose.

11. The system of claim 8 wherein the reference point is other than a point on the rear doors of the leader.

12. The system of claim 8 wherein the reference point is derived from a model of image formation of the leader.

13. The system of claim 8 wherein the reference point is adjusted for wheel slip.

14. The system of claim 7 wherein the follower controls its own longitudinal positions using leader-follower relative pose with adjustable pursuit distance.

15. The system of claim 7 the one or more processors further cause the system to:

decouple a control over distance to pursuit pose from a control over distance to leader.

16. The system of claim 7 wherein the first condition comprises any of lane markings being visible to the follower, the positions of the not leader being detectable, and the leader not executing a lane change; and wherein the second condition comprises any of lane markings not being visible to the follower, and the leader executing a lane change.

17. A method of operating a plurality of vehicles in a platoon, the vehicles including a first leader, a follower, and a second leader, the method comprising:

while the first leader is travelling along a first path:

autonomously following, by the follower, the first leader's path via sensor-based positional tracking of the first leader,

transitioning, by the follower, to following the second leader instead of the first leader, by the further steps of:

while the second leader is travelling within range of one or more of the follower's sensors,

testing, by the follower, for a precondition, and

when the precondition is satisfied, stopping, following, by the follower, the first path of the first leader, and following, by the follower, a second path of the second leader path autonomously via sensor-based positional tracking of the second leader, such that the follower is never alone in a travel lane without having either the first leader or the second leader to track; and

detecting that the first leader moves away from the follower.

18. The method of claim 17 wherein the preconditions tested by the follower may include any or all of:

whether there are multiple available travel lanes for one or more of the first leader, the second leader, or the follower;

whether there is no blocking traffic ahead;

whether there are interfering vehicles to a side of any of the first leader, the second leader, and the follower;

whether there is traffic approaching from behind;

whether lane markings are visible to the follower's sensors;

whether the follower is able to detect a position of either the first leader, the second leader, or both;

an autonomy level of the follower; or

an authorization for the follower to platoon with the second leader.

19. The method of claim 17 additionally wherein transitioning to following the second leader further comprises:

when the follower is following the first leader in a travel lane, and the second leader is moving into an adjacent lane;

then

changing lanes, by the follower, to fall behind the second leader; and

initiating, by the follower, following of the second leader.

20. The method of claim 19 wherein the follower follows either the first leader, the second leader, or both by either detecting lane markings or by tracking the respective first leader or second leader.

21. The method of claim 17 additionally wherein:

when the follower is following the first leader in a travel lane;

the first leader and the follower moving longitudinally to create a gap between them, wherein the gap is sized such that the follower is still able to follow the first leader;

the second leader moving into the gap; and

the follower initiating following of the second leader and stopping following the first leader.

22. The method of claim 17 further comprising: informing, by the follower, the second leader that it is now following the second leader; and informing, by the follower, the first leader that it has stopped following the first leader.

23. The method of claim 17 further comprising: detecting, by the second leader, that the follower is now following the second leader; and detecting, by the first leader, that the follower is no longer following the first leader.

24. The method of claim 17 wherein the precondition is a sensed behavior of the first leader, the second leader, or both.

25. The method of claim 24 wherein the sensed behavior is a signal light.

26. The method of claim 17 wherein the precondition is receipt of information at the follower indicating that the follower should start following the second leader and stop following the first leader.

27. The method of claim 17 additionally comprising:

receiving, by one or more processors, leader state information as to which of the first leader and the second leader is currently leading the follower; and

comparing, by the one or more processors, the received leader state information and other leader state information derived from the follower's sensors; and

informing one or both of the first and second leader of any inconsistency in such state information.

28. The method of claim 17 additionally comprising:

determining a lateral offset from the path of the second leader; and generating a corrective trajectory for the follower that causes the follower to converge onto the path of the second leader.

29. The method of claim 17 , additionally comprising: determining an offset to the path of the follower that depends on either a lane width or a relative position between the follower and the second leader, and wherein the offset is further reduced based on one or both of time or distance travelled by the follower.

30. The method of claim 17 , additionally comprising: entering, by the follower, a lane following mode while the transition to following the second leader is in process.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2023
From: TRUCK OPCO LLC
To: STACK AV CO.
Reel/Frame 065874/0708 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2023
From: LOCOMATION, INC.
To: TRUCK OPCO LLC
Reel/Frame 064550/0029 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2023
From: LOCOMATION, INC.
To: TRUCK OPCO LLC
Reel/Frame 064282/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2023
From: RAJAGOPALAN, VENKATARAMANAN; GEORGE, MICHAEL DAVID; MERIÇLI, TEKIN ALP; MERIÇLI, CETIN ALP; KELLY, ALONZO JAMES
To: LOCOMATION, INC.
Reel/Frame 064126/0918 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2023
From: RAJAGOPALAN, VENKATARAMANAN; MERIÇLI, TEKIN ALP; MERIÇLI, CETIN ALP; KELLY, ALONZO JAMES
To: LOCOMATION, INC.
Reel/Frame 064131/0508 →
Continuity (3)
Provisional Application 62915795 · Oct 16, 2019
Provisional Application 62915808 · Oct 16, 2019
Related Publication 20210129843A1 · May 6, 2021
References Cited (100)
US 3461812A · Roland · 1969 [cited by applicant]
US 7124027B1 · Ernst et al. · 2006 [cited by applicant]
US 8116921B2 · Ferrin et al. · 2012 [cited by applicant]
US 8352111B2 · Mudalige · 2013 [cited by applicant]
US 10427732B1 · Carroll · 2019 [cited by applicant]
US 10593211B2 · Kim · 2020 [cited by applicant]
US 11541889B2 · Um · 2023 [cited by examiner]
US 20090057068A1 · Lin · 2009 [cited by examiner]
US 20100256836A1 · Mudalige · 2010 [cited by applicant]
US 20100256852A1 · Mudalige · 2010 [cited by examiner]
US 20130041576A1 · Switkes et al. · 2013 [cited by applicant]
US 20130080041A1 · Kumabe · 2013 [cited by examiner]
US 20130151058A1 · Zagorski et al. · 2013 [cited by applicant]
US 20130166157A1 · Schleicher et al. · 2013 [cited by applicant]
US 20150239473A1 · Gosset · 2015 [cited by applicant]
US 20150307095A1 · Aso · 2015 [cited by applicant]
US 20160026187A1 · Alam · 2016 [cited by applicant]
US 20160253906A1 · Celikkol et al. · 2016 [cited by applicant]
US 20160318510A1 · Hess · 2016 [cited by applicant]
US 20170011633A1 · Boegel · 2017 [cited by examiner]
US 20170147005A1 · Ramm et al. · 2017 [cited by applicant]
US 20170259820A1 · Takahashi · 2017 [cited by applicant]
US 20180050697A1 · Kuszmaul et al. · 2018 [cited by applicant]
US 20180113448A1 · Nagda · 2018 [cited by applicant]
US 20180188725A1 · Cremona et al. · 2018 [cited by applicant]
US 20180188745A1 · Pilkington · 2018 [cited by applicant]
US 20180188746A1 · Lesher et al. · 2018 [cited by applicant]
US 20190054920A1 · Karlsson et al. · 2019 [cited by applicant]
US 20190084533A1 · Kasper et al. · 2019 [cited by applicant]
US 20190088142A1 · Kotteri et al. · 2019 [cited by applicant]
US 20190147262A1 · Kuehnle et al. · 2019 [cited by applicant]
US 20190147745A1 · Kim · 2019 [cited by applicant]
US 20190179330A1 · Oniwa · 2019 [cited by applicant]
US 20190180629A1 · Kim · 2019 [cited by applicant]
US 20190196501A1 · Lesher et al. · 2019 [cited by applicant]
US 20190204853A1 · Miller, Jr. et al. · 2019 [cited by applicant]
US 20190206260A1 · Pilkington et al. · 2019 [cited by applicant]
US 20190206261A1 · Szymezak et al. · 2019 [cited by applicant]
US 20190206262A1 · Sin · 2019 [cited by applicant]
US 20190225219A1 · Ueda · 2019 [cited by applicant]
US 20190241184A1 · Hayashi · 2019 [cited by applicant]
US 20190308625A1 · Timura et al. · 2019 [cited by applicant]
US 20200033885A1 · Kim · 2020 [cited by examiner]
US 20200042013A1 · Kelkar et al. · 2020 [cited by applicant]
US 20200057453A1 · Laws et al. · 2020 [cited by applicant]
US 20200107384A1 · Lindner et al. · 2020 [cited by applicant]
US 20200241563A1 · Van Der Knaap · 2020 [cited by examiner]
US 20200282990A1 · Sato · 2020 [cited by applicant]
US 20200283025A1 · Honda · 2020 [cited by applicant]
US 20200284883A1 · Ferreira et al. · 2020 [cited by applicant]
US 20200406834A1 · Russell et al. · 2020 [cited by applicant]
US 20210034054A1 · Patnaik et al. · 2021 [cited by applicant]
US 20210129844A1 · George et al. · 2021 [cited by applicant]
EP 3614355A1 · 2020 [cited by applicant]
JP 2008108219A · 2008 [cited by applicant]
JP 2015210720A · 2015 [cited by applicant]
JP 201710586A · 2017 [cited by applicant]
JP 201756783A · 2017 [cited by applicant]
JP 201946034A · 2019 [cited by applicant]
KR 101102408B1 · 2012 [cited by applicant]
SE 201950565A1 · 2020 [cited by applicant]
WO 2007081345A1 · 2007 [cited by applicant]
WO 2015199789A2 · 2015 [cited by applicant]
WO 2016038931A1 · 2016 [cited by applicant]
WO 2017196165A1 · 2017 [cited by applicant]
WO 2018035145A1 · 2018 [cited by applicant]
WO WO2018085107A1 · 2018 [cited by examiner]
WO 2018215910A1 · 2018 [cited by applicant]
WO 2019106788A1 · 2019 [cited by applicant]
WO 20190214828A1 · 2019 [cited by applicant]
Chien et al., “Automatic Vehicle-Following”, Southern California Center for Advanced Transportation Technologies, pp. 1748-1752 (1992). [cited by applicant]
Fernandes, P., “Multiplatooning Leaders Positioning and Cooperative Behavior Algorithms of Communicant Automated Vehicles for High Traffic Capacity”, IEEE Transactions on Intelligent Transportation Systems, pp. 1171-118… [cited by applicant]
Halle et al., “Collaborative Driving System Using Teamwork for Platoon Formations”, D'epartement d'informatique et g'enie logiciel Universit'e Laval, pp. 1-12. [cited by applicant]
Herrera et al., “Lateral Control of Heavy Duty Vehicles in Platooning using Model Predicitve Control”, Master's thesis EX-038, Chalmers University of Technology (2016). [cited by applicant]
Kavathekar et al., “Vehicle Platooning: a Brief Survey and Categorization”, Proceedings of the ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, Augu… [cited by applicant]
Keßler et al., “Lane Change of Heavy-Duty Vehicle Platoons Without Lateral Position Information”, IFAC Proceedings, vol. 40:10, pp. 455-462 (2007). [cited by applicant]
Kunze et al., “Efficient Organization of Truck Platoons by Means of Data Mining”, ICINCO, 7th International Conference on Informatics in Control, Automation and Robotics, 70 pages (2010). [cited by applicant]
Soni et al., Formation Control for a Fleet of Autonomous Ground Vehicles: a Survey', Robotics, 7:67, p. 1-25 (2018). [cited by applicant]
Tsugawa et al., “A Review of Truck Platooning Projects for Energy Savings”, IEEE Transactions on Intelligent Vehicles, 1:1, pp. 68-77 (2016). [cited by applicant]
van de Hoef et al., “Coordinating Truck Platooning by Clustering Pairwise Fuel-Optimal Plans”, Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems, pp. 408-415 (2015). [cited by applicant]
Vegamoor et al., “A Review of Automatic Vehicle Following Systems”, J. Indian Inst. Sci., vol. 99:4, pp. 567-587 (2019). [cited by applicant]
Wang et al., “Model Predictive Control-Based Cooperative Lane Change Strategy For Improving Traffic Flow”, Advances in Mechanical Engineering, vol. 8(2), pp. 1-17 (2016). [cited by applicant]
Alvarez et al., “Safe Platooning in Automated Highway Systems Part II: Velocity Tracking Controller”, Vehicle System Dynamics, vol. 32, pp. 57-84 (1999). [cited by applicant]
Schlindler et al., “Dynamic and Flizible Platooning in Urban Areas”, AAET, 17 pages (2018). [cited by applicant]
International Search Report and Written Opinion Dated Apr. 2, 2021 for Related PCT/US20/55695. [cited by applicant]
International Search Report and Written Opinion Dated Mar. 26, 2021 for Related PCT/US20/55681. [cited by applicant]
Campbell. (Sep. 2007). “Steering Control of an Autonomous Ground Vehicle with Application to the DARPA Urban Challenge,” Thesis, Massachusetts Institute of Technology; pp. 1-193. [cited by applicant]
Coulter. (Jan. 1992). “Implementation of the Pure Pursuit Path Tracking Algorithm,” The Robotics Institute, Carnegie Mellon University (CMU-RI-TR-92-01); 15 pages. [cited by applicant]
Dani et al. “Position-Based Visual Servo Control of Leader-Follower Formation Using Image-Based Relative Pose and Relative Velocity Estimation,” American Control Conference, Jun. 10-12, 2009, St. Louis, Missouri; pp. 52… [cited by applicant]
Extended European Search Report dated Jul. 19, 2023, directed to EP Application No. 20876345.8; 10 pages. [cited by applicant]
George et al., Office Action dated Aug. 4, 2022, directed to U.S. Appl. No. 17/071,156; 25 pages. [cited by applicant]
George et al., Office Action dated Mar. 14, 2023, directed to U.S. Appl. No. 17/071,156; 31 pages. [cited by applicant]
George et al., Office Action dated Sep. 29, 2023, directed to U.S. Appl. No. 17/071,156; 30 pages. [cited by applicant]
Huang et al. (Mar. 2009). “Finding Multiple Lanes in Urban Road Networks with Vision and Lidar,” Autonomous Robots, 26: 103-122. [cited by applicant]
Kelly. (2013). “Sensors for Perception,” Chapter 8.3 in Mobile Robotics: Mathematics, Models, and Methods, Cambridge University Press, pp. 551-565. [cited by applicant]
Mathworks. “Pure Pursuit Controller,” located at www.mathworks.com/help/robotics/ug/pure-pursuit-controller.html, visited on Dec. 6, 2023. (3 pages). [cited by applicant]
Stevens et al. (Feb. 1965). “Offtracking Calculation Charts for Trailer Combinations,” SAE International Technical Paper 650721, located at https://doi.org/10.4271/650721; 19 pages. [cited by applicant]
Wikipedia. “Kanade-Lucas-Tomasi feature tracker,” located at https://en.wikipedia.org/wiki/Kanade-Lucas-Tomasi_feature_tracker, visited on Dec. 7, 2023; 8 pages. [cited by applicant]
Partial Supplementary Search Report dated Feb. 22, 2024, directed to EP application No. 20877510.6; 17 pages. [cited by applicant]
Extended European Search Report dated Jul. 1, 2024, directed to European Patent Application No. 20877510.6; 18 pages. [cited by applicant]