IP Library Granted Patent US 12,304,494
Granted Patent B2
US 12,304,494 · App. 18/601,710 · Granted May 20, 2025

Control of autonomous vehicle based on determined yaw parameter(s) of additional vehicle

Inventors: Warren Smith (McKees Rocks, PA); Ethan Eade (Pittsburgh, PA); Sterling J. Anderson (Sunnyvale, CA); James Andrew Bagnell (Pittsburgh, PA); Bartholomeus C. Nabbe (Palo Alto, CA); Christopher Paul Urmson (Los Altos, CA)
Assignee: Aurora Operations, Inc.
B60W40/04B60W30/0956G01S17/89G01S17/931G05D1/0088G05D1/024G05D1/247G05D1/81G06F18/214G06F18/2178G06N20/00B60W2554/4041B60W2554/803
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,304,494
App. No.
18/601,710
Granted
May 20, 2025
Kind
B2
Abstract

Determining an instantaneous vehicle characteristic (e.g., at least one yaw rate) of an additional vehicle that is in addition to a vehicle being autonomously controlled, and adapting autonomous control of the vehicle based on the determined instantaneous vehicle characteristic of the additional vehicle. For example, autonomous steering, acceleration, and/or deceleration of the vehicle can be adapted based on a determined instantaneous vehicle characteristic of the additional vehicle. In many implementations, the instantaneous vehicle characteristics of the additional vehicle are determined based on data from a phase coherent Light Detection and Ranging (LIDAR) component of the vehicle, such as a phase coherent LIDAR monopulse component and/or a frequency-modulated continuous wave (FMCW) LIDAR component.

Claims (42)

1. A computer implemented method, comprising:

receiving, from a phase coherent Light Detection and Ranging (LIDAR) component of a vehicle, a group of LIDAR data points of a sensing cycle of the phase coherent LIDAR component;

each of the LIDAR data points of the group indicating a corresponding instantaneous range and a corresponding instantaneous velocity for a corresponding point in an environment of the vehicle;

each of the LIDAR data points of the group being generated based on a corresponding sensing event of the phase coherent LIDAR component during the sensing cycle; and

processing the group of LIDAR data points with a machine learning model to generate an output that indicates that a subset of the group of LIDAR data points correspond to a dynamic object in the environment; and

controlling an autonomous vehicle based on a determined at least one instantaneous characteristic of the dynamic object.

2. The computer implemented method of claim 1 , wherein the dynamic object is at least one of: a pedestrian and an additional vehicle.

3. The computer implemented method of claim 1 , wherein processing of the group of LIDAR data points with the machine learning model further comprises determining an instantaneous characteristic of the dynamic object.

4. The computer implemented method of claim 3 , wherein determining the instantaneous characteristic of the dynamic object comprises:

determining a first set of one or more of a plurality of the LIDAR data points of the group;

determining a second set of one or more of the plurality of the LIDAR data points of the group based on the second set being spatially offset from the first set; and

determining the at least one instantaneous characteristic based on comparison of one or more of the corresponding instantaneous velocities of the first set to one or more of the corresponding instantaneous velocities of the second set.

5. The computer implemented method of claim 1 , further comprising determining at least one instantaneous characteristic of the dynamic object based on the corresponding instantaneous velocity of the LIDAR data points of the group and based on a stored model for the dynamic object, the stored model describing geometric features of the dynamic object.

6. The computer implemented method of claim 5 , wherein the stored model is a three-dimensional model of the dynamic object.

7. The computer implemented method of claim 6 , further comprising selecting the stored model, from multiple candidate stored models, based on determining that sensor data corresponds most closely to the stored model.

8. The computer implemented method of claim 7 , wherein the sensor data comprises the group of LIDAR data points.

9. The computer implemented method of claim 5 , wherein determining the at least one instantaneous characteristic, further comprises:

determining a velocity differential based on comparison of a first set velocity magnitude and a second set velocity magnitude, wherein the first set velocity magnitude is based on a first set of the corresponding instantaneous velocities of the LIDAR data points of the group, and wherein the second set velocity magnitude is based on a second set of the corresponding instantaneous velocities of the LIDAR data points of the group; and

converting the velocity differential to the at least one instantaneous characteristic based on the stored model for the dynamic object.

10. The computer implemented method of claim 1 , wherein the at least one instantaneous characteristic of the dynamic object is a velocity differential that is indicative of yaw rate, and wherein adapting control of the vehicle based on the determined at least one instantaneous characteristic of the dynamic object comprises adapting a velocity of the vehicle and/or a direction of the vehicle based on the velocity differential exceeding a threshold.

11. The computer implemented method of claim 1 , wherein the controlling the autonomous vehicle based on the determined at least one instantaneous characteristic of the dynamic object comprises:

determining at least one candidate trajectory of the dynamic object based on the determined at least one instantaneous characteristic; and

adapting autonomous control of the vehicle based on the at least one candidate trajectory.

12. The computer implemented method of claim 11 , wherein the dynamic object is an additional vehicle and wherein the controlling the autonomous vehicle based on the at least one candidate trajectory comprises performing autonomous evasive steering.

13. The computer implemented method of claim 1 , wherein the LIDAR component is a LIDAR monopulse component and wherein corresponding sensing events of the LIDAR component each comprise a first receiver sensing event at a first coherent receiver of the LIDAR monopulse component and a second receiver sensing event at a second coherent receiver of the LIDAR monopulse component, the first coherent receiver being positionally offset from the second coherent receiver.

14. The computer implemented method of claim 13 , wherein the LIDAR data points of the group are super-resolution LIDAR data points generated based on combining the first receiver sensing events and the second receiver sensing event.

15. A computer implemented method using a phase coherent LIDAR component, comprising:

receiving, from a phase coherent Light Detection and Ranging (LIDAR) component of an autonomous vehicle, a group of LIDAR data points of a sensing cycle of the phase coherent LIDAR component;

each of the LIDAR data points of the group indicating a corresponding instantaneous range and a corresponding instantaneous velocity for a corresponding point in an environment of the autonomous vehicle;

each of the LIDAR data points of the group being generated based on a corresponding sensing event of the phase coherent LIDAR component during the sensing cycle;

processing the group of LIDAR data points with a machine learning model to generate an output that indicates that a subset of the group of LIDAR data points correspond to a dynamic object in the environment; and

providing the output of the machine learning model to one or both of: a planning subsystem of the autonomous vehicle and a control subsystem of the autonomous vehicle to control an autonomous vehicle based at least in part on the output of the machine learning model.

16. The computer implemented method of claim 15 further comprising the sensing cycle having a first receiver sensor and a second receiver sensor and combining first receiver sensing events and second receiver sensing events using one or both of: a frequency domain technique and a spatial domain technique.

17. The computer implemented method of claim 15 wherein the dynamic object is at least of one an additional vehicle and/or a pedestrian.

18. The computer implemented method of claim 15 further comprising modifying control characteristics of the autonomous vehicle based on the output of the machine learning model.

19. An autonomous vehicle, comprising:

a phase coherent Light Detection and Ranging (LIDAR) component; one or more processors executing stored computer instructions to:

receive, from the LIDAR component of the autonomous vehicle, a group of LIDAR data points of a sensing cycle of the phase coherent LIDAR component;

each of the LIDAR data points of the group indicating a corresponding instantaneous range and a corresponding instantaneous velocity for a corresponding point in an environment of the autonomous vehicle;

each of the LIDAR data points of the group being generated based on a corresponding sensing event of the phase coherent LIDAR component during the sensing cycle;

processing the group of LIDAR data points with a machine learning model to generate an output that indicates that a subset of the group of LIDAR data points correspond to a dynamic object in the environment; and

control the autonomous vehicle using output of the machine learning model.

Assignments (3)
MERGER AND CHANGE OF NAME Recorded Apr 17, 2025
From: AVIAN U MERGER SUB CORP.; AURORA INNOVATION, INC.
To: AURORA INNOVATION OPCO, INC.
Reel/Frame 070871/0369 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2025
From: SMITH, WARREN; EADE, ETHAN; ANDERSON, STERLING J.; BAGNELL, JAMES ANDREW; NABBE, BARTHOLOMEUS C.; URMSON, CHRISTOPHER PAUL
To: AURORA INNOVATION, INC.
Reel/Frame 070871/0375 →
CHANGE OF NAME Recorded Apr 17, 2025
From: AURORA INNOVATION OPCO, INC.
To: AURORA OPERATIONS, INC.
Reel/Frame 070885/0671 →
Continuity (5)
Continuation 18133509 · Apr 11, 2023
Continuation 17135171 · Dec 28, 2020
Continuation 16173660 · Oct 29, 2018
Provisional Application 62655965 · Apr 11, 2018
Related Publication 20240217520A1 · Jul 4, 2024
References Cited (155)
US 3987297A · Brienza et al. · 1976 [cited by applicant]
US 6175799B1 · Tsutsumi · 2001 [cited by examiner]
US 6220668B1 · Scheffzuck · 2001 [cited by examiner]
US 8825265B1 · Ferguson et al. · 2014 [cited by applicant]
US 8849494B1 · Herbach et al. · 2014 [cited by applicant]
US 9020680B2 · Solyom · 2015 [cited by examiner]
US 9463725B2 · Szczygiel · 2016 [cited by examiner]
US 9463752B1 · Lehtonen · 2016 [cited by applicant]
US 9481277B1 · Ruelas · 2016 [cited by examiner]
US 9606539B1 · Kentley et al. · 2017 [cited by applicant]
US 9734455B2 · Levinson et al. · 2017 [cited by applicant]
US 9940834B1 · Konrardy et al. · 2018 [cited by applicant]
US 10007269B1 · Gray · 2018 [cited by applicant]
US 10037613B1 · Becker et al. · 2018 [cited by applicant]
US 10220752B2 · Line · 2019 [cited by examiner]
US 10514462B2 · Englard et al. · 2019 [cited by applicant]
US 10676085B2 · Smith et al. · 2020 [cited by applicant]
US 10843653B2 · Ohno · 2020 [cited by examiner]
US 10906536B2 · Smith et al. · 2021 [cited by applicant]
US 10915101B2 · Cohen · 2021 [cited by applicant]
US 11086319B2 · Valois · 2021 [cited by applicant]
US 11231500B1 · Rezk · 2022 [cited by examiner]
US 11654917B2 · Smith et al. · 2023 [cited by applicant]
US 20070118263A1 · Nelson · 2007 [cited by applicant]
US 20100026064A1 · Marsden · 2010 [cited by examiner]
US 20100052945A1 · Breed · 2010 [cited by applicant]
US 20100198513A1 · Zeng · 2010 [cited by examiner]
US 20130190982A1 · Nakano · 2013 [cited by examiner]
US 20140324266A1 · Zhu · 2014 [cited by examiner]
US 20140350768A1 · Filippov et al. · 2014 [cited by applicant]
US 20140036849A1 · Rogan et al. · 2014 [cited by applicant]
US 20140368493A1 · Rogan · 2014 [cited by examiner]
US 20150112550A1 · Cho · 2015 [cited by examiner]
US 20150115576A1 · Acker · 2015 [cited by examiner]
US 20150293216A1 · O'Dea · 2015 [cited by examiner]
US 20160107552A1 · Wakeman · 2016 [cited by examiner]
US 20160259037A1 · Molchanov · 2016 [cited by examiner]
US 20160299228A1 · Maleki et al. · 2016 [cited by applicant]
US 20170076227A1 · Elgie et al. · 2017 [cited by applicant]
US 20170123419A1 · Levinson · 2017 [cited by examiner]
US 20170270361A1 · Puttagunta et al. · 2017 [cited by applicant]
US 20170291565A1 · Yamamoto · 2017 [cited by examiner]
US 20180053102A1 · Martinson et al. · 2018 [cited by applicant]
US 20180260628A1 · Namiki et al. · 2018 [cited by applicant]
US 20180060725A1 · Groh et al. · 2018 [cited by applicant]
US 20180089538A1 · Graham et al. · 2018 [cited by applicant]
US 20180113210A1 · Izadian · 2018 [cited by applicant]
US 20180136644A1 · Levinson et al. · 2018 [cited by applicant]
US 20180188037A1 · Wheeler et al. · 2018 [cited by applicant]
US 20180188736A1 · Jian et al. · 2018 [cited by applicant]
US 20180196127A1 · Harada · 2018 [cited by applicant]
US 20180272977A1 · Szawarski · 2018 [cited by examiner]
US 20180281626A1 · Murakami · 2018 [cited by examiner]
US 20180307944A1 · Li et al. · 2018 [cited by applicant]
US 20190004525A1 · Bills et al. · 2019 [cited by applicant]
US 20190012907A1 · Itahara · 2019 [cited by examiner]
US 20190025429A1 · Mandava · 2019 [cited by examiner]
US 20190077419A1 · Samma · 2019 [cited by examiner]
US 20190106113A1 · Kato · 2019 [cited by examiner]
US 20190120967A1 · Smits · 2019 [cited by applicant]
US 20190147610A1 · Frossard et al. · 2019 [cited by applicant]
US 20190164049A1 · Bai et al. · 2019 [cited by applicant]
US 20190180451A1 · Kellner · 2019 [cited by examiner]
US 20190258251A1 · Ditty et al. · 2019 [cited by applicant]
US 20190302269A1 · Singer et al. · 2019 [cited by applicant]
US 20190315351A1 · Smith et al. · 2019 [cited by applicant]
US 20190317217A1 · Day et al. · 2019 [cited by applicant]
US 20190317219A1 · Smith et al. · 2019 [cited by applicant]
US 20190318206A1 · Smith · 2019 [cited by examiner]
US 20190354782A1 · Kee et al. · 2019 [cited by applicant]
US 20200074862A1 · Johnston et al. · 2020 [cited by applicant]
US 20200118359A1 · Sato · 2020 [cited by applicant]
US 20200142408A1 · Valois · 2020 [cited by examiner]
US 20200142409A1 · Valois et al. · 2020 [cited by applicant]
US 20200142422A1 · Valois et al. · 2020 [cited by applicant]
US 20200209867A1 · Valois et al. · 2020 [cited by applicant]
US 20200210777A1 · Valois et al. · 2020 [cited by applicant]
US 20210146932A1 · Smith et al. · 2021 [cited by applicant]
US 20230271615A1 · Smith et al. · 2023 [cited by applicant]
CN 1668938 · 2005 [cited by applicant]
CN 103496366 · 2014 [cited by applicant]
CN 106828492 · 2017 [cited by applicant]
CN 107074241 · 2017 [cited by applicant]
CN 107192409 · 2017 [cited by applicant]
CN 107627564 · 2018 [cited by applicant]
CN 112041702 · 2020 [cited by applicant]
EP 1298454 · 2003 [cited by applicant]
EP 1298454A2 · 2003 [cited by examiner]
EP 1531343 · 2005 [cited by applicant]
EP 2112042 · 2009 [cited by applicant]
EP 3285230 · 2018 [cited by applicant]
EP 3285230A1 · 2018 [cited by examiner]
EP 3477616 · 2019 [cited by applicant]
JP 2001291197 · 2001 [cited by applicant]
JP 2004017731 · 2004 [cited by applicant]
JP 2016200443 · 2016 [cited by applicant]
JP 2017502315 · 2017 [cited by applicant]
JP 2017516110 · 2017 [cited by applicant]
JP 7358384 · 2023 [cited by applicant]
KR 1020160093465 · 2016 [cited by applicant]
RU 2617727 · 2017 [cited by applicant]
WO 8500784 · 1985 [cited by applicant]
WO WO8500784A · 1985 [cited by examiner]
WO 2014168851 · 2014 [cited by applicant]
WO 20170013750 · 2017 [cited by applicant]
WO 2017158768 · 2017 [cited by applicant]
WO 20170158768 · 2017 [cited by applicant]
WO 2018055378 · 2018 [cited by applicant]
WO 2019199473 · 2019 [cited by applicant]
WO 2019199474 · 2019 [cited by applicant]
WO 2019199475 · 2019 [cited by applicant]
WO 2020091833 · 2020 [cited by applicant]
WO 2020091834 · 2020 [cited by applicant]
WO 2020091835 · 2020 [cited by applicant]
Japanese Intellectual Property Office; Certificate of Patent issued for Application No. 2020-555890, 3 pages, dated Sep. 29, 2023. [cited by applicant]
Japan Intellectual Property Office; Decision to Grant issued for Application No. 2020-555890, 3 pages, dated Aug. 29, 2023. [cited by applicant]
Japanese Intellectual Property Office, Notice of Reasons For Rejection in App. No. 2020-555890, 11 pages, dated Jun. 21, 2022. [cited by applicant]
United States Paten and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/173,648, 62 pages, dated May 11, 2022. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 16/173,648, 21 pages, dated Aug. 17, 2022. [cited by applicant]
Korean Intellectual Property Office, Notice of Grounds of Rejection issued in App. No. 10/2020-7031846, 24 pages, dated Apr. 8, 2022. [cited by applicant]
European Patent Office, Examination Report in App. 19744897.0, 6 pages, dated Aug. 11, 2022. [cited by applicant]
Korean Intellectual Property Office; Notice of Preliminary Rejections in app. No. 10-2020-7031853 dated Feb. 21, 2022. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 16/173,660 dated Oct. 15, 2020. [cited by applicant]
United States Patent and Trademark Office, Office Action for U.S. Appl. No. 16/271,401 dated Nov. 27, 2020. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 16/173,660 dated Nov. 27, 2020. [cited by applicant]
Barth, Alexander et al.; Where Will the Oncoming Vehicle be the Next Second? 2008 IEEE Intelligent Vehicles Symposium, Eindhoven University of Technology, Eindhoven, The Netherlands, Jun. 4-6, 2008, 6 pages, Downloaded … [cited by applicant]
Carlson, Christopher R., et al.; Practical Position and Yaw Rate Estimation with GPS and Differential Wheelspeeds, Mechanical Engineering, Standford, CA, 8 pages, Oct. 30, 2014. [cited by applicant]
Kellner, Dominik, et al.; Instantaneous Full-Motion Estimation of Arbitrary Objects using Dual Doppler Radar, driveU, Institute of Measurement, Control and Microtechnology Ulm, Germany, 6 pages, Jun. 29, 2016. [cited by applicant]
Kellner, Dominik, et al.; Tracking of Extended Objects with High-Resolution Doppler Radar, driveU, Institute of Measurement, Control and Microtechnology Ulm, Germany, 13 pages, Nov. 23, 2015. [cited by applicant]
Mukhtar, Amir, et al.; Vehicle Detection Techniques for Collision Avoidance Systems: A Review, IEEE Transactions on Intelligent Transportation Systems, vol. 16, No. 5, 21 pages, Oct. 2015. [cited by applicant]
Dresner, et al.; A Multiagent Approach to Autonomous Intersection Management, Journal of Artificial Intelligence Research 31 (2008) 591-656, dated Mar. 2018. [cited by applicant]
Cortica Automotive; It's Not Enough to Recognize A Traffic Light 99% of the Time, http://www.cortica.com/automotive/index.html, dated Jun. 5, 2018. [cited by applicant]
Bojarski, et al.; End to End Learning for Self-Driving Cars, dated Apr. 25, 2016. [cited by applicant]
Michels, Jeff, et al.; High Speed Obstacle Avoidance using Monocular Vision and Reinforcement Learning, Somputer Science Department, Stanford University, Proceedings of the 22nd International Conference on Machine _earn… [cited by applicant]
Dresner, Kurt, et al.; Stone P. (2006) Multiagent Traffic Management: Opportunities for Multiagent Learning. In: Tuyls K., Hoen P.J., Verbeeck K., Sen S. (eds) Learning and Adaption in Multi-Agent Systems. LAMAS; Lectur… [cited by applicant]
Pongpunwattana, Anawat, et al.; Real-Time Planning for Multiple Autonomous Vehicles in Dynamic Jncertain Environments. Journal of Aerospace Computing Information and Communication—J Aerosp Comput Inf 7,0MMUN. 1. 580-604… [cited by applicant]
Roderick, Norman, et al.; Reinforcement Learning for Autonomous Vehicles; dated 2002. [cited by applicant]
Desjardins, C. et al.; Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach; IEEEE, vol. 12, No. 4; pp. 1248-1260; dated Dec. 2011. [cited by applicant]
Ye, H. et al.: Machine LEarning for Vehicular Networks: Recent Advances and Application Examples; IEEE, vol. 13, No. 2; pp. 94-101; dated Jun. 1, 2018. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/US2019/024671, 11 pages Jul. 23, 2019. [cited by applicant]
International Searching Authority; International Search Report and Written Opinion of the International Searching Authority of PCT application No. PCT/US2019/024671; 14 pages, dated Oct. 11, 2019. [cited by applicant]
United States Patent and Trademark Office; Office Action for U.S. Appl. No. 16/173,669 dated Jan. 14, 2020. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 16/173,669 dated Mar. 25, 2020. [cited by applicant]
Khuon, Timothy et al.: “Distributed adaptive spectral and spatial sensor fusion for super-resolution classification”, Applied Imagery Pattern Recognition Workshop (AIPR), 2012 IEEE, IEEE, pp. 1-8, XP032422650; dated Oct… [cited by applicant]
Chinese Application No. 201980024172.3 entered national stage Sep. 30, 2020. [cited by applicant]
Chinese Application No. 201980024410.0 entered national stage Sep. 30, 2020. [cited by applicant]
Korean Patent App. No. 10-10-2020-7031846 entered national stage Nov. 4, 2020. [cited by applicant]
Korean Patent App. No. 10-10-10-2020-7031853 entered national stage Nov. 4, 2020. [cited by applicant]
European Patent App. No. 19744897.0 entered national stage Nov. 9, 2020. [cited by applicant]
European Patent App. No. 19722966.9 entered national stage Nov. 9, 2020. [cited by applicant]
Japanese Patent App. No. 2020-555890 entered national stage Oct. 7, 2020. [cited by applicant]
United States Patent and Trademark Office, Office Action for U.S. Appl. No. 16/173,660 dated Jun. 24, 2020. [cited by applicant]
United States Patent and Trademark Office, Office Action for U.S. Appl. No. 16/271,628 dated Jan. 19, 2021. [cited by applicant]
China National Intellectual Property Office; First Office Action issued for Application No. 201980024172.3, 6 pages, dated Oct. 31, 2023. [cited by applicant]
China National Intellectual Property Office; Notice of Grant issued for Application No. 201980024410.0, 8 pages, dated Mar. 14, 2024. [cited by applicant]