IP Library Granted Patent US 12,353,213
Granted Patent B2
US 12,353,213 · App. 18/432,887 · Granted Jul 8, 2025

Safety procedure analysis for obstacle avoidance in autonomous vehicles

Inventors: David Nister (Bellevue, WA); Hon-Leung Lee (Bellevue, WA); Julia Ng (San Jose, CA); Yizhou Wang (Santa Clara, CA)
Assignee: NVIDIA Corporation
G05D1/0214B60W30/09B60W30/095G05D1/0221G05D1/0223G05D1/0231G05D1/0242G05D1/0255G05D1/0257G05D1/027G05D1/0278G05D1/0289G05D1/0891G05D1/245G05D1/247G05D1/248G05D1/617G05D1/65G05D1/693G06N3/08B60W2520/06B60W2520/10B60W2520/14B60W2520/16B60W2520/18B60W2554/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,213
App. No.
18/432,887
Granted
Jul 8, 2025
Kind
B2
Abstract

In various examples, a current claimed set of points representative of a volume in an environment occupied by a vehicle at a time may be determined. A vehicle-occupied trajectory and at least one object-occupied trajectory may be generated at the time. An intersection between the vehicle-occupied trajectory and an object-occupied trajectory may be determined based at least in part on comparing the vehicle-occupied trajectory to the object-occupied trajectory. Based on the intersection, the vehicle may then execute the first safety procedure or an alternative procedure that, when implemented by the vehicle when the object implements the second safety procedure, is determined to have a lesser likelihood of incurring a collision between the vehicle and the object than the first safety procedure.

Claims (71)

1. A method comprising:

determining, based at least on a first safety procedure associated with a vehicle, a first trajectory of the vehicle;

determining, based at least on one or more second safety procedures associated with one or more objects, one or more second trajectories associated with the one or more objects; and

causing, based at least on the first trajectory and the one or more second trajectories, the vehicle to navigate along a route.

2. The method of claim 1 , further comprising:

determining, based at least on the first trajectory and the one or more second trajectories, a likelihood of collision between the vehicle and the one or more objects,

wherein the causing the vehicle to navigate is based at least on the likelihood of collision.

3. The method of claim 1 , further comprising:

determining, based at least on first sensor data generated using one or more sensors, a first current trajectory associated with the vehicle that is different than the first trajectory; and

determining, based at least on second sensor data generated using the one or more sensors, one or more second current trajectories associated with the one or more objects that are different than the one or more second trajectories.

4. The method of claim 3 , wherein:

the determining the first trajectory is based at least on implementing the first safety procedure at a time along with the first current trajectory; and

the determining the one or more second trajectories is based at least on implementing the one or more second safety procedures at a time along the one or more second current trajectories.

5. The method of claim 1 , wherein:

the first safety procedure is associated with at least the first trajectory that the vehicle may perform to avoid a collision with the one or more objects; and

the one or more second safety procedures are associated with at least the one or more second trajectories that the one or more objects may perform to avoid the collision.

6. The method of claim 1 , wherein the causing the vehicle to navigate comprises causing the vehicle to navigate along a current trajectory based at least on the first trajectory and the one or more second trajectories indicating that there is no likelihood of collision between the machine-vehicle and the one or more objects.

7. The method of claim 1 , wherein the causing the vehicle to navigate comprises:

determining, based at least the first trajectory and the one or more second trajectories, one or more constraints associated with reducing a likelihood of collision between the vehicle and the one or more objects;

determining a third trajectory based at least on the one or more constraints, the third trajectory including the route; and

causing the vehicle to navigate along the third trajectory.

8. The method of claim 1 , further comprising:

determining, based at least on the first trajectory, one or more first points within an environment that the vehicle may occupy; and

determining, based at least on the one or more second trajectories, one or more second points within the environment that the one or more objects may occupy,

wherein the causing the vehicle to navigate is based at least on the one or more first points and the one or more second points.

9. A system comprising:

one or more processors to:

determine one or more first points within an environment that a vehicle is estimated to occupy if implementing a first safety procedure at a time;

determine one or more second points within the environment that one or more objects are estimated to occupy if implementing one or more second safety procedures at the time; and

cause, based at least on the one or more first points and the one or more second points, the vehicle to navigate along a route.

10. The system of claim 9 , wherein the one or more processors are further to:

determine, based at least on the one or more first points and the one or more second points, a likelihood of collision between the vehicle and the one or more objects,

wherein the vehicle is caused to navigate based at least on the likelihood of collision.

11. The system of claim 10 , wherein the system is comprised in at least one of:

a control system for an autonomous or semi-autonomous vehicle;

a perception system for an autonomous or semi-autonomous vehicle;

a system for performing simulation operations;

a system for performing deep learning operations;

a system on chip (SoC);

a system including a programmable vision accelerator (PVA);

a system including a vison processing unit;

a system implemented using an edge device;

a system implemented using a robot;

a system incorporating one or more virtual machines (VMs);

a system implemented at least partially in a data center; or

a system implemented at least partially using cloud computing resources.

12. The system of claim 9 , wherein the one or more processors are further to:

determine an amount of overlap associated with the one or more first points and the one or more second points,

wherein the vehicle is caused to navigate based at least on the amount of overlap.

13. The system of claim 9 , wherein the one or more processors are further to:

determine, based at least on first sensor data generated using one or more sensors, a first current trajectory associated with the vehicle; and

determine, based at least on second sensor data generated using the one or more sensors, one or more second current trajectories associated with the one or more objects.

14. The system of claim 13 , wherein:

the determination of the one or more first points is based at least on implementing the first safety procedure at the time along with the first current trajectory; and

the determination of the one or more second points is based at least on implementing the one or more second safety procedures at the time along the one or more second current trajectories.

15. The system of claim 9 , wherein:

the determination of the one or more first points comprises determining, based at least on implementing the first safety procedure at the time, a first area of the environment that may be occupied by the vehicle, the first area including the one or more first points; and

the determination of the one or more second points comprises determining, based at least on implementing the one or more second safety procedures at the time, a second area of the environment that may be occupied by the one or more objects, the second area including the one or more second points.

16. The system of claim 9 , wherein:

the first safety procedure is associated with one or more first trajectories that the vehicle may perform to avoid a collision with the one or more objects; and

the one or more second safety procedures are associated with one or more second trajectories that the one or more objects may perform to avoid the collision.

17. The system of claim 9 , wherein the vehicle is caused to navigate, at least, by:

determining, based at least the one or more first points and the one or more second points, one or more constraints associated with reducing a likelihood of collision between the vehicle and the one or more objects;

determining a trajectory based at least on the one or more constraints, the route including the trajectory; and

causing the vehicle to navigate along the trajectory.

18. A method comprising:

causing a vehicle to navigate based at least on a first trajectory associated with the vehicle and one or more second trajectories associated with one or more objects, wherein the first trajectory is determined based at least on a safety procedure associated with the vehicle to avoid a collision with the one or more objects.

19. The method of claim 18 , further comprising:

determining, based at least on the first trajectory and the one or more second trajectories, a likelihood of collision between the vehicle and the one or more objects,

wherein the causing the vehicle to navigate is based at least on the likelihood of collision.

20. The method of claim 19 , wherein the one or more second trajectories are determined based at least on one or more second safety procedures associated with the one or more objects avoiding the collision with the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2024
From: NISTER, DAVID; NG, JULIA; LEE, HON-LEUNG; WANG, YIZHOU
To: NVIDIA CORPORATION
Reel/Frame 067293/0014 →
Continuity (7)
Continuation 18083159 · Dec 16, 2022
Continuation 17356337 · Jun 23, 2021
Continuation 16265780 · Feb 1, 2019
Provisional Application 62768064 · Nov 15, 2018
Provisional Application 62760916 · Nov 13, 2018
Provisional Application 62625351 · Feb 2, 2018
Related Publication 20240174219A1 · May 30, 2024
References Cited (237)
US 6393362B1 · Burns · 2002 [cited by applicant]
US 7221797B2 · Koshizen et al. · 2007 [cited by applicant]
US 7409295B2 · Paradie · 2008 [cited by applicant]
US 7565006B2 · Stam et al. · 2009 [cited by applicant]
US 8204642B2 · Tanaka et al. · 2012 [cited by applicant]
US 8352111B2 · Mudalige · 2013 [cited by applicant]
US 9373057B1 · Erhan et al. · 2016 [cited by applicant]
US 9489635B1 · Zhu · 2016 [cited by applicant]
US 9701307B1 · Newman et al. · 2017 [cited by applicant]
US 10007269B1 · Gray · 2018 [cited by applicant]
US 10053091B2 · Jiang et al. · 2018 [cited by applicant]
US 10108867B1 · Vallespi-Gonzalez et al. · 2018 [cited by applicant]
US 10133274B2 · Shashua et al. · 2018 [cited by applicant]
US 10134278B1 · Konrardy et al. · 2018 [cited by applicant]
US 10137896B2 · Zhuang et al. · 2018 [cited by applicant]
US 10139831B2 · Yan · 2018 [cited by applicant]
US 10157331B1 · Tang et al. · 2018 [cited by applicant]
US 10289469B2 · Fortino et al. · 2019 [cited by applicant]
US 10363960B2 · Stefan et al. · 2019 [cited by applicant]
US 10372136B2 · Yang et al. · 2019 [cited by applicant]
US 10489972B2 · Atsmon · 2019 [cited by applicant]
US 10579063B2 · Haynes et al. · 2020 [cited by applicant]
US 10580158B1 · Mousavian et al. · 2020 [cited by applicant]
US 10599546B1 · Walther et al. · 2020 [cited by applicant]
US 10625748B1 · Dong et al. · 2020 [cited by applicant]
US 10635110B2 · Shashua et al. · 2020 [cited by applicant]
US 10698407B2 · Ostafew · 2020 [cited by examiner]
US 10730517B2 · Park et al. · 2020 [cited by applicant]
US 10739778B2 · Winkler et al. · 2020 [cited by applicant]
US 10740954B2 · Liu · 2020 [cited by applicant]
US 10776985B2 · Liu et al. · 2020 [cited by applicant]
US 10816978B1 · Schwalb et al. · 2020 [cited by applicant]
US 10829793B2 · Arikawa et al. · 2020 [cited by applicant]
US 10843690B2 · Shalev-Shwartz · 2020 [cited by examiner]
US 10885698B2 · Muthler et al. · 2021 [cited by applicant]
US 10942030B2 · Haque et al. · 2021 [cited by applicant]
US 10997433B2 · Xu et al. · 2021 [cited by applicant]
US 11079764B2 · Nister et al. · 2021 [cited by applicant]
US 11080590B2 · Smolyanskiy et al. · 2021 [cited by applicant]
US 11099558B2 · Huang et al. · 2021 [cited by applicant]
US 11182917B2 · Kang · 2021 [cited by examiner]
US 11188794B2 · Yao · 2021 [cited by examiner]
US 11189172B2 · Branscombe et al. · 2021 [cited by applicant]
US 11370423B2 · Casas · 2022 [cited by examiner]
US 11467590B2 · Halder · 2022 [cited by examiner]
US 11604470B2 · Nister et al. · 2023 [cited by applicant]
US 11966228B2 · Nister et al. · 2024 [cited by applicant]
US 11966673B2 · Kristensen · 2024 [cited by examiner]
US 12077190B2 · Ng · 2024 [cited by examiner]
US 12179795B2 · Henke · 2024 [cited by examiner]
US 20040252864A1 · Chang et al. · 2004 [cited by applicant]
US 20070021912A1 · Morita et al. · 2007 [cited by applicant]
US 20070154068A1 · Stein et al. · 2007 [cited by applicant]
US 20070182528A1 · Breed et al. · 2007 [cited by applicant]
US 20090125177A1 · Tanaka et al. · 2009 [cited by applicant]
US 20090256840A1 · Varadhan et al. · 2009 [cited by applicant]
US 20100256852A1 · Mudalige · 2010 [cited by applicant]
US 20130054106A1 · Schmudderich et al. · 2013 [cited by applicant]
US 20150054824A1 · Jiang · 2015 [cited by applicant]
US 20150346716A1 · Scharfe et al. · 2015 [cited by applicant]
US 20160001775A1 · Wilhelm et al. · 2016 [cited by applicant]
US 20160247290A1 · Liu et al. · 2016 [cited by applicant]
US 20160321074A1 · Hung et al. · 2016 [cited by applicant]
US 20170010108A1 · Shashua · 2017 [cited by applicant]
US 20170090478A1 · Blayvas et al. · 2017 [cited by applicant]
US 20170220876A1 · Gao et al. · 2017 [cited by applicant]
US 20170236013A1 · Clayton et al. · 2017 [cited by applicant]
US 20170259801A1 · Abou-Nasr et al. · 2017 [cited by applicant]
US 20170344808A1 · El-Khamy et al. · 2017 [cited by applicant]
US 20170364083A1 · Yang et al. · 2017 [cited by applicant]
US 20170371340A1 · Cohen et al. · 2017 [cited by applicant]
US 20180089833A1 · Lewis et al. · 2018 [cited by applicant]
US 20180121273A1 · Fortino et al. · 2018 [cited by applicant]
US 20180136332A1 · Barfield, Jr. et al. · 2018 [cited by applicant]
US 20180158244A1 · Ybanez Zepeda et al. · 2018 [cited by applicant]
US 20180173240A1 · Fang et al. · 2018 [cited by applicant]
US 20180188059A1 · Wheeler et al. · 2018 [cited by applicant]
US 20180203959A1 · Refsnaes et al. · 2018 [cited by applicant]
US 20180232663A1 · Ross et al. · 2018 [cited by applicant]
US 20180239361A1 · Micks et al. · 2018 [cited by applicant]
US 20180251153A1 · Li et al. · 2018 [cited by applicant]
US 20180253103A1 · Winkler et al. · 2018 [cited by applicant]
US 20180267558A1 · Tiwari et al. · 2018 [cited by applicant]
US 20180275657A1 · You · 2018 [cited by applicant]
US 20180276278A1 · Cagan et al. · 2018 [cited by applicant]
US 20180342157A1 · Donnelly et al. · 2018 [cited by applicant]
US 20180348374A1 · Laddha et al. · 2018 [cited by applicant]
US 20180349746A1 · Vellespi-Gonzalez · 2018 [cited by applicant]
US 20180365740A1 · Nix et al. · 2018 [cited by applicant]
US 20180370540A1 · Yousuf et al. · 2018 [cited by applicant]
US 20180373980A1 · Huval · 2018 [cited by applicant]
US 20190016285A1 · Freienstein et al. · 2019 [cited by applicant]
US 20190025841A1 · Haynes et al. · 2019 [cited by applicant]
US 20190065933A1 · Bogdoll et al. · 2019 [cited by applicant]
US 20190066328A1 · Kwant et al. · 2019 [cited by applicant]
US 20190071101A1 · Emura et al. · 2019 [cited by applicant]
US 20190102646A1 · Redmon et al. · 2019 [cited by applicant]
US 20190102668A1 · Yao et al. · 2019 [cited by applicant]
US 20190129831A1 · Goldberg · 2019 [cited by applicant]
US 20190147600A1 · Karasev et al. · 2019 [cited by applicant]
US 20190147610A1 · Frossard et al. · 2019 [cited by applicant]
US 20190171912A1 · Vellespi-Gonzalez et al. · 2019 [cited by applicant]
US 20190179979A1 · Melick · 2019 [cited by applicant]
US 20190212749A1 · Chen et al. · 2019 [cited by applicant]
US 20190213481A1 · Godard et al. · 2019 [cited by applicant]
US 20190235515A1 · Shirvani et al. · 2019 [cited by applicant]
US 20190250622A1 · Nister et al. · 2019 [cited by applicant]
US 20190251442A1 · Koivisto et al. · 2019 [cited by applicant]
US 20190258251A1 · Ditty et al. · 2019 [cited by applicant]
US 20190258878A1 · Koivisto et al. · 2019 [cited by applicant]
US 20190286153A1 · Rankawat et al. · 2019 [cited by applicant]
US 20190287407A1 · Branscombe et al. · 2019 [cited by applicant]
US 20190299984A1 · Shalev-Shwartz et al. · 2019 [cited by applicant]
US 20190302761A1 · Huang et al. · 2019 [cited by applicant]
US 20190310650A1 · Halder · 2019 [cited by applicant]
US 20190369616A1 · Ostafew · 2019 [cited by applicant]
US 20190382007A1 · Casas et al. · 2019 [cited by applicant]
US 20200013176A1 · Kang et al. · 2020 [cited by applicant]
US 20200143205A1 · Yao et al. · 2020 [cited by applicant]
US 20210039649A1 · Yu · 2021 [cited by applicant]
US 20210286923A1 · Kristensen et al. · 2021 [cited by applicant]
US 20230124848A1 · Nister et al. · 2023 [cited by applicant]
US 20240174219A1 · Nister · 2024 [cited by examiner]
US 20240336285A1 · Ng et al. · 2024 [cited by applicant]
US 20250138534A1 · Nister et al. · 2025 [cited by applicant]
CN 106428009A · 2017 [cited by applicant]
CN 106740457A · 2017 [cited by applicant]
CN 106864454A · 2017 [cited by applicant]
CN 106608263A · 2018 [cited by applicant]
DE 102015221920A1 · 2017 [cited by applicant]
DE 102015226762A1 · 2017 [cited by applicant]
EP 1930863A2 · 2008 [cited by applicant]
EP 2384009A2 · 2011 [cited by applicant]
GB 2547082A · 2017 [cited by applicant]
KR 20120009590A · 2012 [cited by applicant]
WO 2012011713A2 · 2012 [cited by applicant]
WO 2016183074A1 · 2016 [cited by applicant]
WO 2018002910A1 · 2018 [cited by applicant]
WO 2018102717A1 · 2018 [cited by applicant]
WO 2018147874A1 · 2018 [cited by applicant]
WO 2018142394A3 · 2018 [cited by applicant]
WO 2018218155A1 · 2018 [cited by applicant]
Ng, Julia; Requirement for Restriction/Election for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Sep. 15, 20222, 5 pgs. [cited by applicant]
IEC 61508, “Functional Safety of Electrical/Electronic/Programmable Electronic Safety-related Systems,” https://en.wikipedia.org/wiki/IEC_61508, accessed on Apr. 1, 2022, 7 pgs. [cited by applicant]
ISO 26262, “Road vehicle—Functional safety,” International standard for functional safety of electronic system, https://en.wikipedia.org/wiki/ISO_26262, accessed on Sep. 13, 2021, 8 pgs. [cited by applicant]
Bojarski, Mariusz; “End to End Learning for Self-Driving Cars”, https://arxiv.org/abs/1604.07316; Apr. 25, 2016, 9 pgs. [cited by applicant]
Nister, David; Non-Final Office Action for U.S. Appl. No. 17/356,337, filed Jun. 23, 2021, mailed Nov. 2, 2022, 35 pgs. [cited by applicant]
Nister, David; Notice of Allowance for U.S. Appl. No. 17/356,337, filed Jun. 23, 2021, mailed Nov. 18, 2022, 5 pgs. [cited by applicant]
Asvadi, A., et al., “DepthCN: Vehicle Detection Using 3D-LIDAR and ConvNet”, International Conference on Intelligent Transportation Systems (ITSC), IEEE, pp. 1-6 (Oct. 16, 2017), XP033330533. [cited by applicant]
Kim, W., S., et al., “Depth Map Coding with Distortion Estimation of Rendered View”, Proceedings of Spie, vol. 7543, pp. 7430B1-75430B10, (Jan. 17, 2010), XP055272237. [cited by applicant]
Tateno, K., et al., “CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction”, Arxiv.Org, Cornell University Library, pp. 6243-6252 (Apr. 11, 2017). [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/061820, mailed on May 27, 2021, 9 pgs. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/068766, mailed on Jul. 8, 2021, 10 pgs. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/068764, mailed on Jul. 8, 2021, 12 pgs. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/018348, mailed on Aug. 27, 2020, 16 pgs. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/022753, mailed on Oct. 1, 2020, 14 pgs. [cited by applicant]
International Preliminary Report on Patentability International Patent Application No. PCT/US2019/012535 mailed Jul. 7, 2020. [cited by applicant]
International Search Report and Written Opinion mailed Apr. 15, 2020 in Application No. PCT/US2019/061820 filed Nov. 15, 2019. [cited by applicant]
International Search Report and Written Opinion mailed Nov. 7, 2019 in International Patent Application No. PCT/US2019/022753, 22 pgs. [cited by applicant]
International Search Report and Written Opinion mailed Oct. 17, 2019 in International Patent Application No. PCT/US2019/012535, 24 pgs. [cited by applicant]
International Search Report and Written Opinion mailed Jul. 25, 2019 in International Patent Application No. PCT/US2019/018348, 22 pgs. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 26, 2019 in International Patent Application No. PCT/US2019/024400, 15 pgs. [cited by applicant]
International Search Report and Written Opinion mailed Aug. 26, 2019 in International Patent Application No. PCT/US2019/022592, 18 pgs. [cited by applicant]
“Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles”, Society of Automotive Engineers (SAE), Standard No. J3016-201609, pp. 30 (Sep. 30, 2016). [cited by applicant]
“Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles”, Society of Automotive Engineers (SAE), Standard No. J3016-201806, pp. 35 (Jun. 15, 2018). [cited by applicant]
Aude, E. P. L., et al., “Integration of intelligent systems and sensor fusion within the ControLab AGV”, In Mobile Robots XIV, vol. 3838, pp. 50-62 (1999). [cited by applicant]
Bach, M., et al., “Multi-camera traffic light recognition using a classifying Labeled Multi-Bernoulli filter”, IEEE Intelligent Vehicles Symposium (IV), pp. 1045-1051 (Jun. 2017). [cited by applicant]
Bidlack, C., et al., “Visual Robot Navigation using Flat Earth Obstacle Projection”, Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3374-3381 (1994). [cited by applicant]
Dynov, I., “Is Deep Learning Really the Solution for Everything in Self-Driving Cars? ”, Retrieved from Internet URL : https://www.automotive-iq.com/autonomous-drive/articles/deep-learning-really-solution-everything-sel… [cited by applicant]
Fazlollahtabar, H., et al., “Delay Optimization in a Multiple AGV System”, International Journal of Swarm Intelligence and Evolutionary Computation, pp. 7 (2014). [cited by applicant]
Garnett, N., et al., “Real-Time Category-Based and General Obstacle Detection for Autonomous Driving”, IEEE International Conference on Computer Vision Workshops, pp. 198-205 (2017). [cited by applicant]
Godard, C., et al., “Unsupervised Monocular Depth Estimation with Left-Right Consistency”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 270-279 (2017). [cited by applicant]
He, L., et al., “Learning Depth from Single Images with Deep Neural Network Embedding Focal Length”, Cornell University Library, pp. 1-14 (Mar. 27, 2018). [cited by applicant]
Jayaraman, A., et al., “Creating 3D Virtual Driving Environments for Simulation-Aided Development of Autonomous Driving and Active Safety”, SAE Technical Paper, pp. 1-6 (2017). [cited by applicant]
Keighobadi, J., et al., “Self-Constructing Neural Network Modeling and Control of an AGV”, Positioning, pp. 160-168 (2013). [cited by applicant]
Kendall, A., et al., “End-to-end Learning of Geometry and Context for Deep Stereo Regression”, Cornell University Library, pp. 66-75 (2017). [cited by applicant]
Liu, H., et al., “Neural Person Search Machines”, IEEE International Conference on Computer Vision (ICCV), pp. 493-501 (2017). [cited by applicant]
Muller, U., et al., “Off-Road Obstacle Avoidance Through End-To-End Learning”. In Advances in neural information processing systems, pp. 1-8, (2006). [cited by applicant]
Neven, D., et al., “Towards end-to-end lane detection: an instance segmentation approach”, In 2018 IEEE intelligent vehicles symposium (IV), pp. 7 (2018). [cited by applicant]
Pang, J., et al., “Cascade Residual Learning: A Two-Stage Convolutional Neural Network for Stereo Matching”, IEEE International Conference on Computer Vision Workshops, pp. 887-895 (2017). [cited by applicant]
Pomerleau, D. A., “Alvinn: An Autonomous Land Vehicle in a Neural Network”, In Advances in neural information processing systems, pp. 1-16, (1989). [cited by applicant]
Rothe, R., et al., “Non-maximum Suppression for Object Detection by Passing Messages Between Windows”, ETH Library, pp. 1-17 (2015). [cited by applicant]
Schwarting, W., et al., “Planning And Decision-Making for Autonomous Vehicles”, Annual Review of Control, Robotics, and Autonomous Systems, vol. 1, pp. 187-210, (2018). [cited by applicant]
Soylu, M., et al., “A self-organizing neural network approach for the single AGV routing problem”, European Journal of Operational Research, pp. 124-137 (2000). [cited by applicant]
Stein, G. P., et al., “Vision-Based ACC With A Single Camera: Bounds on Range and Range Rate Accuracy”, Proceedings of IEEE Intelligent Vehicle Symposium, pp. 1-6 (2003). [cited by applicant]
Suorsa, R., E., and Sridhar, B., “A Parallel Implementation of a Multisensor Feature-Based Range-Estimation Method”, IEEE Transactions on Robotics And Automation, pp. 1-34 (1993). [cited by applicant]
Tao, A., “Detectnet: Deep neural network for object detection in digits”, NVIDIA Developer Blog, Retrieved from Internet URL: https://devblogs.nvidia.com/detectnet-deep-neural-network-object-detection-digits/, accessed … [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/012535, mailed on Jul. 16, 2020, 16 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/016418, mailed on Aug. 13, 2020, 8 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/019656, mailed on Sep. 3, 2020, 11 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application No. PCT/US2019/024400, mailed on Oct. 8, 2020, 10 pages. [cited by applicant]
Weber, M., et al., “DeepTLR: A single deep convolutional network for detection and classification of traffic lights”, IEEE Intelligent Vehicles Symposium (IV), pp. 8 (Jun. 2016). [cited by applicant]
Zhong, Y., et al., “Self-Supervised Learning for Stereo Matching with Self-Improving Ability”, Cornell University Library, pp. 1-13 (2017). [cited by applicant]
Zitzewitz, G. V., “Survey of neural networks in autonomous driving”, Survey of Neural Networks in Autonomous Driving, pp. 1-8 (2017). [cited by applicant]
“Conservative Control for Zone Driving of Autonomous Vehicles Using Safe Time of Arrival”, United States U.S. Appl. No. 62/628,831, filed Feb. 9, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“Convolutional Neural Networks to Detect Drivable Freespace for Autonomous Vehicles”, U.S. Appl. No. 62/643,665, filed Mar. 15, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“Deep Learning for Path Detection in Autonomous Vehicles”, U.S. Appl. No. 62/684,328, filed Jun. 13, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Deep Neural Network for Estimating Depth from Stereo Using Semi-Supervised Learning”, U.S. Appl. No. 62/646,148, filed Mar. 21, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“Distance Based Ambient Occlusion Filter for Denoising Ambient Occlusions”, U.S. Appl. No. 62/644,601, filed Mar. 19, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Energy Based Reflection Filter for Denoising Ray-Traced Glossy Reflections”, U.S. Appl. No. 62/644,386, filed Mar. 17, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Geometric Shadow Filter for Denoising Ray-Traced Shadows”, U.S. Appl. No. 62/644,385, filed Mar. 17, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“Method and System of Remote Operation of a Vehicle Using an Immersive Virtual Reality Environment”, U.S. Appl. No. 62/648,493, filed Mar. 27, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Methodology of Using a Single Controller (ECU) for a Fault-Tolerant/Fail-Operational Self-Driving System”, U.S. Appl. No. 62/524,283, filed Jun. 23, 2017. Note: Copy not provided as part of PTO records. [cited by applicant]
“Methods for accurate real-time object detection and for determining confidence of object detection suitable for D autonomous vehicles”, U.S. Appl. No. 62/631,781, filed Feb. 18, 2018. [cited by applicant]
“Network Injection Rate Limiting”, United States U.S. Appl. No. 62/648,326, filed Mar. 26, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Network Synchronization Using Posted Operation Tracking for Flush Semantics”, United States U.S. Appl. No. 62/648,333, filed Mar. 26, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“Programmable Vision Accelerator”, U.S. Appl. No. 15/141,703, filed Apr. 28, 2016. Note: Copy not provided as part of PTO records. [cited by applicant]
“Pruning Convolutional Neural Networks for Autonomous Vehicles and Robotics”, U.S. Appl. No. 62/630,445, filed Feb. 14, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Reliability Enhancement Systems and Methods” U.S. Appl. No. 15/338,247, filed Oct. 28, 2016. Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Method for Autonomous Shuttles, Robo-Taxis, Ride-Sharing and On-Demand Vehicles”, U.S. Appl. No. 62/635,503, filed Feb. 26, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Method for Controlling Autonomous Vehicles”, U.S. Appl. No. 62/614,466, filed Jan. 17, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Method for Safe Operation of Autonomous Vehicles”, U.S. Appl. No. 62/625,351, filed Feb. 2, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Method for Sharing Camera Data Between Primary and Backup Controllers in Autonomous Vehicle Systems”, U.S. Appl. No. 62/629,822, filed Feb. 13, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Method for Training, Testing, Verifying, and Validating Autonomous and Semi-Autonomous Vehicles”, U.S. Appl. No. 62/648,399, filed Mar. 27, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Methods for Advanced AI-Assisted Vehicles”, U.S. Appl. No. 62/648,358, filed Mar. 26, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“System and Methods for Virtualized Intrusion Detection and Prevent System in Autonomous Vehicles”, U.S. Appl. No. 62/682,803, filed Jun. 8, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
“Systems and Methods for Safe and Reliable Autonomous Vehicles”, U.S. Appl. No. 62/584,549, filed Nov. 10, 2017. Note: Copy not provided as part of PTO records. [cited by applicant]
“Video Prediction Using Spatially Displaced Convolution”, U.S. Appl. No. 62/646,309, filed Mar. 21, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
“Detection of Hazardous Autonomous Driving Using Machine Learning,” U.S. Appl. No. 62/622,538, filed Jan. 26, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
Adaptive Occlusion Sampling of Rectangular Area Lights with Voxel Cone Tracing, U.S. Appl. No. 62/644,806, filed Mar. 19, 2018 Note: Copy not provided as part of PTO records. [cited by applicant]
Ching Y. Hung et al. “Programmable Vision Accelerator”, U.S. Appl. No. 62/156,167, filed May 1, 2015 Note: Copy not provided as part of PTO records. [cited by applicant]
“Video Prediction Using Spatially Displaced Convolution”, U.S. Appl. No. 62/647,545, filed Mar. 23, 2018. Note: Copy not provided as part of PTO records. [cited by applicant]
Chen, Chenyi; Final Office Action dated Feb. 8, 2022 in U.S. Appl. No. 16/366,875, 20 pgs. [cited by applicant]
Ng, Julia; Non-Final Office Action for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Jan. 13, 2023, 75 pgs. [cited by applicant]
Ng, Julia; Applicant-Initiated Interview Summary for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Mar. 2, 2023, 3 pgs. [cited by applicant]
Invitation to Pay Additional Fees received in PCT Application No. PCT/US2019/012535, mailed on Mar. 29, 2019, 15 pgs. [cited by applicant]
International Search Report and Written Opinion received in International Application No. PCT/US2019/016418, mailed on Apr. 10, 2019, 10 pgs. [cited by applicant]
Non-Final Office Action dated Oct. 7, 2021 U.S. Appl. No. 16/366,875, 22 pgs. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/366,875, dated Apr. 22, 2022, 16 pgs. [cited by applicant]
Ng, et al.; Final Office Action for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Jun. 16, 2023, 43 pgs. [cited by applicant]
Ng, et al.; Advisory Action for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Aug. 1, 2023, 5 pgs. [cited by applicant]
Ng, Julia; Non-Final Office Action for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Sep. 6, 2023, 48 pgs. [cited by applicant]
Nister, David; Non-Final Office Action for U.S. Appl. No. 18/083,159, filed Dec. 16, 2022, mailed Dec. 15, 2023, 45 pgs. [cited by applicant]
Ng, Julia; Restriction Requirement for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Dec. 22, 2023, 6 pgs. [cited by applicant]
Nister, David; Notice of Allowance for U.S. Appl. No. 18/083,159, filed Dec. 16, 2022, mailed Jan. 24, 2024, 11 pgs. [cited by applicant]
Nister, David; First Office Action for Chinese Patent Application No. 201980001151.X, filed Jul. 29, 2019, mailed Dec. 12, 2023, 13 pgs. [cited by applicant]
Ng, Julia; Notice of Allowance for U.S. Appl. No. 16/877,127, filed May 18, 2020, mailed Apr. 18, 2024, 34 pgs. [cited by applicant]