IP Library › Granted Patent US 12,210,965
Granted Patent B2
US 12,210,965 · App. 17/013,482 · Granted Jan 28, 2025

Interpretable autonomous driving system and method thereof

Inventors: Sujitha Catherine Martin (San Jose, CA); Chen Tang (Albany, CA)
Assignee: Honda Motor Co., Ltd.
G06N3/08B60W50/06B60W60/001G01C21/3407G06N5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,965
App. No.
17/013,482
Granted
Jan 28, 2025
Kind
B2
Abstract

In some examples, a dynamic system, including a vehicle, may be represented using a graph-based representation. One or more nodes in the graph-based representation may correspond to one or more agents in the dynamic system, and one or more edges between the nodes in the graph-based representation may correspond to one or more interactions between the agents in the dynamic system. The interactions may be defined based on human domain knowledge of the dynamic system. The dynamic system may be modeled using a respective machine learning model that includes a reward decoder that operates on the graph-based representation and evaluates one or more reward functions for the dynamic system. The one or more reward functions may be defined based on the human domain knowledge of the dynamic system. Autonomous operation of the vehicle may be controlled based on the modeling of the dynamic system.

Claims (44)

1. A method comprising:

at an electronic device with one or more processors and memory:

representing a dynamic system through a graph-based representation, wherein one or more nodes in the graph-based representation correspond to one or more agents in the dynamic system, and one or more edges between the nodes in the graph-based representation correspond to one or more interactions between the agents in the dynamic system, wherein the interactions are defined based on human domain knowledge of the dynamic system;

modeling the dynamic system through a respective machine learning model that includes a reward decoder that operates on the graph-based representation and evaluates one or more reward functions for the dynamic system, wherein:

the one or more reward functions for the dynamic system are defined based on the human domain knowledge of the dynamic system,

the one or more reward functions include a first reward function that evaluates a first category of human interpretable behavior between the one or more agents in the dynamic system, and a second reward function that evaluates a second category, different from the first category, of human interpretable behavior between the one or more agents in the dynamic system, and

the first reward function is a node reward function and the second reward function is an edge reward function; and

controlling autonomous operation based on the modeling of the dynamic system.

2. The method of claim 1 , wherein the respective machine learning model comprises a grounded interpretable relational inference (GIRI) model.

3. The method of claim 1 , further comprising training the respective machine learning model using adversarial inverse reinforcement learning.

4. The method of claim 1 , wherein the reward decoder comprises a graph neural network that operates on the graph-based representation to evaluate the one or more reward functions.

5. The method of claim 1 , further comprising determining, by a graph neural network encoder, the graph-based representation of the dynamic system.

6. The method of claim 1 , wherein the graph-based representation of the dynamic system is determined based on one or more characteristics of an environment sensed by one or more sensors.

7. The method of claim 1 , further comprising determining, by a graph neural network decoder, a trajectory for the dynamic system based on the evaluated one or more reward functions.

8. The method of claim 7 , wherein controlling the autonomous operation is based on the determined trajectory for the dynamic system.

9. The method of claim 1 , wherein:

the node reward function evaluates one or more human interpretable behaviors of one or more of the one or more agents based on their compliance with one or more node parameters, and applies penalties for deviations from the one or more node parameters, and

the edge reward function evaluates one or more human interpretable behaviors between one or more of the one or more agents based on their compliance with one or more edge parameters, and applies penalties for deviations from the one or more edge parameters.

10. An electronic device comprising:

one or more processors; and

memory storing instructions, which when executed by the one or more processors, cause the electronic device to perform a method comprising:

representing a dynamic system through a graph-based representation, wherein one or more nodes in the graph-based representation correspond to one or more agents in the dynamic system, and one or more edges between the nodes in the graph-based representation correspond to one or more interactions between the agents in the dynamic system, wherein the interactions are defined based on human domain knowledge of the dynamic system;

modeling the dynamic system through a respective machine learning model that includes a reward decoder that operates on the graph-based representation and evaluates one or more reward functions for the dynamic system, wherein:

the one or more reward functions for the dynamic system are defined based on the human domain knowledge of the dynamic system,

the one or more reward functions include a first reward function that evaluates a first category of human interpretable behavior between the one or more agents in the dynamic system, and a second reward function that evaluates a second category, different from the first category, of human interpretable behavior between the one or more agents in the dynamic system, and

the first reward function is a node reward function and the second reward function is an edge reward function; and

controlling autonomous operation based on the modeling of the dynamic system.

11. The electronic device of claim 10 , wherein the respective machine learning model comprises a grounded interpretable relational inference (GIRI) model.

12. The electronic device of claim 10 , wherein the method further comprises training the respective machine learning model using adversarial inverse reinforcement learning.

13. The electronic device of claim 10 , wherein the reward decoder comprises a graph neural network that operates on the graph-based representation to evaluate the one or more reward functions.

14. The electronic device of claim 10 , wherein the graph-based representation of the dynamic system is determined based on one or more characteristics of an environment sensed by one or more sensors.

15. The electronic device of claim 10 , wherein the method further comprises determining, by a graph neural network decoder, a trajectory for the dynamic system based on the evaluated one or more reward functions.

16. A non-transitory computer-readable storage medium storing instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising:

representing a dynamic system through a graph-based representation, wherein one or more nodes in the graph-based representation correspond to one or more agents in the dynamic system, and one or more edges between the nodes in the graph-based representation correspond to one or more interactions between the agents in the dynamic system, wherein the interactions are defined based on human domain knowledge of the dynamic system;

modeling the dynamic system through a respective machine learning model that includes a reward decoder that operates on the graph-based representation and evaluates one or more reward functions for the dynamic system, wherein:

the one or more reward functions for the dynamic system are defined based on the human domain knowledge of the dynamic system,

the one or more reward functions include a first reward function that evaluates a first category of human interpretable behavior between the one or more agents in the dynamic system, and a second reward function that evaluates a second category, different from the first category, of human interpretable behavior between the one or more agents in the dynamic system, and

the first reward function is a node reward function and the second reward function is an edge reward function; and

controlling autonomous operation based on the modeling of the dynamic system.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the respective machine learning model comprises a grounded interpretable relational inference (GIRI) model.

18. The non-transitory computer-readable storage medium of claim 16 , wherein the method further comprises training the respective machine learning model using adversarial inverse reinforcement learning.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the reward decoder comprises a graph neural network that operates on the graph-based representation to evaluate the one or more reward functions.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the graph-based representation of the dynamic system is determined based on one or more characteristics of an environment sensed by one or more sensors.

21. The non-transitory computer-readable storage medium of claim 16 , wherein the method further comprises determining, by a graph neural network decoder, a trajectory for the dynamic system based on the evaluated one or more reward functions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2020
From: MARTIN, SUJITHA CATHERINE; TANG, CHEN
To: HONDA MOTOR CO., LTD.
Reel/Frame 053817/0835 →
Continuity (2)
Provisional Application 62966381 · Jan 27, 2020
Related Publication 20210232913A1 · Jul 29, 2021
References Cited (180)
US 7096004B2 · Minear et al. · 2006 [cited by applicant]
US 8837718B2 · Lauter et al. · 2014 [cited by applicant]
US 10021103B2 · Xu et al. · 2018 [cited by applicant]
US 11243532B1 · Levihn · 2022 [cited by examiner]
US 11369879B2 · Juliani, Jr. · 2022 [cited by examiner]
US 11436484B2 · Farabet et al. · 2022 [cited by applicant]
US 11537134B1 · Wiest · 2022 [cited by examiner]
US 20100033333A1 · Victor et al. · 2010 [cited by applicant]
US 20140359305A1 · Pappachan et al. · 2014 [cited by applicant]
US 20150195086A1 · Davison · 2015 [cited by applicant]
US 20150222606A1 · Yan · 2015 [cited by applicant]
US 20160359916A1 · Kim et al. · 2016 [cited by applicant]
US 20170124407A1 · Micks et al. · 2017 [cited by applicant]
US 20180009442A1 · Spasojevic et al. · 2018 [cited by applicant]
US 20180024562A1 · Bellaiche · 2018 [cited by applicant]
US 20180053103A1 · Delgado et al. · 2018 [cited by applicant]
US 20190023208A1 · Boston et al. · 2019 [cited by applicant]
US 20190101985A1 · Sajda · 2019 [cited by examiner]
US 20190147610A1 · Frossard · 2019 [cited by examiner]
US 20190225232A1 · Blau · 2019 [cited by applicant]
US 20190236464A1 · Feinson · 2019 [cited by examiner]
US 20190266489A1 · Hu · 2019 [cited by examiner]
US 20190283746A1 · Shalev-Shwartz et al. · 2019 [cited by applicant]
US 20190384303A1 · Muller et al. · 2019 [cited by applicant]
US 20200017117A1 · Milton · 2020 [cited by examiner]
US 20200057487A1 · Sicconi et al. · 2020 [cited by applicant]
US 20200082117A1 · Simmons et al. · 2020 [cited by applicant]
US 20200086863A1 · Rosman · 2020 [cited by examiner]
US 20200139965A1 · Hanna · 2020 [cited by applicant]
US 20200207358A1 · Katz et al. · 2020 [cited by applicant]
US 20200210765A1 · Chinni · 2020 [cited by applicant]
US 20200234145A1 · Dai · 2020 [cited by examiner]
US 20200344237A1 · Murdoch et al. · 2020 [cited by applicant]
US 20200353943A1 · Siddiqui · 2020 [cited by examiner]
US 20200374269A1 · Lidman · 2020 [cited by applicant]
US 20200384998A1 · Yang et al. · 2020 [cited by applicant]
US 20210009163A1 · Urtasun · 2021 [cited by examiner]
US 20210116935A1 · Kalabic · 2021 [cited by examiner]
US 20210125067A1 · Kamatani · 2021 [cited by examiner]
US 20210150417A1 · Fadel Argerich · 2021 [cited by examiner]
US 20210163021A1 · Frazzoli · 2021 [cited by examiner]
US 20210166148A1 · Matsuura · 2021 [cited by examiner]
US 20210213977A1 · Aragon · 2021 [cited by examiner]
US 20210248399A1 · Martin et al. · 2021 [cited by applicant]
US 20210271866A1 · Hayakawa et al. · 2021 [cited by applicant]
US 20210320947A1 · Moridi · 2021 [cited by applicant]
US 20220122001A1 · Choe et al. · 2022 [cited by applicant]
US 20220138568A1 · Smolyanskiy et al. · 2022 [cited by applicant]
US 20220204020A1 · Misu · 2022 [cited by applicant]
US 20220327840A1 · Ambeck-madsen et al. · 2022 [cited by applicant]
EP 3722908A1 · 2020 [cited by applicant]
Learning Robust Rewards with Adversarial Inverse Reinforcement Learning Conference Paper at ICLR , 2018. 15 pages. (Year: 2018). [cited by examiner]
Final Office Action received for U.S. Appl. No. 16/846,081, mailed on Aug. 17, 2022, 17 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/950,820, mailed on May 17, 2022, 16 Pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/846,081, mailed on Mar. 2, 2022, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/950,820, mailed on Dec. 17, 2021, 11 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/805,607, mailed on Jan. 27, 2022, 9 pages. [cited by applicant]
Alahi et al., “Social LSTM: Human Trajectory Prediction in Crowded Spaces”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016, pp. 961-971. [cited by applicant]
Anonymous, “Toward Simulation of Driver Behavior in Level 2 Driving Automation”, Conference 17, USA, Jul. 2017, 5 pages. [cited by applicant]
Antoniou et al., “Data Augmentation Generative Adversarial Networks”, Available Online at: <https://arxiv.org/abs/1711.04340>, 2017, 14 pages. [cited by applicant]
Arakawa Toshiya, “Trial Verification of Human Reliance on Autonomous Vehicles from the Viewpoint of Human Factors”, International Journal of Innovative Computing, Information & Control, vol. 14, No. 2, 2017, pp. 491-501. [cited by applicant]
Barifah Maram, “Automatic Simulation of Users for Interactive Information Retrieval”, In Proceedings of the 2017 Conference on Conference Human Information interaction and Retrieval, Association for Computing Machinery,… [cited by applicant]
Becker et al., “Bosch's Vision and Roadmap Toward Fully Autonomous Driving”, Available Online at: <https://doi.org/10.1007/978-3-319-05990-7_5>, 2014, 11 pages. [cited by applicant]
Bertoni et al., “MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation”, EPFL VITA lab, CH-1015 Lausanne, Aug. 2019, 11 pages. [cited by applicant]
Chen et al., “3D Object Proposals for Accurate Object Class Detection”, Curran Associates Inc., Advances in Neural Information Processing Systems 28, 2015, pp. 424-432. [cited by applicant]
Chen et al., “Monocular 3D Object Detection for Autonomous Driving”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016, pp. 2147-2156. [cited by applicant]
Du et al., “Predicting Takeover Performance in Conditionally Automated Driving”, Proc. Conference on Human Factors in Computing Systems (CHI), Available Online at: <https://dl.acm.org/doi/pdf/10.1145/3334480.3382963>, 2… [cited by applicant]
Endsley Micar. , “Toward a Theory of Situation Awareness in Dynamic Systems”, Hum Factors, vol. 37, No. 1, Available Online at: <https://doi.org/10.1518/001872095779049543>, Mar. 1995, pp. 32-64. [cited by applicant]
Faria et al., “The Effect of Augmented Reality Cues on Glance Behavior and Driver-initiated Takeover in Conditionally Automated Driving”, In AutoUI in Submission, 2020, 15 pages. [cited by applicant]
Frid-Adar et al., “Gan-based Synthetic Medical Image Augmentation for Increased CNN Performance in Liver Lesion Classification”, Available Online at: <https://doi.org/10.1016/j.neucom.2018.09.013>, 2018, 10 pages. [cited by applicant]
Geiger et al., “Vision Meets Robotics: The KITTI Dataset”, International Journal of Robotics Research (IJRR), 2013, 6 pages. [cited by applicant]
Godard et al., “Unsupervised Monocular Depth Estimation with Left-Right Consistency”, Available Online at: <http://visual.cs.ucl.ac.uk/pubs/monoDepth/>, Sep. 2016, 14 pages. [cited by applicant]
Gold et al., “Modeling take-over performance in level 3 conditionally automated vehicles”, Accident Analysis and Prevention, Available Online at: <http://dx.doi.org/10.1016/j.aap.2017.11.009>, 2017, 11 pages. [cited by applicant]
Goodfellow et al., “Generative Adversarial Nets”, Curran Associates, Inc., Available Online at: <http://papers.nips.cc/paper/5423-generative-adversarial-nets.pdf>, 2014, pp. 2672-2680. [cited by applicant]
Güler et al., “DensePose: Dense Human Pose Estimation in the Wild”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7297-7306. [cited by applicant]
Gupta et al., “Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks”, Mar. 2018, 10 pages. [cited by applicant]
Hayakawa et al., “Pedestrian Action Recognition and Localization Using RGB Images and Pose”, 2020, 6 pages. [cited by applicant]
He et al., “Mask R-CNN”, Facebook AI Research (FAIR), Jan. 2018, 12 pages. [cited by applicant]
Hergeth, “Keep Your Scanners Peeled: Gaze Behavior as a Measure of Automation Trust During Highly Automated Driving”, Hum Factors 58, Available Online at: <https://doi.org/10.1177/0018720815625744>, May 2016, pp. 509-51… [cited by applicant]
Inagaki et al., “Human's Overtrust in and Overreliance on Advanced Driver Assistance Systems: A Theoretical Framework”, International Journal of Vehicular Technology, Available Online at: <http://dx.doi.org/10.1155/2013… [cited by applicant]
Itani et al., “Privacy as a Service: Privacy-Aware Data Storage and Processing in Cloud Computing Architectures”, Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing, Dec. 2009, pp. 711-71… [cited by applicant]
Jajodia et al., “A Unified Framework for Enforcing Multiple Access Control Policies”, ACM, 1997, 474-485 pages. [cited by applicant]
Kotseruba et al., “Joint Attention in Autonomous Driving (JAAD)”, Apr. 2017, 10 pages. [cited by applicant]
Kreiss et al., “PifPaf: Composite Fields For Human Pose Estimation”, In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2019, 10 pages. [cited by applicant]
Kumar et al., “Adaptive Trust Calibration for Level Driving Automation”, Proc. IEEE Intelligent Transportation Systems Available Online at: <https://doi.org/10.1145/3334480.3382963>, Sep. 24, 2020, 10 pages. [cited by applicant]
Li et al., “Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognition”, CVPR, Apr. 2019, 12 pages. [cited by applicant]
Li et al., “Investigating the Effects of Age and Disengagement in Driving on Driver's Takeover Control Performance in Highly Automated Vehicles”, Transportation Planning and Technology, vol. 42, No. 5, Available online … [cited by applicant]
Liu et al., “Adversarial Learning of Task-Oriented Neural Dialog Models”, Available Online at: <https://arxiv.org/abs/1805.11762>, 2018, 10 pages. [cited by applicant]
Liu et al., “CBNet: A Novel Composite Backbone Network Architecture for Object Detection”, Wangxuan Institute of Computer Technology, Peking University, Department of Computer Science , Stony Brook University, Sep. 2019… [cited by applicant]
Liu et al., “High-Level Semantic Feature Detection: A New Perspective for Pedestrian Detection”, In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 5187-5196. [cited by applicant]
Liu et al., “SSD: Single Shot MultiBox Detector”, Springer International Publishing AG, ECCV 2016, Part I, LNCS 9905, 2016, pp. 21-37. [cited by applicant]
Loper et al., “SMPL: A Skinned Multi-Person Linear Model”, ACM Transactions on Graphics, vol. 34, No. 6, Oct. 2015, pp. 1-16. [cited by applicant]
Lu et al., “Eye Tracking: A Process-Oriented Method for Inferring Trust in Automation as a Function of Priming and System Reliability”, IEEE, Transactions on Human-Machine Systems, Available online at: <https://doi.org/… [cited by applicant]
Magassouba et al., “Understanding Natural Language Instructions for Fetching Daily Objects Using GAN-Based Multimodal Target-Source Classification”, Available Online at: <https://arxiv.org/abs/1906.06830>, 2017, 8 pages. [cited by applicant]
Maltz et al., “Imperfect In-vehicle Collision Avoidance Warning Systems Can Aid Distracted Drivers”, Transportation Research Part F: Traffic Psychology and Behaviour Available Online at: <https://doi.org/10.1016/j.trf.2… [cited by applicant]
Mirza et al., “Conditional Generative Adversarial Nets”, Available Online at: <https://arxiv.org/abs/1411.1784>, 2014, 7 pages. [cited by applicant]
Olsen Anneli, “The Tobii I-VT Fixation Filter”, Tobii Technology, Mar. 20, 2012, 21 pages. [cited by applicant]
Pal et al., ““Looking at The Right Stuff”—Guided Semantic-Gaze for Autonomous Driving”, The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, 10 pages. [cited by applicant]
Ramanishka et al., “Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoning”, In Conference on Computer Vision and Pattern Recognition, 2018, 9 pages. [cited by applicant]
Rasouli et al., “Pedestrian Action Anticipation Using Contextual Feature Fusion in Stacked RNNs”, BMVC, 2019, 13 pages. [cited by applicant]
Redmon et al., “YOLOv3: An Incremental Improvement”, University of Washington, Apr. 2018, 6 pages. [cited by applicant]
SAE International, “Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems”, Available Online at: <https://www.sae.org/news/3544/>, 2014, 35 pages. [cited by applicant]
Schatzmann et al., “A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies”, The Knowledge Engineering Review, Available Online at: <https://doi.org/10.1017/S0269… [cited by applicant]
Si et al., “An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition”, Mar. 2019, 10 pages. [cited by applicant]
Tawari et al., “Learning to Attend to Salient Targets in Driving Videos Using Fully Convolutional RNN”, 21st International Conference on Intelligent Transportation Systems (ITSC), 2018, 8 pages. [cited by applicant]
Tobiipro, “Tobii Pro Lab User Manual”, Available Online at: <https://www.tobiipro.com/siteassets/tobii-pro/user-manuals/Tobii-Pro-Lab-User-Manual/>, Aug. 31, 2015, 148 pages. [cited by applicant]
Toshev et al., “DeepPose: Human Pose Estimation via Deep Neural Networks.”, IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 1653-1660. [cited by applicant]
Van Dijk et al., “On the Impossibility of Cryptography Alone for {Privacy-Preserving} Cloud Computing”, 5th USENIX Workshop on Hot Topics in Security (HotSec 10), 2010, 8 pages. [cited by applicant]
Wang et al., “Temporal Segment Networks: Towards Good Practices for Deep Action Recognition”, Aug. 2016, 16 pages. [cited by applicant]
Wei et al., “Convolutional Pose Machines”, CVPR, 2016, 9 pages. [cited by applicant]
Wojke et al., “Simple Online and Realtime Tracking With a Deep Association Metric”, IEEE International Conference on Image Processing (ICIP), 2017, pp. 3645-3649. [cited by applicant]
Wu et al., “Drivers' Attitudes and Perceptions towards a Driving Automation System with Augmented Reality Human-Machine Interface”, Proc. IEEE Intelligent Vehicles Symposium, Available Online at: <https://doi.org/10.110… [cited by applicant]
Wu et al., “Take-Over Performance and Safety Analysis Under Different Scenarios and Secondary Tasks in Conditionally Automated Driving”, IEEE, 2019, pp. 136924-136933. [cited by applicant]
Xia Qi, “MeDShare: Trust-Less Medical Data Sharing Among Cloud Service Providers via Blockchain”, IEEE, vol. 5, Jul. 24, 2017, 14757-14767 pages. [cited by applicant]
Yan et al., “Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition”, Department of Information Engineering, The Chinese University of Hong Kong, Jan. 2018, 10 pages. [cited by applicant]
Yang et al., “3D Human Pose Estimation in the Wild by Adversarial Learning”, IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 5255-5264. [cited by applicant]
Zhang, “CityPersons: A Diverse Dataset for Pedestrian Detection”, Feb. 2017, 12 pages. [cited by applicant]
Zheng et al., “Mars: A Video Benchmark For Large-Scale Person Re-Identification”, In Computer Vision—ECCV 2016, Sep. 2016, pp. 868-884. [cited by applicant]
Zhou et al., “Temporal Relational Reasoning in Videos”, Jul. 2018, 16 pages. [cited by applicant]
Zhu et al., “StarNet: Pedestrian Trajectory Prediction using Deep Neural Network in Star Topology”, Jun. 2019, 6 pages. [cited by applicant]
Zhu et al., “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”, In IEEE International Conference on Computer Vision (ICCV), 2017, 18 pages. [cited by applicant]
Alemi et al., “Deep Variational Information Bottleneck”, Conference Paper at ICLR 2017, 2017, 19 pages. [cited by applicant]
Bojarski et al., “End to End Learning for Self-Driving Cars”, NVIDIA Corporation, Holmdel, NJ 07735, Apr. 25, 2016, 9 pages. [cited by applicant]
Bojarski et al., “VisualBackProp: Visualizing CNNs for Autonomous Driving”, Nov. 16, 2016, 13 pages. [cited by applicant]
Chen et al., “Multi-View 3D Object Detection Network for Autonomous Driving”, Department of Electronic Engineering, Tsinghua University, Baidu Inc., Jun. 22, 2017, 9 pages. [cited by applicant]
Finn et al., “A Connection Between Generative Adversarial Networks, Inverse Reinforcement Learning, and Energy-Based Models”, University of California, Berkeley, Nov. 25, 2016, 10 pages. [cited by applicant]
Finn et al., “Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimization”, University of California, Berkeley, Berkeley, CA 94709 USA, May 27, 2016, 13 pages. [cited by applicant]
Fu et al., “Learning Robust Rewards with Adversarial Inverse Reinforcement Learning”, Conference Paper at ICLR 2018, Department of Electrical Engineering and Computer Science, University of California, 2018, 15 pages. [cited by applicant]
Gilmer et al., “Neural Message Passing for Quantum Chemistry”, Jun. 12, 2017, 14 pages. [cited by applicant]
Hoshen, Yedid, “VAIN: Attentional Multi-agent Predictive Modeling”, Facebook AI Research, NYC, Sep. 28, 2018, 12 pages. [cited by applicant]
Jang et al., “Categorical Reparameterization With Gumbel—Softmax”, conference paper at ICLR 2017, Aug. 5, 2017, 13 pages. [cited by applicant]
Kesting et al., “Enhanced Intelligent Driver Model to Access the Impact of Driving Strategies on Traffic Capacity”, Institute for Transport & Economics, Dec. 18, 2009, 20 pages. [cited by applicant]
Kim et al., “Interpretable Learning for Self-Driving Cars by Visualizing Causal Attention”, Computer Science Division, University of California, Berkeley, CA 94720, USA, Mar. 30, 2017, 9 pages. [cited by applicant]
Kim et al., “Textual Explanations for Self-Driving Vehicles”, EECS, University of California, Berkeley CA 94720, USA, MPI for Informatics, Saarland Informatics Campus, 66123 Saarbrucken, Germany, AMLab, University of Am… [cited by applicant]
Kipf et al., “Neural Relational Inference for Interacting Systems”, Jun. 6, 2018, 17 pages. [cited by applicant]
Levine, Sergey, “Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review”, UC Berkeley, May 20, 2018, 22 pages. [cited by applicant]
Peng et al., “Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL and GANs By Constraining Information Flow”, University of California, Berkeley, Dec. 29, 2018, 27 pages. [cited by applicant]
Steenkiste et al., “Relational Neural Expectation Maximization: Unsupervised Discovery of Objects and Their Interactions”, Conference Paper at ICLR 2018, Feb. 28, 2018, 15 pages. [cited by applicant]
Sukhbaatar et al., “Learning Multiagent Communication with Backpropagation”, 29th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain., Oct. 31, 2006, 12 pages. [cited by applicant]
Sun et al., “Probabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learning”, Sep. 9, 2018, 7 pages. [cited by applicant]
Tang et al., “Disturbance-Observer-Based Tracking Controller for Neural Network Driving Policy Transfer”, IEEE Transactions On Intelligent Transportation Systems, Dec. 5, 2019, 12 pages. [cited by applicant]
Velickovic et al., “Graph Attention Networks”, Conference Paper at ICLR 2018, Feb. 4, 2018, 12 pages. [cited by applicant]
Yu et al., “Multi-Agent Adversarial Inverse Reinforcement Learning”, Jul. 30, 2019, 13 pages. [cited by applicant]
Ziebart et al., “Maximum Entropy Inverse Reinforcement Learning”, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence,… [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/139,788, mailed on Mar. 10, 2023, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/139,788, mailed on Jul. 27, 2023, 17 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/139,788, mailed on Nov. 2, 2022, 15 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/950,820, mailed on Oct. 21, 2022, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/846,081, mailed on Dec. 7, 2022, 8 pages. [cited by applicant]
Bolstad et al., “Measurement of Situation Awareness for Automobile Technologies of the Future”, Performance Metrics for Assessing Driver Distraction: the Quest for Improved Road Safety, 2010, 18 pages. [cited by applicant]
Endsley, Mica R., “A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM”, Human factors, doi: 10.1177/0018720819875376, Available online at: <http://w… [cited by applicant]
Gabbard et al., “AR DriveSim: An Immersive Driving Simulator for Augmented Reality Head-Up Display Research”, Frontiers for Augmented Reality Head-Up Display Research, Frontiers in Robotics and AI, vol. 6, Available onl… [cited by applicant]
Gregoriades et al., “Simulation-based Evaluation of an in-vehicle Smart Situation Awareness Enhancement System”, Ergonomics, vol. 61, No. 7, Available online at: <https://www.tandfonline.com/doi/full/10.1080/00140139.20… [cited by applicant]
Just et al., “A Theory of Reading: From Eye Fixations to Comprehension”, Psychological Review, vol. 87, No. 04, Jul. 1980, pp. 329-354. [cited by applicant]
Kim et al., “Assessing Distraction Potential of Augmented Reality Head-Up Displays for Vehicle Drivers”, Human Factors: The Journal of the Human Factors and Ergonomics Society, Available online at: <http://journals.sage… [cited by applicant]
Kim, Hyungil, “Augmented Reality Pedestrian Collision Warning: An Ecological Approach to Driver Interface Design and Evaluation”, PhD Dissertation, Virginia Tech., Sep. 29, 2017, 144 pages. [cited by applicant]
Kim et al., “Toward Prediction of Driver Awareness of Automotive Hazards: Driving-Video-Based Simulation Approach”, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 63, No. 1, Available onlin… [cited by applicant]
Kim et al., “Toward Real-Time Estimation of Driver Situation Awareness: An Eye Tracking Approach based on Moving Objects of Interest”, 2020 IEEE Intelligent Vehicles Symposium (IV), doi: 10.1109/IV47402.2020.9304770, 20… [cited by applicant]
Kim et al., “Virtual Shadow: Making Cross Traffic Dynamics Visible Through Augmented Reality Head Up Display”, Proceedings of the Human Factors and Ergonomics Society, SAGE Publications, 2016, pp. 2093-2097. [cited by applicant]
Koenderink et al., “Spatial and Temporal Parameters of Motion Detection in the Peripheral Visual Field”, Journal of the Optical Society of America A, vol. 2, No. 2, Available online at: <https://www.osapublishing.org/ab… [cited by applicant]
Kuefler et al., “Imitating Driver Behavior with Generative Adversarial Networks”, IEEE, Jan. 24, 2017, 8 pages. [cited by applicant]
Li et al., “Improved Generative Adversarial Networks with Reconstruction Loss”, Neurocomputing, vol. 323, 2019, pp. 363-372. [cited by applicant]
Martin et al., “Dynamics of Driver's Gaze: Explorations in Behavior Modeling & Maneuver Prediction”, IEEE Transactions on Intelligent Vehicles, vol. 3, No. 2, Feb. 2018, 10 pages. [cited by applicant]
Martinez et al., “Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance”, IEEE Transactions on Intelligent Transportation Systems, vol. 19, No. 3, Mar. 3, 2018, pp. 666-676. [cited by applicant]
Moore et al., “Development of a Novel Measure of Situation Awareness: The Case for Eye Movement Analysis”, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 54, No. 19, Available online at: <h… [cited by applicant]
Oliver et al., “Graphical Models for Driver Behavior Recognition in a Smartcar”, IEEE, 2000, 6 pages. [cited by applicant]
Platho et al., “Learning Driving Situations and Behavior Models from Data”, Proceedings of the 16th International IEEE Annual Conference on Intelligent Transportation Systems (ITSC 2013), The Hague, The Netherlands, Oct… [cited by applicant]
Rayner et al., “Eye Movements”, Scholarpedia, vol. 2, No. 10, Available online at: <http://www.scholarpedia.org/article/Eye movements> [Retrieved Mar. 17, 2022], 2007, 11 pages. [cited by applicant]
Rucci et al., “Fixational Eye Movements and Perception”, Vision Research, Jan. 2016, pp. 1-4. [cited by applicant]
Rushton et al., “Behavioral Development and Construct Validity: The Principle of Aggregation”, Psychological Bulletin, vol. 94, No. 1, Jul. 1983, pp. 18-38. [cited by applicant]
Salvucci, Dario, “Modeling Driver Behavior in a Congitive Architecture”, Human Factors, vol. 48, 2006, pp. 362-380. [cited by applicant]
Sethumadhavan, Arathi, “Knowing What You Know: The Role of Meta-Situation Awareness in Predicting Situation Awareness”, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 55, No. 1, Available o… [cited by applicant]
Strasburger et al., “Peripheral Vision and Pattern Recognition: A Review”, Journal of Vision, vol. 11, No. 5, 2011, pp. 1-82. [cited by applicant]
Tobii Technology, “Tobii Glasses Eye Tracker User Manual”, Danderyd, Sweden: Tobii Technology AB, 2012, 70 pages. [cited by applicant]
Uricar et al., “Yes, We Gan: Applying Adversarial Techniques for Autonomous Driving”, arXiv:1902.03442v2, Feb. 2, 2020, 16 pages. [cited by applicant]
Vondrick et al., “Efficiently Scaling Up Crowdsourced Video Annotation”, International Journal of Computer Vision, vol. 101, No. 1, Jan. 2013, 22 pages. [cited by applicant]
Wickens et al., “Modeling of Situation Awareness Supported by Advanced Flight Deck Displays”, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 51, No. 12, Available online at: <http://journal… [cited by applicant]
Winter et al., “Situation Awareness Based on Eye Movements in Relation to the Task Environment”, Cognition, Technology and Work, 2019, 14 pages. [cited by applicant]
Zhang et al., “Deeproad: Gan-Based Metamorphic Testing and Input Validation Framework for Autonomous Driving System”, 2018 33rd IEEE/ACM International Conference on Automated Software Engineering (ASE), Sep. 3, 2018, 11… [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/139,788, mailed on Feb. 14, 2024, 9 pages. [cited by applicant]
Cited By (1)
US 12,546,609