IP Library › Granted Patent US 12,288,166
Granted Patent B2
US 12,288,166 · App. 16/456,937 · Granted Apr 29, 2025

Assessment and response mechanism for autonomous systems

Inventors: Helen Adrienne Frances Gould (Portland, OR); Ignacio Javier Alvarez Martinez (Portland, OR); David W. Browning (Portland, OR)
Assignee: Intel Corporation
G06N5/022G06F9/45558G06N20/00G06F2009/45595
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,166
App. No.
16/456,937
Filed
Jun 28, 2019
Granted
Apr 29, 2025
Kind
B2
Art Unit
3668
USPC
701/1
Abstract

Various systems and methods for implementing an assessment and response mechanism for autonomous systems are described herein. An assessment and response system for an autonomous system is configured to access a realm classification of an event; determine a hazard score based on the realm classification, a severity metric, a likelihood metric, an urgency metric, and a confidence level metric; identify, based on the hazard score, a responsive action; and record details of the hazard score determination and the responsive action in a decision ledger.

Claims (47)

1. An assessment and response system for an autonomous system comprising:

a processor subsystem; and

a memory device including instructions, which when executed by the processor subsystem, cause the processor subsystem to:

access a realm classification of an event occurring at a roadway location, wherein the realm classification classifies the event into one of a known domain or an unknown domain;

determine a hazard score for possible outcomes of the event based on the realm classification, a severity metric, a likelihood metric, an urgency metric, and a confidence level metric, wherein the severity metric is based on severity of the possible outcomes, wherein the likelihood metric is based on controllability of the possible outcomes, and wherein the urgency metric is based on speed of an autonomous response required from the autonomous system to perform a corresponding action for each of the possible outcomes;

identify, based on the hazard score, a responsive action of a safety system of the autonomous system, wherein the responsive action includes causing actuation of at least one of steering, braking, or stabilization of the autonomous system, and wherein the responsive action is identified based on: (i) whether the event is classified into the known domain or the unknown domain, (ii) the speed of the autonomous response required from the autonomous system to perform the responsive action, and (iii) whether the responsive action complies with one or more ethics rules applicable to the roadway location, wherein the one or more ethics rules are evaluated separately from rules of safety;

control the safety system of the autonomous system to perform the responsive action; and

record details of the hazard score determination and the responsive action in a decision ledger.

2. The system of claim 1 , wherein the known domain includes recognized events and the unknown domain includes unrecognized events.

3. The system of claim 1 , wherein the realm classification is performed by a realm classifier model that analyzes the event, and wherein the realm classifier model is to further classify the event as having one of an acceptable outcome or an unacceptable outcome.

4. The system of claim 1 , wherein the likelihood metric includes an exposure metric.

5. The system of claim 1 , wherein the likelihood metric includes a controllability metric.

6. The system of claim 1 , wherein to determine the hazard score, the processor subsystem is to determine the confidence level metric based on confidence in the severity metric, the likelihood metric, the urgency metric, and the possible outcomes of the event.

7. The system of claim 1 , wherein to determine the hazard score, the processor subsystem is to multiply the severity metric, the likelihood metric, the urgency metric, and the confidence level metric.

8. The system of claim 1 , wherein to identify the responsive action, the processor subsystem is to:

obtain a plurality of possible responsive actions involving causing at least one of steering, braking, or stabilization of the autonomous system;

access a policy bank to obtain the one or more ethics rules to evaluate the plurality of possible responsive actions; and

select the responsive action based on, at least in part, the one or more ethics rules from the policy bank.

9. The system of claim 1 , wherein to record the details of the hazard score determination and the responsive action in the decision ledger, the processor subsystem is to:

access a blockchain; and

write the details of the hazard score determination and the responsive action to the blockchain.

10. A method of providing an assessment and response system for an autonomous system, the method comprising:

accessing a realm classification of an event occurring at a roadway location, wherein the realm classification classifies the event into one of a known domain or an unknown domain;

determining a hazard score for possible outcomes of the event based on the realm classification, a severity metric, a likelihood metric, an urgency metric, and a confidence level metric, wherein the severity metric is based on severity of the possible outcomes, wherein the likelihood metric is based on controllability of the possible outcomes, and wherein the urgency metric is based on speed of an autonomous response required from the autonomous system to perform a corresponding action for each of the possible outcomes;

identifying, based on the hazard score, a responsive action of a safety system of the autonomous system, wherein the responsive action includes causing actuation of at least one of steering, braking, or stabilization of the autonomous system, and wherein the responsive action is identified based on: (i) whether the event is classified into the known domain or the unknown domain, (ii) the speed of the autonomous response required from the autonomous system to perform the responsive action, and (iii) whether the responsive action complies with one or more ethics rules applicable to the roadway location, wherein the one or more ethics rules are evaluated separately from rules of safety;

causing the safety system of the autonomous system to perform the responsive action; and

recording details of the hazard score determination and the responsive action in a decision ledger.

11. The method of claim 10 , wherein the known domain includes recognized events and the unknown domain includes unrecognized events.

12. The method of claim 10 , wherein the realm classification is performed by a realm classifier model that analyzes the event, and wherein the realm classifier model classifies the event as having one of an acceptable outcome or an unacceptable outcome.

13. The method of claim 10 , wherein the likelihood metric includes an exposure metric.

14. The system of claim 10 , wherein the likelihood metric includes a controllability metric.

15. At least one non-transitory machine-readable medium including instructions for providing an assessment and response system for an autonomous system, which when executed by a machine, cause the machine to:

access a realm classification of an event occurring at a roadway location, wherein the realm classification is performed by a realm classifier model that analyzes the event and classifies the event into one of a known domain or an unknown domain;

determine a hazard score for possible outcomes of the event based on the realm classification, a severity metric, a likelihood metric, an urgency metric, and a confidence level metric, wherein the severity metric is based on severity of the possible outcomes, wherein the likelihood metric is based on controllability of the possible outcomes, and wherein the urgency metric is based on speed of an autonomous response required from the autonomous system to perform a corresponding action for each of the possible outcomes;

identify, based on the hazard score, a responsive action of a safety system of the autonomous system, wherein the responsive action includes causing actuation of at least one of steering, braking, or stabilization of the autonomous system, and wherein the responsive action is identified based on:

(i) whether the event is classified into the known domain or the unknown domain, (ii) the speed of the autonomous response required from the autonomous system to perform the responsive action, and (iii) whether the responsive action complies with one or more ethics rules applicable to the roadway location, wherein the one or more ethics rules are evaluated separately from rules of safety;

cause the safety system of the autonomous system to perform the responsive action; and

record details of the hazard score determination and the responsive action in a decision ledger.

16. The at least one non-transitory machine-readable medium of claim 15 , wherein to determine the hazard score, the instructions cause the machine to determine the confidence level metric based on confidence in the severity metric, the likelihood metric, the urgency metric, and the possible outcomes of the event.

17. The at least one non-transitory machine-readable medium of claim 15 , wherein to determine the hazard score, the machine is to multiply the severity metric, the likelihood metric, the urgency metric, and the confidence level metric.

18. The at least one non-transitory machine-readable medium of claim 15 , wherein to identify the responsive action, the instructions cause the machine to:

obtain a plurality of possible responsive actions involving causing at least one of steering, braking, or stabilization of the autonomous system;

access a policy bank to obtain the one or more ethics rules to evaluate the plurality of possible responsive actions; and

select the responsive action based on, at least in part, the one or more ethics rules from the policy bank.

19. The at least one non-transitory machine-readable medium of claim 15 , wherein to record the details of the hazard score determination and the responsive action in the decision ledger, the instructions cause the machine to:

access a blockchain; and

write the details of the hazard score determination and the responsive action to the blockchain.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2019
From: GOULD, HELEN ADRIENNE FRANCES; ALVAREZ MARTINEZ, IGNACIO JAVIER; BROWNING, DAVID W
To: INTEL CORPORATION
Reel/Frame 051341/0623 →
Continuity (1)
Related Publication 20190318257A1 · Oct 17, 2019
References Cited (60)
US 6748284B1 · Vaughan · 2004 [cited by examiner]
US 9690937B1 · Duchin · 2017 [cited by examiner]
US 10392022B1 · Rau · 2019 [cited by examiner]
US 10586024B1 · Patton · 2020 [cited by examiner]
US 10643407B1 · Tang · 2020 [cited by examiner]
US 20050114829A1 · Robin · 2005 [cited by examiner]
US 20120208492A1 · Tschofenig · 2012 [cited by examiner]
US 20140249927A1 · De Angelo · 2014 [cited by examiner]
US 20150170287A1 · Tirone · 2015 [cited by examiner]
US 20150227868A1 · Saraf · 2015 [cited by examiner]
US 20150331422A1 · Hartung · 2015 [cited by examiner]
US 20170091617A1 · Baughman · 2017 [cited by examiner]
US 20170101093A1 · Barfield, Jr. · 2017 [cited by examiner]
US 20170153644A1 · Otsuka · 2017 [cited by examiner]
US 20170214702A1 · Moscovici · 2017 [cited by examiner]
US 20170240096A1 · Ross · 2017 [cited by examiner]
US 20170240098A1 · Sweeney · 2017 [cited by examiner]
US 20170329332A1 · Pilarski · 2017 [cited by examiner]
US 20180075309A1 · Sathyanarayana · 2018 [cited by examiner]
US 20180220309A1 · Gomes · 2018 [cited by examiner]
US 20180285343A1 · Chen · 2018 [cited by examiner]
US 20180348763A1 · Jiang · 2018 [cited by examiner]
US 20190056726A1 · Weldemariam · 2019 [cited by examiner]
US 20190102554A1 · Luo · 2019 [cited by examiner]
US 20190113927A1 · Englard · 2019 [cited by examiner]
US 20190165949A1 · Ramos · 2019 [cited by examiner]
US 20190205744A1 · Mondello · 2019 [cited by examiner]
US 20190205765A1 · Mondello · 2019 [cited by examiner]
US 20190286793A1 · Patton · 2019 [cited by examiner]
US 20190318265A1 · Gould · 2019 [cited by examiner]
US 20190355257A1 · Caldwell · 2019 [cited by examiner]
US 20190359056A1 · Wilson · 2019 [cited by examiner]
US 20190370760A1 · Kundu · 2019 [cited by examiner]
US 20190379699A1 · Katragadda · 2019 [cited by examiner]
US 20190392308A1 · Bhatnagar · 2019 [cited by examiner]
US 20200097004A1 · Whittaker · 2020 [cited by examiner]
US 20200118441A1 · Han · 2020 [cited by examiner]
US 20200159601A1 · Asmussen · 2020 [cited by examiner]
US 20200164874A1 · Zhao · 2020 [cited by examiner]
US 20200184741A1 · Tormasov · 2020 [cited by examiner]
US 20200192365A1 · Russell · 2020 [cited by examiner]
US 20200201325A1 · Parekh · 2020 [cited by examiner]
US 20200201334A1 · Max · 2020 [cited by examiner]
US 20200307619A1 · Huang · 2020 [cited by examiner]
US 20200394562A1 · Nonaka · 2020 [cited by examiner]
US 20210046924A1 · Caldwell · 2021 [cited by examiner]
US 20210094577A1 · Shalev-Shwartz · 2021 [cited by examiner]
US 20210247205A1 · Szilágyi · 2021 [cited by examiner]
US 20210291823A1 · Newman · 2021 [cited by examiner]
US 20210350256A1 · Asghar · 2021 [cited by examiner]
US 20220030408A1 · Zhang · 2022 [cited by examiner]
US 20220207309A1 · Sathyanarayana · 2022 [cited by examiner]
US 20230284029A1 · Yang · 2023 [cited by examiner]
“Vehicle Cybersecurity”, NHTSA https: www.nhtsa.gov technology-innovation vehicle-cybersecurity, (Accessed on Nov. 27, 2019), 5 pgs. [cited by applicant]
“General Data Protection Regulation”, Wikipedia https: en.wikipedia.org wiki General_Data_Protection_Regulation, (Accessed on Nov. 27, 2019), 17 pgs. [cited by applicant]
“ISO 26262”, Wikipedia https: en.wikipedia.org wiki ISO_26262, (Accessed on Nov. 27, 2019), 5 pgs. [cited by applicant]
“Industrial Internet of Things vol. G4: Security Framework”, IIC:PUB:G4:V1.0:PB:20160926, (2016), 173 pgs. [cited by applicant]
“Ethically Aligned Design”, IEEE, 16 pgs. [cited by applicant]
Awad, Edmond, “The Moral Machine experiment”, https: doi.org 10.1038 s41586-018-0637-6 Nature, (2018), 20 pgs. [cited by applicant]
McLeod, Saul, “Maslow's Hierarchy of Needs”, Simply Psychology, (2018), 14 pgs. [cited by applicant]