IP Library Granted Patent US 11,458,997
Granted Patent B2
US 11,458,997 · App. 16/893,617 · Granted Oct 4, 2022

Autonomous vehicle computing system with processing assurance

Inventors: Sean Hyde (Pittsburgh, PA); Jose Francisco Molinari (Cranberry Township, PA); Stephen Luke Thomas (Cheswick, PA)
Assignee: UATC, LLC
B60W60/0025B60W50/04B60W60/001B60W60/0015B60W60/0027G05B13/027G05D1/0088G06N3/0454G06N3/063G06N3/08B60W2554/00B60W2555/00G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,458,997
App. No.
16/893,617
Granted
Oct 4, 2022
Kind
B2
Abstract

Systems and methods are directed to a method for assured autonomous vehicle compute processing. The method can include providing sensor data to first and second functional circuitry of an autonomy computing system. The first and second functional circuitry can be configured to generate first and second outputs associated with a first autonomous compute function. The method can include generating, by the first and second functional circuitry in response to the sensor data, first and second output data associated with the first autonomous compute function. The method can include generating, by monitoring circuitry of the autonomy computing system, comparative data associated with differences between the first output data and the second output data. The method can include generating one or more vehicle control signals for the autonomous vehicle based at least in part on the comparative data.

Claims (72)

1. A computer-implemented method for assured autonomous vehicle compute processing, comprising:

providing data associated with a sensor system of an autonomous vehicle to first functional circuitry and second functional circuitry of an autonomy computing system of a vehicle computing system, the first functional circuitry configured to generate one or more first outputs associated with a first autonomous compute function of the autonomy computing system and the second functional circuitry configured to generate one or more second outputs associated with the first autonomous compute function of the autonomy computing system;

generating, by the first functional circuitry in response to the data associated with the sensor system, first output data associated with the first autonomous compute function of the autonomy computing system;

generating, by the second functional circuitry in response to the data associated with the sensor system, second output data associated with the first autonomous compute function of the autonomy computing system;

generating, by monitoring circuitry of the autonomy computing system, comparative data associated with one or more differences between the first output data associated with the first autonomous compute function of the autonomy computing system and the second output data associated with the first autonomous compute function of the autonomy computing system; and

generating, by a vehicle computing system, one or more vehicle control signals for the autonomous vehicle based at least in part on the comparative data associated with the one or more differences between the first output data and the second output data.

2. The computer-implemented method of claim 1 , wherein:

the first functional circuitry is configured to generate the first output data associated with the first autonomous compute function of the autonomy computing system at a first frequency; and

the second functional circuitry is configured to generate the second output data associated with the first autonomous compute function of the autonomy computing system at a second frequency that is less than the first frequency.

3. The computer-implemented method of claim 1 , wherein:

the first functional circuitry includes one or more non-assured hardware processing circuits and the second functional circuitry includes one or more non-assured processing circuits; and

the monitoring circuitry includes one or more assured processing circuits.

4. The computer-implemented method of claim 1 , wherein:

the first functional circuitry includes one or more assured hardware processing circuits and the second functional circuitry includes one or more assured processing circuits; and

the method further comprises monitoring, by the monitoring circuitry, performance of one or more operations associated with at least one of the first functional circuitry or the second functional circuitry.

5. The computer-implemented method of claim 4 , wherein

the one or more first outputs of the first functional circuitry is one or more first non-assured outputs;

the one or more second outputs of the second functional circuitry is one or more second non-assured outputs; and

the method further comprises providing, by the monitoring circuitry, one or more assured outputs associated with the one or more first non-assured outputs and the one or more second non-assured outputs.

6. The computer-implemented method of claim 1 , wherein each of the first functional circuitry and the second functional circuitry respectively comprise:

a first processor and a second processor;

a first core of a processor and a second core of the processor; or

a first computing device and a second computing device.

7. The computer-implemented method of claim 1 , wherein the monitoring circuitry comprises virtualized processing circuitry.

8. The computer-implemented method of claim 1 , wherein generating, by the monitoring circuitry of the autonomy computing system, the comparative data associated with the one or more differences between the first output data associated with the first autonomous compute function of the autonomy computing system and the second output data associated with the first autonomous compute function of the autonomy computing system comprises:

using, by the autonomy computing system, the first functional circuitry to generate a second output validation for the one or more second outputs;

using, by the autonomy computing system, the second functional circuitry to generate a first output validation for the one or more first outputs; and

generating, by the monitoring circuitry of the autonomy computing system, the comparative data based at least in part on the first output validation and the second output validation.

9. The computer-implemented method of claim 8 , wherein:

Using, by the autonomy computing system, the first functional circuitry to generate the second output validation for the one or more second outputs comprises inputting the one or more second outputs to one or more first neural networks associated with the first functional circuitry to generate a second output validation; and

using, by the autonomy computing system, the second functional circuitry to generate the first output validation for the one or more first outputs comprises inputting the one or more first outputs to one or more second neural networks associated with the second functional circuitry to generate a first output validation.

10. The computer-implemented method of claim 8 , wherein:

the comparative data indicates a fault associated with the one or more first outputs; and

generating the one or more vehicle control signals comprises generating the one or more vehicle control signals based at least in part on the second output data.

11. The computer-implemented method of claim 9 , further comprising:

controlling, by the vehicle computing system, the autonomous vehicle based at least in part on the one or more vehicle control signals.

12. The computer-implemented method of claim 1 , wherein:

generating, by the first functional circuitry in response to the data associated with the sensor system, the first output data comprises using, by the first functional circuitry, one or more first neural networks to generate the first output data; and

generating, by the second functional circuitry in response to the data associated with the sensor system, the second output data comprises using, by the second functional circuitry, one or more second neural networks to generate the second output data.

13. The computer-implemented method of claim 1 , further comprising:

evaluating at least one output of a perception system of the autonomy computing system using a perception checking system;

evaluating at least one output of a prediction system of the autonomy computing system using a prediction checking system; and

evaluating at least one output of a motion planning system of the autonomy computing system using a motion planning checking system.

14. The computer-implemented method of claim 1 , wherein:

the first output data comprises perception data associated with a first object; and

the second output data comprises perception data associated with the first object.

15. The computer-implemented method of claim 1 , wherein:

the first output data includes motion planning data comprising a trajectory for the autonomous vehicle; and

the second output data includes motion planning data comprising the trajectory for the autonomous vehicle.

16. An autonomy computing system for an autonomous vehicle, comprising:

first functional circuitry configured to:

obtain data associated with a sensor system of the autonomous vehicle;

generate, based on the data associated with the sensor system, one or more first outputs using one or more first neural networks associated with an autonomous compute function of the autonomous vehicle; and

generate, using the one or more first neural networks associated with the autonomous compute function, a second output validation for one or more second outputs of second functional circuitry of the autonomous vehicle, the one or more second outputs associated with the autonomous compute function of the autonomous vehicle; and

the second functional circuitry configured to:

obtain the data associated with the sensor system of the autonomous vehicle;

generate, based on the data associated with the sensor system, the one or more second outputs using one or more second neural networks; and

generate, using the one or more second neural networks, a first output validation for the one or more first outputs of the first functional circuitry.

17. The autonomy computing system of claim 16 , wherein:

the autonomy computing system is part of a vehicle computing system; and

the vehicle computing system is configured to generate one or more vehicle control signals for the autonomous vehicle based at least in part on at least one of the first output validation or the second output validation.

18. The autonomy computing system of claim 17 , wherein:

the vehicle computing system is configured to, in response to the first functional circuitry detecting a fault associated with the first output validation, generate the one or more vehicle control signals based at least in part on the second output validation.

19. The autonomy computing system of claim 17 , wherein generating, using the one or more second neural networks, the first output validation for the one or more first outputs comprises evaluating the one or more first outputs against a world state associated with the first functional circuitry.

20. A computing system, comprising:

one or more processors; and

one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:

providing data associated with a sensor system of an autonomous vehicle to first functional circuitry and second functional circuitry of an autonomy computing system of a vehicle computing system, the first functional circuitry configured to generate one or more first outputs associated with a first autonomous compute function of the autonomy computing system and the second functional circuitry configured to generate one or more second outputs associated with the first autonomous compute function of the autonomy computing system;

generating, by the first functional circuitry in response to the data associated with the sensor system, first output data associated with the first autonomous compute function of the autonomy computing system;

generating, by the second functional circuitry in response to the data associated with the sensor system, second output data associated with the first autonomous compute function of the autonomy computing system;

generating comparative data associated with one or more differences between the first output data associated with the first autonomous compute function of the autonomy computing system and the second output data associated with the first autonomous compute function of the autonomy computing system; and

generating one or more vehicle control signals for the autonomous vehicle based at least in part on the comparative data associated with the one or more differences between the first output data and the second output data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: UATC, LLC
To: AURORA OPERATIONS, INC.
Reel/Frame 067733/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2020
From: HYDE, SEAN; MOLINARI, JOSE FRANCISCO; THOMAS, STEPHEN LUKE
To: UATC, LLC
Reel/Frame 054767/0987 →