IP Library Granted Patent US 12,151,689
Granted Patent B2
US 12,151,689 · App. 17/498,166 · Granted Nov 26, 2024

Methods and systems for determining diagnostic coverage of sensors to prevent goal violations of autonomous vehicles

Inventor: Schuyler Burson (Royal Oak, MI)
Assignee: Volkswagen Group of America Investments, LLC
B60W50/0205B60W60/001B60W2050/0215B60W2420/403B60W2420/408
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,151,689
App. No.
17/498,166
Granted
Nov 26, 2024
Kind
B2
Abstract

Systems may include a processor to, in response to determining at least one segment of a field of view (FOV) of a first sensor of an autonomous vehicle that overlaps with a FOV of at least one second sensor of the autonomous vehicle, calculate a scaling factor for diagnostic coverage for the at least one segment based on a value of modality overlap (MoD) for the at least one segment, calculate, based on the scaling factor, a value of a metric of hardware failure for the first sensor, and compare the value of the metric of hardware failure to a threshold value to determine whether to increase a diagnostic coverage of the first sensor. Methods, computer program products, and autonomous vehicles are also disclosed.

Claims (48)

1. A system comprising:

a memory; and

at least one processor coupled to the memory and configured to:

in response to determining at least one segment of a field of view (FOV) of a first sensor of an autonomous vehicle that overlaps with a FOV of at least one second sensor of the autonomous vehicle, calculate a scaling factor for diagnostic coverage for the at least one segment based on a value of modality overlap (MoD) for the at least one segment;

calculate, based on the scaling factor, a value of a metric of hardware failure for the first sensor;

compare the value of the metric of hardware failure to a threshold value to determine whether to increase a diagnostic coverage of the first sensor; and

increase the diagnostic coverage of the first sensor.

2. The system of claim 1 , wherein, when calculating the value of the metric of hardware failure for the first sensor, the at least one processor is configured to:

calculate a value of Probabilistic Metric for random Hardware Failures (PMHF) for the first sensor.

3. The system of claim 2 , wherein the at least one processor is further configured to:

calculate a value of latent fault metric (LFM) for the first sensor; and

calculate a value of single-point fault metric (SPFM) for the first sensor.

4. The system of claim 1 , wherein the first sensor comprises a light detection and ranging (LiDAR) sensor, an image sensor, or a radar sensor.

5. The system of claim 1 , wherein the at least one second sensor comprises a LiDAR sensor, an image sensor, or a radar sensor.

6. The system of claim 1 , wherein the at least one processor is further configured to:

determine that additional sensor coverage is necessary in the FOV of the first sensor based on determining that the value of the metric of hardware failure for the first sensor does not satisfy the threshold value associated with the metric of hardware failure.

7. The system of claim 1 , wherein the at least one processor is further configured to:

determine the value of MOD for the at least one segment of the FOV of the first sensor based on a modality of the first sensor and a modality of the at least one second sensor, wherein the modality of the first sensor is different from the modality of the at least one second sensor.

8. A computer program product comprising at least one non-transitory computer-readable medium comprising one or more instructions that, when executed by at least one processor, cause the at least one processor to:

in response to determining at least one segment of a field of view (FOV) of a first sensor of an autonomous vehicle that overlaps with an FOV of at least one second sensor of the autonomous vehicle, calculate a scaling factor for diagnostic coverage for the at least one segment based on a value of modality overlap (MoD) for the at least one segment;

calculate, based on the scaling factor, a value of a metric of hardware failure for the first sensor;

compare the value of the metric of hardware failure to a threshold value to determine whether to increase a diagnostic coverage of the first sensor; and

increase the diagnostic coverage of the first sensor.

9. The computer program product of claim 8 , wherein the one or more instructions that cause the at least one processor to calculate the value of the metric of hardware failure for the first sensor, the at least one processor is programmed or configured to:

calculate a value of Probabilistic Metric for random Hardware Failures (PMHF) for the first sensor.

10. The computer program product of claim 9 , wherein the one or more instructions further cause the at least one processor to:

calculate a value of latent fault metric (LFM) for the first sensor; or

calculate a value of single-point fault metric (SPFM) for the first sensor.

11. The computer program product of claim 8 , wherein the first sensor comprises a light detection and ranging (LiDAR) sensor, an image sensor, or a radar sensor.

12. The computer program product of claim 8 , wherein the at least one second sensor comprises a LiDAR sensor, an image sensor, or a radar sensor.

13. The computer program product of claim 8 , wherein the one or more instructions further cause the at least one processor to:

determine that additional sensor coverage is necessary in the FOV of the first sensor based on determining that the value of the metric of hardware failure for the first sensor does not satisfy the threshold value associated with the metric of hardware failure.

14. The computer program product of claim 8 , wherein the one or more instructions further cause the at least one processor to:

determine the value of MOD for the at least one segment of the FOV of the first sensor based on a modality of the first sensor and a modality of the at least one second sensor, wherein the modality of the first sensor is different from the modality of the at least one second sensor.

15. A method, comprising:

in response to determining at least one segment of a field of view (FOV) of a first sensor of an autonomous vehicle that overlaps with a FOV of at least one second sensor of the autonomous vehicle, calculating, with at least one processor, a scaling factor for diagnostic coverage for the at least one segment based on a value of modality overlap (MoD) for the at least one segment;

calculating, with the at least one processor, a value of a metric of hardware failure for the first sensor based on the scaling factor;

comparing, with the at least one processor, the value of the metric of hardware failure to a threshold value to determine whether to increase a diagnostic coverage of the first sensor; and

increasing, with the at least one processor, the diagnostic coverage of the first sensor.

16. The method of claim 15 , wherein calculating the value of the metric of hardware failure for the first sensor comprises:

calculating a value of Probabilistic Metric for random Hardware Failures (PMHF) for the first sensor.

17. The method of claim 16 , further comprising:

calculating a value of latent fault metric (LFM) for the first sensor; and

calculating a value of single-point fault metric (SPFM) for the first sensor.

18. The method of claim 15 , further comprising:

determining that additional sensor coverage is necessary in the FOV of the first sensor based on determining that the value of the metric of hardware failure for the first sensor does not satisfy the threshold value associated with the metric of hardware failure.

19. The method of claim 15 , further comprising:

determining the value of MOD for the at least one segment of the FOV of the first sensor based on a modality of the first sensor and a modality of the at least one second sensor, wherein the modality of the first sensor is different from the modality of the at least one second sensor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2024
From: ARGO AI, LLC
To: VOLKSWAGEN GROUP OF AMERICA INVESTMENTS, LLC
Reel/Frame 069228/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2021
From: BURSON, SCHUYLER
To: ARGO AI, LLC
Reel/Frame 057752/0299 →
Continuity (1)
Related Publication 20230113560A1 · Apr 13, 2023