Granted Patent B2

US 12,565,230 · App. 18/453,725 · Granted Mar 3, 2026

Inventors: Ali Reza Abbaspour (Escondido, CA); Volodimir Slobodyanyuk (San Diego, CA); Mohammed Ataur Rahman Shuman (San Diego, CA)

Assignee: QUALCOMM Incorporated

B60W60/001B60W50/0205B60W2050/0083B60W2050/021

Abstract

Claims (98)

1 . An environment perception system, of an ego vehicle, comprising:

one or more sensors;

one or more receivers;

one or more memories; and

one or more processors communicatively coupled to the one or more sensors, the one or more receivers, and the one or more memories, the one or more processors being configured to:

receive, via the one or more receivers from a device external to the ego vehicle, a plurality of first reliability factors associated with the device and with a first value of a parameter of an environment containing the ego vehicle;

determine, based on the plurality of first reliability factors, a first reliability trust score of the first value of the parameter;

determine, based on a plurality of second reliability factors associated with the ego vehicle and with a second value of the parameter of the environment provided by the one or more sensors, a second reliability trust score of the second value of the parameter of the environment;

provide a reliability indication indicating which of the first value of the parameter of the environment and the second value of the parameter of the environment is more reliable based on which of the first reliability trust score and the second reliability trust score indicates a higher reliability; and

perform, based on the reliability indication, at least one autonomous driving operation comprising at least one of:

calibrating at least a first one of the one or more sensors using the first value of the parameter of the environment based on the first trust score indicating higher reliability than the second trust score; and

evaluating an environment near the ego vehicle using at least a second one of the one or more sensors without calibrating the second one of the one or more sensors based on the second trust score indicating higher reliability than the first trust score.

2 . The environment perception system of claim 1 , wherein the one or more first reliability factors indicate a type of the device, or a first sensor type, or an age of the device, or an age of a sensor corresponding to the first value of the parameter of the environment, or a distance between the ego vehicle and the device, or a security integrity level of the device, or a safety integrity level of the device, or a software version associated with a sensor of the device, or a mileage of the device, or a combination of any two or more thereof, and wherein the one or more second reliability factors indicate a type of the ego vehicle, or a second sensor type, or an age of the ego vehicle, or an age of a sensor corresponding to the second value of the parameter of the environment, or the distance between the ego vehicle and the device, or a security integrity level of the ego vehicle, or a safety integrity level of the ego vehicle, or a software version associated with one or more of the one or more sensors of the ego vehicle, or a mileage of the ego vehicle, or a combination of any two or more thereof.

3 . The environment perception system of claim 1 , wherein the one or more processors are configured to:

receive, via the one or more receivers, the first value of the parameter of the environment;

determine, based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

determine a perception of the environment based on the first value of the parameter of the environment and the second value of the parameter of the environment, while giving more weight to the one of the first value of the parameter of the environment and the second value of the parameter of the environment that is more reliable.

4 . The environment perception system of claim 1 , wherein the one or more processors are configured to:

receive, via the one or more receivers, the first value of the parameter of the environment;

determine, based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

calibrate at least one of the one or more sensors using the first value of the parameter of the environment, based on the reliability indication indicating that the first value of the parameter of the environment is more reliable than the second value of the parameter of the environment.

5 . The environment perception system of claim 4 , wherein the one or more processors are configured to calibrate the at least one of the one or more sensors, using the first value of the parameter of the environment, based further on the first value of the parameter of the environment differing by less than a threshold amount from the second value of the parameter of the environment.

6 . The environment perception system of claim 1 , wherein the one or more processors are configured to:

receive, via the one or more receivers, the first value of the parameter of the environment;

determine, based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

perform fault mitigation based on the reliability indication indicating that the first value of the parameter of the environment is more reliable than the second value of the parameter of the environment, and based on the first value of the parameter of the environment differing by more than a threshold amount from the second value of the parameter of the environment.

7 . The environment perception system of claim 6 , wherein to perform the fault mitigation the one or more processors are configured to perform one of a hierarchy of fault mitigation operations based on availability of a driver or availability of one or more resources of the ego vehicle.

8 . The environment perception system of claim 7 , wherein a highest priority of the hierarchy of fault mitigation operations comprises providing driving control of the ego vehicle to the driver.

9 . The environment perception system of claim 1 , wherein:

to receive the one or more first reliability factors the one or more processors are configured to receive, via the one or more receivers for each of a plurality of devices external to the ego vehicle, one or more respective first reliability factors;

to determine the first reliability the one or more processors are configured to determine a plurality of first reliabilities each corresponding to a respective one of the plurality of devices and a respective first value of the parameter of the environment, and each based on the one or more respective first reliability factors; and

to provide the reliability indication, the one or more processors are configured to provide an indication of one or more most reliable values of the parameter of the environment corresponding to one or more highest reliabilities of the plurality of first reliabilities and the second reliability.

10 . The environment perception system of claim 9 , further comprising one or more transmitters communicatively coupled to the one or more processors, wherein to provide the indication of the one or more most reliable values of the parameter of the environment, the one or more processors are configured to transmit, via the one or more transmitters, a list of most reliable values of the parameter of the environment with indications of relative reliabilities.

11 . An environment perception method comprising:

receiving, at an ego vehicle from a device external to the ego vehicle, a plurality of first reliability factors associated with the device and with a first value of a parameter of an environment containing the ego vehicle;

determining, at the ego vehicle based on the plurality of first reliability factors, a first reliability trust score of the first value of the parameter;

determining, at the ego vehicle based on a plurality of second reliability factors associated with the ego vehicle and with a second value of the parameter of the environment provided by one or more sensors of the ego vehicle, a second reliability trust score of the second value of the parameter of the environment;

providing, by the ego vehicle, a reliability indication indicating which of the first value of the parameter of the environment and the second value of the parameter of the environment is more reliable based on which of the first reliability trust score and the second reliability trust score indicates a higher reliability; and

performing, based on the reliability indication, at least one autonomous driving operation comprising at least one of:

calibrating at least a first one of the one or more sensors using the first value of the parameter of the environment based on the first trust score indicating higher reliability than the second trust score; and

evaluating an environment near the ego vehicle using at least a second one of the one or more sensors without calibrating the second one of the one or more sensors based on the second trust score indicating higher reliability than the first trust score.

12 . The environment perception method of claim 11 , wherein the one or more first reliability factors indicate a type of the device, or a first sensor type, or an age of the device, or an age of a sensor corresponding to the first value of the parameter of the environment, or a distance between the ego vehicle and the device, or a security integrity level of the device, or a safety integrity level of the device, or a software version associated with a sensor of the device, or a mileage of the device, or a combination of any two or more thereof, and wherein the one or more second reliability factors indicate a type of the ego vehicle, or a second sensor type, or an age of the ego vehicle, or an age of a sensor corresponding to the second value of the parameter of the environment, or the distance between the ego vehicle and the device, or a security integrity level of the ego vehicle, or a safety integrity level of the ego vehicle, or a software version associated with one or more of the one or more sensors of the ego vehicle, or a mileage of the ego vehicle, or a combination of any two or more thereof.

13 . The environment perception method of claim 11 , further comprising:

receiving, at the ego vehicle, the first value of the parameter of the environment;

determining, at the ego vehicle based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

determining, at the ego vehicle, a perception of the environment based on the first value of the parameter of the environment and the second value of the parameter of the environment, while giving more weight to the one of the first value of the parameter of the environment and the second value of the parameter of the environment that is more reliable.

14 . The environment perception method of claim 11 , further comprising:

receiving, at the ego vehicle, the first value of the parameter of the environment;

determining, at the ego vehicle based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

calibrating, at the ego vehicle, at least one of the one or more sensors using the first value of the parameter of the environment, based on the reliability indication indicating that the first value of the parameter of the environment is more reliable than the second value of the parameter of the environment.

15 . The environment perception method of claim 14 , wherein the calibrating the at least one of the one or more sensors is further based on the first value of the parameter of the environment differing by less than a threshold amount from the second value of the parameter of the environment.

16 . The environment perception method of claim 11 , further comprising:

receiving, at the ego vehicle, the first value of the parameter of the environment;

determining, at the ego vehicle based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

performing, at the ego vehicle, fault mitigation based on the reliability indication indicating that the first value of the parameter of the environment is more reliable than the second value of the parameter of the environment, and based on the first value of the parameter of the environment differing by more than a threshold amount from the second value of the parameter of the environment.

17 . The environment perception method of claim 16 , wherein performing the fault mitigation comprises performing one of a hierarchy of fault mitigation operations based on availability of a driver or availability of one or more resources of the ego vehicle.

18 . The environment perception method of claim 17 , wherein a highest priority of the hierarchy of fault mitigation operations comprises providing driving control of the ego vehicle to the driver.

19 . The environment perception method of claim 11 , wherein:

receiving the one or more first reliability factors comprises receiving, for each of a plurality of devices external to the ego vehicle, one or more respective first reliability factors;

determining the first reliability comprises determining a plurality of first reliabilities each corresponding to a respective one of the plurality of devices and a respective first value of the parameter of the environment, and each based on the one or more respective first reliability factors; and

providing the reliability indication comprises providing an indication of one or more most reliable values of the parameter of the environment corresponding to one or more highest reliabilities of the plurality of first reliabilities and the second reliability.

20 . The environment perception method of claim 19 , wherein providing the indication of the one or more most reliable values of the parameter of the environment comprises transmitting, from the ego vehicle, a list of most reliable values of the parameter of the environment with indications of relative reliabilities.

21 . An environment perception system, of an ego vehicle, comprising:

means for receiving, from a device external to the ego vehicle, a plurality of first reliability factors associated with the device and with a first value of a parameter of an environment containing the ego vehicle;

means for determining, based on the plurality of first reliability factors, a first reliability trust score of the first value of the parameter;

means for determining, based on a plurality of second reliability factors associated with the ego vehicle and with a second value of the parameter of the environment provided by one or more sensors of the ego vehicle, a second reliability trust score of the second value of the parameter of the environment;

means for providing a reliability indication indicating which of the first value of the parameter of the environment and the second value of the parameter of the environment is more reliable based on which of the first reliability trust score and the second reliability trust score indicates a higher reliability; and

means for performing, based on the reliability indication, at least one autonomous driving operation comprising:

at least one of calibrating at least a first one of the one or more sensors using the first value of the parameter of the environment based on the first trust score indicating higher reliability than the second trust score; and

evaluating an environment near the ego vehicle using at least a second one of the one or more sensors without calibrating the second one of the one or more sensors based on the second trust score indicating higher reliability than the first trust score.

22 . The environment perception system of claim 21 , wherein the one or more first reliability factors indicate a type of the device, or a first sensor type, or an age of the device, or an age of a sensor corresponding to the first value of the parameter of the environment, or a distance between the ego vehicle and the device, or a security integrity level of the device, or a safety integrity level of the device, or a software version associated with a sensor of the device, or a mileage of the device, or a combination of any two or more thereof, and wherein the one or more second reliability factors indicate a type of the ego vehicle, or a second sensor type, or an age of the ego vehicle, or an age of a sensor corresponding to the second value of the parameter of the environment, or the distance between the ego vehicle and the device, or a security integrity level of the ego vehicle, or a safety integrity level of the ego vehicle, or a software version associated with one or more of the one or more sensors of the ego vehicle, or a mileage of the ego vehicle, or a combination of any two or more thereof.

23 . The environment perception system of claim 21 , further comprising:

means for receiving the first value of the parameter of the environment;

means for determining, based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

means for determining a perception of the environment based on the first value of the parameter of the environment and the second value of the parameter of the environment, while giving more weight to the one of the first value of the parameter of the environment and the second value of the parameter of the environment that is more reliable.

24 . The environment perception system of claim 21 , further comprising:

means for receiving the first value of the parameter of the environment;

means for determining, based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

means for calibrating at least one of the one or more sensors using the first value of the parameter of the environment, based on the reliability indication indicating that the first value of the parameter of the environment is more reliable than the second value of the parameter of the environment.

25 . The environment perception system of claim 24 , wherein the means for calibrating the at least one of the one or more sensors are for calibrating the at least one of the one or more sensors based further on the first value of the parameter of the environment differing by less than a threshold amount from the second value of the parameter of the environment.

26 . The environment perception system of claim 21 , further comprising:

means for receiving the first value of the parameter of the environment;

means for determining, based on one or more measurements from the one or more sensors, the second value of the parameter of the environment; and

means for performing fault mitigation based on the reliability indication indicating that the first value of the parameter of the environment is more reliable than the second value of the parameter of the environment, and based on the first value of the parameter of the environment differing by more than a threshold amount from the second value of the parameter of the environment.

27 . The environment perception system of claim 26 , wherein the means for performing the fault mitigation comprise means for performing one of a hierarchy of fault mitigation operations based on availability of a driver or availability of one or more resources of the ego vehicle.

28 . The environment perception system of claim 27 , wherein a highest priority of the hierarchy of fault mitigation operations comprises providing driving control of the ego vehicle to the driver.

29 . The environment perception system of claim 21 , wherein:

the means for receiving the one or more first reliability factors comprise means for receiving, for each of a plurality of devices external to the ego vehicle, one or more respective first reliability factors;

the means for determining the first reliability comprise means for determining a plurality of first reliabilities each corresponding to a respective one of the plurality of devices and a respective first value of the parameter of the environment, and each based on the one or more respective first reliability factors; and

the means for providing the reliability indication comprise means for providing an indication of one or more most reliable values of the parameter of the environment corresponding to one or more highest reliabilities of the plurality of first reliabilities and the second reliability.

30 . A non-transitory, processor-readable storage medium comprising processor-readable instructions to cause one or more processors of an ego vehicle to:

receive, from a device external to the ego vehicle, a plurality of first reliability factors associated with the device and with a first value of a parameter of an environment containing the ego vehicle;

determine, based on the plurality of first reliability factors, a first reliability trust score of the first value of the parameter;

determine, based on a plurality of second reliability factors associated with the ego vehicle and with a second value of the parameter of the environment provided by one or more sensors of the ego vehicle, a second reliability trust score of the second value of the parameter of the environment;

provide a reliability indication indicating which of the first value of the parameter of the environment and the second value of the parameter of the environment is more reliable based on which of the first reliability trust score and the second reliability trust score indicates a higher reliability; and

perform, based on the reliability indication, at least one autonomous driving operation comprising:

at least one of calibrating at least a first one of the one or more sensors using the first value of the parameter of the environment based on the first trust score indicating higher reliability than the second trust score; and

evaluating an environment near the ego vehicle using at least a second one of the one or more sensors without calibrating the second one of the one or more sensors based on the second trust score indicating higher reliability than the first trust score.

Assignments (2)

Continuity (1)

References Cited (22)