IP Library Granted Patent US 11,415,687
Granted Patent B2
US 11,415,687 · App. 16/407,065 · Granted Aug 16, 2022

System and method for determining whether to perform sensor calibration while minimizing system load

Inventors: Pingfan Meng (Dublin, CA); Zhenhao Pan (Sunnyvale, CA)
Assignee: Pony AI Inc.
G01S7/4972G01S7/40G01S7/52004H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,415,687
App. No.
16/407,065
Granted
Aug 16, 2022
Kind
B2
Abstract

Provided herein is a system and method for calibrating sensors. The system comprises a sensor to capture first data, an analysis engine to determine whether the sensor is to be calibrated, and a communication engine to transmit the first data from the sensor to the analysis engine and transmit information to an error handling module that the sensor is to be calibrated, in response to a determination that the sensor is to be calibrated. The determining is based on a result from a first validation of the first data, which is based on a known parameter of the sensor or historical data.

Claims (39)

1. A sensor system comprising:

a first sensor configured to capture first data, wherein the first data comprises one or more first features extracted from a first image; and

one or more processors configured to:

conduct a first validation of the first data based on historical data, wherein the historical data comprises one or more second features extracted from a second image, the second image comprising a previously taken image, the first validation comprising:

determining a parameter of the first sensor from the first data;

determining that a difference between the determined parameter and a known parameter is between a first threshold and a second threshold;

determining a proportion of the one or more second features of the historical data that matches the one or more first features of the first data; and

obtaining a result from the first validation indicating whether the proportion is less than a third threshold;

in response to the proportion being less than the first threshold, determine to conduct a further validation to determine whether the sensor is to be calibrated, the further validation being based on the first validation or a second validation, the second validation being based on second data captured at a different time or from a second sensor; and

based on the result from the first validation of the first data or from the further validation, determine whether the first sensor is to be calibrated.

2. The system of claim 1 , wherein, the one or more processors are configured to:

in response to determining to conduct the further validation, select between the first validation and the second validation based on a comparison of a computation load requirement of the first validation and a computation load requirement of the second validation.

3. The system of claim 1 , wherein the one or more processors are further configured to:

determine whether the historical data is stored in a memory, and

in response to the historical data being determined to not be stored in the memory, upload map data, the map data being indicative of the historical data.

4. The system of claim 1 , wherein the first validation further comprises:

determining a parameter of the sensor from the first data,

determining a difference between the determined parameter and the known parameter, and

in response to the difference exceeding a second threshold, determining that the sensor is to be calibrated.

5. The system of claim 4 , wherein the one or more processors are further configured to adjust the second threshold by a compensation factor based on a time of day, an amount of ambient light, or an environment condition.

6. The system of claim 1 , wherein the historical data is obtained from a lookup table, wherein each entry of the lookup table comprises an image or a feature from the image of the historical data, based on a time of day or an amount of ambient light.

7. The system of claim 1 , wherein the one or more processors are further configured to adjust a frequency of the first validation based on a computation load requirement of the first validation, an amount of availability of a computation load of the system, a history of the sensor, a density of moving objects detected, a weather condition, or an environment condition.

8. A method of validating a sensor, comprising:

capturing first data, wherein the first data comprises one or more first features extracted from a first image;

conducting a first validation of the first data based on historical data, wherein the historical data comprises one or more second features extracted from a second image, the second image comprising a previously taken image, the first validation comprising:

determining a parameter of the first sensor from the first data;

determining that a difference between the determined parameter and a known parameter is between a first threshold and a second threshold;

determining a proportion of the one or more second features of the historical data that matches the one or more first features of the first data; and

obtaining a result from the first validation indicating whether the proportion is less than a third threshold;

in response to the proportion being less than the first threshold, determining to conduct a further validation to determine whether the sensor is to be calibrated, the further validation being based on the first validation or a second validation, the second validation being based on second data captured at a different time or from a second sensor; and

determining whether the sensor is to be calibrated based on the result from the first validation of the first data or from the further validation.

9. The method of claim 8 , further comprising, in response to determining to conduct the further validation, selecting between the first validation and the second validation based on a comparison of a computation load requirement of the first validation and a computation load requirement of the second validation.

10. The method of claim 8 , further comprising determining whether the historical data is stored in a memory, and

in response to the historical data being determined to not be stored in the memory, uploading map data, the map data being indicative of the historical data.

11. The method of claim 8 , wherein the first validation comprises:

determining a parameter of the sensor from the first data,

determining a difference between the determined parameter and the known parameter, and

in response to the difference exceeding a second threshold, determining that the sensor is to be calibrated.

12. The method of claim 11 , further comprising adjusting the second threshold by a compensation factor based on a time of day, an amount of ambient light, or an environment condition.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2019
From: PONY.AI, INC.
To: PONY AI INC.
Reel/Frame 049434/0372 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2019
From: MENG, PINGFAN; PAN, ZHENHAO
To: PONY.AI, INC.
Reel/Frame 049120/0492 →
Continuity (1)
Related Publication 20200355811A1 · Nov 12, 2020