IP Library Granted Patent US 11,372,406
Granted Patent B2
US 11,372,406 · App. 16/706,990 · Granted Jun 28, 2022

System and method for collaborative sensor calibration

Inventor: Ankur Agarwal (Cupertino, CA)
Assignee: PlusAI, Inc.
G05D1/0088G05D1/0231G05D1/0257G05D1/0268G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,372,406
App. No.
16/706,990
Granted
Jun 28, 2022
Kind
B2
Abstract

The present teaching relates to method, system, medium, and implementations for sensor calibration. An ego vehicle determines whether a sensor deployed on the ego vehicle to facilitate autonomous driving of the ego vehicle needs to be calibrated and sends, if it is determined that the sensor needs to be calibrated, a request for assistance in collaborative calibration of the sensor, with a first position of the ego vehicle or a first configuration of the sensor with respect to the ego vehicle. When a response of the request is received, an assisting vehicle is indicated to travel to be near the ego vehicle to facilitate the calibration of the sensor by collaborating with the moving ego vehicle and the ego vehicle coordinates with the assisting vehicle to enable the sensor to acquire information of a target present on the assisting vehicle for the collaborative calibration of the sensor.

Claims (50)

1. A method implemented on at least one machine including at least one processor, memory, and communication platform capable of connecting to a network for sensor calibration, the method comprising:

determining, by an ego vehicle in motion, whether a sensor deployed on the ego vehicle to facilitate autonomous driving of the ego vehicle needs to be calibrated;

sending, if it is determined that the sensor needs to be calibrated, a request for assistance in collaborative calibration of the sensor, the request including at least one of a first position of the ego vehicle and a first configuration of the sensor with respect to the ego vehicle;

receiving, at the ego vehicle, a response to the request indicative of an assisting vehicle that is to travel to be near the ego vehicle to facilitate the collaborative calibration of the sensor by collaborating with the ego vehicle in motion; and

coordinating, with the assisting vehicle in motion, to enable the sensor to acquire information of a target present on the assisting vehicle in motion for the collaborative calibration, the acquired information of the target from the assisting vehicle being used to calibrate the sensor.

2. The method of claim 1 , wherein the step of determining is based on at least one of:

sensor information acquired by the sensor from a surrounding of the ego vehicle;

a pose of the sensor; and

a schedule specifying an interval by which the sensor is to be calibrated.

3. The method of claim 2 , wherein the interval specified by the schedule is one of a static interval, a dynamic interval, an adaptive interval, and a combination thereof.

4. The method of claim 1 , wherein the assisting vehicle is a member of a fleet that the ego vehicle belongs to as a member.

5. The method of claim 1 , wherein the assisting vehicle is determined based on the first position of the ego vehicle.

6. The method of claim 5 , wherein the assisting vehicle is to travel to a second position determined based on the first position, the first configuration, and a second configuration associated with the target with respect to the assisting vehicle.

7. The method of claim 1 , wherein the request is

sent to a management center to locate the assisting vehicle of a plurality of moving vehicles monitored by the management center; or

broadcast to one or more moving vehicles from the plurality of moving vehicles to request the assistance in collaborative calibration.

8. Machine readable non-transitory medium having information recorded thereon for sensor calibration, wherein the information, when read by the machine, causes the machine to perform:

determining, by an ego vehicle in motion, whether a sensor deployed on the ego vehicle to facilitate autonomous driving of the ego vehicle needs to be calibrated;

sending, if it is determined that the sensor needs to be calibrated, a request for assistance in collaborative calibration of the sensor, the request including at least one of a first position of the ego vehicle and a first configuration of the sensor with respect to the ego vehicle;

receiving, at the ego vehicle, a response to the request indicative of an assisting vehicle that is to travel to be near the ego vehicle to facilitate the collaborative calibration of the sensor by collaborating with the ego vehicle in motion; and

coordinating, with the assisting vehicle, to enable the sensor to acquire information of a target present on the assisting vehicle in motion for the collaborative calibration, the acquired information of the target on the assisting vehicle being used to calibrate the sensor.

9. The medium of claim 8 , wherein the step of determining is based on at least one of:

sensor information acquired by the sensor from a surrounding of the ego vehicle;

a pose of the sensor; and

a schedule specifying an interval by which the sensor is to be calibrated.

10. The medium of claim 9 , wherein the interval specified by the schedule is one of a static interval, a dynamic interval, an adaptive interval, and a combination thereof.

11. The medium of claim 8 , wherein the assisting vehicle is a member of a fleet that the ego vehicle belongs to as a member.

12. The medium of claim 8 , wherein the assisting vehicle is determined based on the first position of the ego vehicle.

13. The medium of claim 12 , wherein the assisting vehicle is to travel to a second position determined based on the first position, the first configuration, and a second configuration associated with the target with respect to the assisting vehicle.

14. The medium of claim 8 , wherein the request is

sent to a management center to locate the assisting vehicle of a plurality of moving vehicles monitored by the management center; or

broadcast to one or more moving vehicles from the plurality of moving vehicles to request assistance in collaborative calibration.

15. A system for sensor calibration, comprising:

a memory; and

a processor operatively coupled to the memory and configured to be disposed on a moving ego vehicle, the processor configured to:

determine whether a sensor deployed on the moving ego vehicle to facilitate autonomous driving of the moving ego vehicle needs to be calibrated;

send, if it is determined that the sensor needs to be calibrated, a request for assistance in collaborative calibration of the sensor, the request including at least one of a first position of the moving ego vehicle and a first configuration of the sensor with respect to the moving ego vehicle, and

receive a response to the request indicative of an assisting vehicle that is to travel to be near the moving ego vehicle to facilitate the collaborative calibration of the sensor by collaborating with the moving ego vehicle; and

coordinate with the assisting vehicle in motion to enable the sensor to acquire information of a target present on the assisting vehicle in motion for the collaborative calibration, the acquired information of the target from the assisting vehicle being used to calibrate the sensor.

16. The system of claim 15 , wherein the step of determining is based on at least one of:

sensor information acquired by the sensor from a surrounding of the moving ego vehicle;

a pose of the sensor; and

a schedule specifying an interval by which the sensor is to be calibrated.

17. The system of claim 16 , wherein the interval specified by the schedule is one of a static interval, a dynamic interval, an adaptive interval, and a combination thereof.

18. The system of claim 15 , wherein the assisting vehicle is a member of a fleet that the ego vehicle belongs to as a member.

19. The system of claim 15 , wherein the assisting vehicle is determined based on the first position of the moving ego vehicle.

20. The system of claim 19 , wherein the assisting vehicle is to travel to a second position determined based on the first position, the first configuration, and a second configuration associated with the target with respect to the assisting vehicle.

21. The system of claim 15 , wherein the request is

sent to a management center to locate the assisting vehicle of a plurality of moving vehicles monitored by the management center; or

broadcast to one or more moving vehicles from the plurality of moving vehicles to request assistance in collaborative calibration.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2021
From: PLUSAI LIMITED
To: PLUSAI, INC.
Reel/Frame 056909/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2021
From: PLUSAI CORP
To: PLUSAI LIMITED
Reel/Frame 055442/0650 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2019
From: AGARWAL, ANKUR
To: PLUSAI CORP
Reel/Frame 051265/0442 →
Continuity (1)
Related Publication 20210173394A1 · Jun 10, 2021
Cited By (3)
US 12,416,731 US 12,633,219 US 12,664,893