IP Library Granted Patent US 12,372,611
Granted Patent B2
US 12,372,611 · App. 17/704,693 · Granted Jul 29, 2025

Sensor calibration method and apparatus

Inventors: Bin Hu (Shanghai, CN); Zhenmei Wan (Shenzhen, CN); Jing Yang (Shanghai, CN)
Assignee: SHENZHEN YINWANG INTELLIGENT TECHNOLOGIES CO., LTD.
G01S7/40G01S13/867G01S13/931H04N17/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,372,611
App. No.
17/704,693
Granted
Jul 29, 2025
Kind
B2
Abstract

A sensor calibration method includes: location information of a target detected by a radar is matched against map information to determine a calibration value of the radar, and then location information of a pixel of a target corresponding to the camera in a global coordinate system is determined based on calibrated radar measurement data so as to further determine a calibration value of the camera. In this way, for a roadside sensing system that includes the single radar and the single camera, manual field calibration is no longer required.

Claims (74)

1. A sensor calibration method, comprising:

obtaining first radar measurement data of a first target;

determining a first slope of a fitting straight line track of the first target based on the first radar measurement data;

determining, based on map information, a second slope of a first road reference target in a world coordinate system;

determining a first calibration value of a radar sensor based on the first slope and the second slope;

determining first radar calibration measurement data of a second target based on second radar measurement data of the second target and the first calibration value, wherein location information of the second target in a world coordinate system is based on the first radar calibration measurement data;

obtaining first camera measurement data of the second target; and

determining a second calibration value of a camera sensor based on the location information and the first camera measurement data.

2. The sensor calibration method of claim 1 , wherein the first road reference target corresponds to the fitting straight line track.

3. The sensor calibration method of claim 2 , wherein determining the second calibration value comprises:

obtaining h pieces of the first radar calibration measurement data corresponding to h second targets and h pieces of the first camera measurement data of the h second targets, wherein the h pieces of the first camera measurement data are the same, and wherein the h is an integer greater than or equal to 2;

determining h pieces of location information of the h second targets in the world coordinate system based on the h pieces of the first radar calibration measurement data;

determining an average value of the h pieces of location information; and

determining the second calibration value based on the average value of the h pieces of location information and the h pieces of the first camera measurement data.

4. The sensor calibration method of claim 1 , wherein determining the first calibration value comprises:

obtaining first radar measurement values corresponding to k first targets, wherein the k first targets correspond to a first road reference target in the map information, and wherein k is an integer greater than or equal to 2;

determining, based on the first radar measurement values, k fitting straight line tracks corresponding to the k first targets;

determining an average value of k first slopes corresponding to the k fitting straight line tracks;

determining a second slope of the first road reference target in a world coordinate system based on the map information; and

determining the first calibration value based on the average value.

5. The sensor calibration method of claim 1 , wherein determining the second calibration value comprises:

obtaining h pieces of the first radar calibration measurement data corresponding to h second targets and h pieces of the first camera measurement data of the h second targets, wherein the h pieces of the first camera measurement data are the same, and wherein the h is an integer greater than or equal to 2;

determining h pieces of location information of the h second targets in a world coordinate system based on the h pieces of the first radar calibration measurement data;

determining an average value of the h pieces of location information; and

determining the second calibration value based on the average value and the h pieces of the first camera measurement data.

6. The sensor calibration method of claim 1 , wherein obtaining the first radar measurement data comprises:

obtaining travelling data of the first target from the camera sensor; and

searching radar measurement data collected by the radar sensor for the first radar measurement data that matches the travelling data.

7. The sensor calibration method of claim 1 , further comprising calibrating a measurement parameter of the camera sensor based on the second calibration value.

8. A sensor calibration apparatus, comprising:

a memory configured to store instructions; and

one or more processors coupled to the memory and configured to execute the instructions to cause the sensor calibration apparatus to:

obtain first radar measurement data of a first target;

determine a first slope of a fitting straight line track of the first target based on the first radar measurement data;

determine, based on map information, a second slope of a first road reference target in a world coordinate system;

determine a first calibration value of a radar sensor based on the first slope and the second slope;

determine first radar calibration measurement data of a second target based on second radar measurement data of the second target and the first calibration value, wherein location information of the second target in a world coordinate system based on the first radar calibration measurement data;

obtain first camera measurement data of the second target; and

determine a second calibration value of a camera sensor based on the location information and the first camera measurement data.

9. The sensor calibration apparatus of claim 8 , wherein the first road reference target corresponds to the fitting straight line track.

10. The sensor calibration apparatus of claim 9 , wherein when executed by the one or more processors, the instructions are further configured to cause the sensor calibration apparatus to:

obtain h pieces of the first radar calibration measurement data corresponding to h second targets and h pieces of the first camera measurement data of the h second targets, wherein the h pieces of the first camera measurement data are the same, and wherein the h is an integer greater than or equal to 2;

determine h pieces of location information of the h second targets in the world coordinate system based on the h pieces of the first radar calibration measurement data;

determine an average value of the h pieces of location information; and

further determine the second calibration value of the camera sensor based on the average value and the h pieces of the first camera measurement data.

11. The sensor calibration apparatus of claim 8 , wherein when executed by the one or more processors, the instructions are further configured to cause the sensor calibration apparatus to:

obtain first radar measurement values corresponding to k first targets, wherein the k first targets correspond to a first road reference target in the map information, and wherein k is an integer greater than or equal to 2;

determine, based on the first radar measurement values, k fitting straight line tracks corresponding to the k first targets;

determine an average value of k first slopes corresponding to the k fitting straight line tracks;

determine a second slope of the first road reference target in a world coordinate system based on the map information; and

further determine the first calibration value based on the average value.

12. The sensor calibration apparatus of claim 8 , wherein when executed by the one or more processors, the instructions are further configured to cause the sensor calibration apparatus to:

obtain h pieces of the first radar calibration measurement data corresponding to h second targets and h pieces of the first camera measurement data of the h second targets, wherein the h pieces of the first camera measurement data are the same, and wherein the h is an integer greater than or equal to 2;

determine h pieces of location information of the h second targets in a world coordinate system based on the h pieces of the first radar calibration measurement data;

determine an average value of the h pieces of location information; and

further determine the second calibration value based on the average value and the h pieces of the first camera measurement data.

13. The sensor calibration apparatus of claim 8 , wherein when executed by the one or more processors, the instructions are further configured to cause the sensor calibration apparatus to:

obtain travelling data of the first target from the camera sensor; and

search radar measurement data collected by the radar sensor for the first radar measurement data that matches the travelling data.

14. A sensor calibration apparatus, comprising:

a memory configured to store instructions; and

one or more processors coupled to the memory and configured to execute the instructions to cause the sensor calibration apparatus to:

receive a first calibration value of a camera sensor from a fusion processor, wherein the first calibration value is based on first radar calibration measurement data of a second target and first camera measurement data of the second target, wherein location information of the second target in a world coordinate system is based on the first radar calibration measurement data, wherein the first radar calibration measurement data is based on first radar measurement data of the second target and a second calibration value of a radar sensor, wherein the second calibration value is based on a first slope of a fitting straight line track of a first target and a second slope of a first road reference target in the world coordinate system, wherein the fitting straight line track is based on the first camera measurement data, and wherein the second slope is based on map information; and

calibrate a measurement parameter of the camera sensor based on the first calibration value.

15. The sensor calibration apparatus of claim 14 , wherein when executed by the one or more processors, the instructions further cause the sensor calibration apparatus to:

obtain second camera measurement data of a plurality of targets;

determine, from the plurality of targets based on the second camera measurement data, a third target that meets a preset reporting condition;

obtain travelling data of the first target, wherein the travelling data indicates to the fusion processor to search second radar measurement data from the radar sensor for third radar measurement data that is of the first target and that matches the travelling data; and

send the travelling data to the fusion processor.

16. The sensor calibration apparatus of claim 14 , wherein the camera sensor is a monocular camera, and wherein the radar sensor comprises a millimeter wave radar.

17. The sensor calibration apparatus of claim 14 , wherein when executed by the one or more processors, the instructions further cause the sensor calibration apparatus to receive the second calibration value of the radar sensor from the fusion processor.

18. The sensor calibration apparatus of claim 14 , wherein the radar sensor and the camera sensor are disposed on a roadside.

19. The sensor calibration apparatus of claim 14 , wherein the fusion processor is disposed on a roadside.

20. The sensor calibration apparatus of claim 14 , wherein the fusion processor is disposed in the cloud.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2024
From: HUAWEI TECHNOLOGIES CO., LTD.
To: SHENZHEN YINWANG INTELLIGENT TECHNOLOGIES CO., LTD.
Reel/Frame 069335/0922 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2024
From: HU, BIN; WAN, ZHENMEI; YANG, JING
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 069203/0263 →