IP Library › Granted Patent US 12,259,464
Granted Patent B2
US 12,259,464 · App. 17/658,619 · Granted Mar 25, 2025

Radar map layer in a crowdsourced HD map

Inventors: Mandar Narsinh Kulkarni (South Plainfield, NJ); Jubin Jose (Basking Ridge, NJ); Muryong Kim (Madison, NJ)
Assignee: QUALCOMM Incorporated
G01S13/89G01S13/581G06F18/23G06F18/2433
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,259,464
App. No.
17/658,619
Granted
Mar 25, 2025
Kind
B2
Abstract

Creating and updating an accurate radar map layer for HD map using crowdsourcing may comprise a vehicle obtaining radar data and filtering the radar data on a frame-by-frame basis. In some embodiments, additional filtering may be made on a batch of frames. The vehicle can then transmit the filtered radar data responsive to a determination that a confidence of a position estimate of the vehicle exceeds a conference threshold level and/or a determination that a reliance of the position estimate of the vehicle on the radar data exceeds a reliance threshold level.

Claims (95)

1. A method of obtaining data at a vehicle for a radar layer of a map, the method comprising:

obtaining, with a radar at the vehicle, radar data within a geographical region corresponding to at least a portion of the map, the radar data comprising a plurality of frames;

filtering the radar data to remove data generated by moving objects, wherein filtering the radar data comprises identifying, on a per-frame basis, the data generated by the moving objects using:

a Doppler velocity measured by the radar, and

linear and angular velocities of the vehicle when the radar data was obtained, the linear and angular velocities based on vehicle speed determined from a non-radar source; and

selectively transmitting the filtered radar data from the vehicle to at least one device, wherein the transmitting is responsive to:

(i) a determination that a confidence metric, indicative of a confidence level of a 6-DOF position estimate of the vehicle, exceeds a confidence metric threshold level;

(ii) a determination that a reliance metric, indicative of a reliance level of the 6-DOF position estimate of the vehicle on the radar data, exceeds a reliance metric threshold level; or

a combination thereof.

2. The method of claim 1 , further comprising using a calibration transform to transform the linear and angular velocities of the vehicle to a radar frame.

3. The method of claim 1 , further comprising, prior to obtaining the radar data:

sending a notification from the vehicle to a server, wherein the notification comprises an indication of:

a location of the vehicle, and

a capability of the vehicle for obtaining the radar data; and

subsequent to sending the notification, receiving the radar layer of the map at the vehicle from the server.

4. The method of claim 1 , wherein filtering the radar data further comprises filtering a batch of radar data comprising plurality of frames of the radar data.

5. The method of claim 4 , wherein filtering the batch of radar data is based on a clustering algorithm.

6. The method of claim 4 , wherein filtering the batch of radar data comprises spatially identifying and removing outlier radar detections.

7. The method of claim 4 , wherein filtering the batch of radar data comprises:

performing a matching algorithm to determine a degree of similarity of the batch of radar data with corresponding data from the radar layer; and

including the batch of radar data in the filtered radar data responsive to a determination that the degree of similarity of the batch of radar data with the corresponding data from the radar layer is below a threshold level.

8. The method of claim 1 , wherein filtering the radar data further comprises performing random down sampling of the radar data.

9. The method of claim 1 , wherein the determination that the confidence metric of the 6-DOF position estimate of the vehicle exceeds the confidence metric threshold level is based on a covariance matrix of the 6-DOF position estimate.

10. The method of claim 1 , wherein the determination that the reliance of the 6-DOF position estimate of the vehicle on the radar data exceeds the reliance threshold level comprises determining the vehicle has entered a predetermined geographical area.

11. The method of claim 1 , wherein the at least one device comprises a server, another vehicle, or both.

12. The method of claim 1 , further comprising transmitting meta information associated with the filtered radar data, wherein the meta information comprises a matching metric, a statistic of radar localization success, or a sensor quality, or any combination thereof.

13. The method of claim 1 , wherein the radar data comprises point cloud data, data vectorization, or a combination thereof.

14. The method of claim 1 , further comprising transmitting an indication of the confidence of the 6-DOF position estimate of the vehicle.

15. The method of claim 1 , wherein the map comprises a high definition (HD) map.

16. A radar unit for obtaining data at a vehicle for a radar layer of a map, the radar unit comprising:

a radar;

a memory and

one or more processors communicatively coupled with the radar and the memory, wherein the one or more processors are configured to:

obtain, using the radar, radar data within a geographical region corresponding to at least a portion of the map, the radar data comprising a plurality of frames;

filtering the radar data to remove data generated by moving objects, wherein filtering the radar data comprises identifying, on a per-frame basis, the data generated by the moving objects using:

a Doppler velocity measured by the radar, and

linear and angular velocities of the vehicle when the radar data was obtained, the linear and angular velocities based on vehicle speed determined from a non-radar source; and

selectively transmit the filtered radar data from the vehicle to at least one device, wherein the transmitting is responsive to:

(i) a determination that a confidence metric, indicative of a confidence level of a 6-DOF position estimate of the vehicle, exceeds a confidence metric threshold level;

(ii) a determination that a reliance metric, indicative of a reliance level of the 6-DOF position estimate of the vehicle on the radar data, exceeds a reliance metric threshold level; or

a combination thereof.

17. The radar unit of claim 16 , wherein, to filter the radar data on a frame-by-frame basis, the one or more processors are further configured to use a calibration transform to transform the linear and angular velocities of the vehicle to a radar frame.

18. The radar unit of claim 16 , wherein the one or more processors are further configured to, prior to obtaining the radar data:

send a notification from the vehicle to a server, wherein the notification comprises an indication of:

a location of the vehicle, and

a capability of the vehicle for obtaining the radar data; and

subsequent to sending the notification, receive the radar layer of the map at the vehicle from the server.

19. The radar unit of claim 16 , wherein, to filter the radar data, the one or more processors are configured to filter a batch of radar data comprising plurality of frames of the radar data.

20. The radar unit of claim 19 , wherein the one or more processors are configured to filter the batch of radar data based on a clustering algorithm.

21. The radar unit of claim 19 , wherein, to filter the batch of radar data, the one or more processors are configured to spatially identify and remove outlier radar detections.

22. The radar unit of claim 19 , wherein, to filter the batch of radar data, the one or more processors are configured to:

perform a matching algorithm to determine a degree of similarity of the batch of radar data with corresponding data from the radar layer; and

include the batch of radar data in the filtered radar data responsive to a determination that the degree of similarity of the batch of radar data with the corresponding data from the radar layer is below a threshold level.

23. The radar unit of claim 16 , wherein, to filter the radar data, the one or more processors are configured to perform random down sampling of the radar data.

24. The radar unit of claim 16 , wherein the one or more processors are configured to determine that the confidence metric of the 6-DOF position estimate of the vehicle exceeds the confidence metric threshold level based on a covariance matrix of the 6-DOF position estimate.

25. The radar unit of claim 16 , wherein, to determine that the reliance of the 6-DOF position estimate of the vehicle on the radar data exceeds the reliance threshold level, the one or more processors are configured to determine the vehicle has entered a predetermined geographical area.

26. The radar unit of claim 16 , wherein, to transmit the filtered radar data to the at least one device, the one or more processors are configured to send the filtered radar data to a server, another vehicle, or both.

27. The radar unit of claim 16 , wherein the one or more processors are further configured to transmit meta information associated with the filtered radar data, wherein the meta information comprises a matching score, a statistic of radar localization success, or a sensor quality, or any combination thereof.

28. The radar unit of claim 16 , wherein, to obtain the radar data, the one or more processors are configured to obtain point cloud data, data vectorization, or a combination thereof.

29. The radar unit of claim 16 , wherein the one or more processors are further configured to transmit an indication of the confidence of the 6-DOF position estimate of the vehicle.

30. An apparatus for obtaining data at a vehicle for a radar layer of a map, the apparatus comprising:

means for obtaining, at the vehicle, radar data within a geographical region corresponding to at least a portion of the map, the radar data comprising a plurality of frames;

means for filtering the radar data to remove data generated by moving objects, wherein filtering the radar data comprises identifying, on a per-frame basis, the data generated by the moving objects using:

a Doppler velocity measured by the radar, and

linear and angular velocities of the vehicle when the radar data was obtained, the linear and angular velocities based on vehicle speed determined from a non-radar source; and

means for selectively transmitting the filtered radar data from the vehicle to at least one device, wherein the transmitting is responsive to:

(i) a determination that a confidence metric, indicative of a confidence level of a 6-DOF position estimate of the vehicle, exceeds a confidence metric threshold level;

(ii) a determination that a reliance metric, indicative of a reliance level of the 6-DOF position estimate of the vehicle on the radar data, exceeds a reliance metric threshold level; or

a combination thereof.

31. The apparatus of claim 30 , wherein the means for filtering the radar data on a frame-by-frame basis comprise means for using a calibration transform to transform the linear and angular velocities of the vehicle to a radar frame.

32. The apparatus of claim 30 , further comprising:

means for sending, prior to obtaining the radar data, a notification from the vehicle to a server, wherein the notification comprises an indication of:

a location of the vehicle, and

a capability of the vehicle for obtaining the radar data; and

means for receiving, subsequent to sending the notification and prior to obtaining the radar data, the radar layer of the map at the vehicle from the server.

33. The apparatus of claim 30 , wherein the means for filtering the radar data further comprises means for filtering a batch of radar data comprising plurality of frames of the radar data.

34. The apparatus of claim 30 , wherein the means for filtering the radar data further comprises means for performing random down sampling of the radar data.

35. The apparatus of claim 30 , further comprising means for determining the vehicle has entered a predetermined geographical area.

36. The apparatus of claim 30 , wherein the means for selectively transmitting the filtered radar data to the at least one device comprises means for sending the filtered radar data to a server, another vehicle, or both.

37. The apparatus of claim 30 , further comprising means for transmitting meta information associated with the filtered radar data, wherein the meta information comprises a matching score, a statistic of radar localization success, or a sensor quality, or any combination thereof.

38. The apparatus of claim 30 , further comprising means for transmitting an indication of the confidence of the 6-DOF position estimate of the vehicle.

39. A non-transitory computer-readable medium storing instructions for obtaining data at a vehicle for a radar layer of an map, the instructions comprising code for:

obtaining, with a radar at the vehicle, radar data within a geographical region corresponding to at least a portion of the map, the radar data comprising a plurality of frames;

filtering the radar data to remove data generated by moving objects, wherein filtering the radar data comprises identifying, on a per-frame basis, the data generated by the moving objects using:

a Doppler velocity measured by the radar, and linear and angular velocities of the vehicle when the radar data was obtained, the linear and angular velocities based on vehicle speed determined from a non-radar source; and

selectively transmitting the filtered radar data from the vehicle to at least one device, wherein the transmitting is responsive to:

(i) a determination that a confidence metric, indicative of a confidence level of a 6-DOF position estimate of the vehicle, exceeds a confidence metric threshold level;

(ii) a determination that a reliance metric, indicative of a reliance level of the 6-DOF position estimate of the vehicle on the radar data, exceeds a reliance metric threshold level; or

a combination thereof.

40. The computer-readable medium of claim 39 , wherein the instructions further comprise code for, prior to obtaining the radar data:

sending a notification from the vehicle to a server, wherein the notification comprises an indication of:

a location of the vehicle, and

a capability of the vehicle for obtaining the radar data; and

subsequent to sending the notification, receiving the radar layer of the map at the vehicle from the server.

41. The computer-readable medium of claim 39 , wherein the code for filtering the radar data comprises code for filtering a batch of radar data comprising plurality of frames of the radar data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2022
From: KULKARNI, MANDAR NARSINH; JOSE, JUBIN; KIM, MURYONG
To: QUALCOMM INCORPORATED
Reel/Frame 059796/0889 →
Continuity (1)
Related Publication 20230324543A1 · Oct 12, 2023
References Cited (19)
US 20200081134A1 · Wheeler et al. · 2020 [cited by applicant]
US 20200245115A1 · Dorrance · 2020 [cited by examiner]
US 20200278217A1 · Ahmad et al. · 2020 [cited by applicant]
US 20200370920A1 · Ahmed · 2020 [cited by examiner]
US 20210063200A1 · Kroepfl · 2021 [cited by examiner]
US 20210190537A1 · Gustafsson et al. · 2021 [cited by applicant]
US 20210278523A1 · Urtasun et al. · 2021 [cited by applicant]
US 20220277472A1 · Birchfield · 2022 [cited by examiner]
US 20230184932A1 · Leßmann · 2023 [cited by examiner]
US 20230296756A1 · Akbarzadeh · 2023 [cited by examiner]
CN 112092803A · 2020 [cited by applicant]
EP 3637391A1 · 2020 [cited by applicant]
Costa C.M., et al., “Robust 3/6 DoF Self-localization System with Selective Map Update for Mobile Robot Platforms”, Robotics and Autonomous Systems, vol. 76, Oct. 8, 2015, pp. 1-24, XP029377882, ISSN: 0921-8890, DOI: 10… [cited by applicant]
Partial International Search Report—PCT/US2023/060908—ISA/EPO—May 10, 2023. [cited by applicant]
Schumann O., et al., “Scene Understanding With Automotive Radar”, IEEE Transactions on Intelligent Vehicles, IEEE, vol. 5, No. 2, Nov. 25, 2019, pp. 1-16, XP011790609, ISSN: 2379-8858, DOI: 10.1109/TIV.2019.2955853, p. … [cited by applicant]
Ward E., et al., “Vehicle Localization with Low Cost Radar Sensors”, IEEE Intelligent Vehicles Symposium, Jun. 19, 2016, pp. 864-870, p. 867, Paragraph III.B. [cited by applicant]
Huang R., et al., “A High-Precision and Robust Odometry Based on Sparse MMW Radar Data and A Large-range and Long-Distance Radar Positioning Data Set”, 2021 IEEE International Intelligent Transportation Systems Conferen… [cited by applicant]
International Search Report and Written Opinion—PCT/US2023/060908—ISA/EPO—Aug. 9, 2023. [cited by applicant]
Ma Y., et al., “Range Sensor Aided Inertial Navigation Using Cross Correlation on the Evidence Grid”, Position Location and Navigation Symposium (PLANS), 2012 IEEE/ION, Apr. 23, 2012, XP032200260, pp. 422-427, Abstract. [cited by applicant]
Cited By (1)
US 12,704,646