IP Library Granted Patent US 12,298,141
Granted Patent B2
US 12,298,141 · App. 18/135,573 · Granted May 13, 2025

Efficient map matching method for autonomous driving and apparatus thereof

Inventor: Gyumin Oh (Seoul, KR)
Assignee: THORDRIVE CO., LTD
G01C21/32G01C21/005G05D1/0214G05D1/0251G05D1/0274G06V20/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,298,141
App. No.
18/135,573
Granted
May 13, 2025
Kind
B2
Abstract

A map matching method for autonomous driving includes extracting a first statistical map from 3D points contained in 3D map data; extracting a second statistical map from 3D points of surroundings which are obtained by a detection sensor simultaneously or after the previous extracting of the statistical map; dividing the second statistical map into a vertical-object part and a horizontal-object part; and performing map matching using the horizontal-object part and/or the vertical-object part and the first statistical map.

Claims (40)

1. An autonomous driving apparatus, the apparatus comprises:

a detection sensor;

a memory; and

one or more processors in communication with the memory,

wherein the one or more processors are configured to:

extract a first statistical map from points of map data;

obtain points from the detection sensor;

extract a second statistical map from the points obtained by the detection sensor;

divide the second statistical map into a vertical-object part and a horizontal-object part depending on statistical values of respective divided regions of the second statistical map;

estimate a pose of the autonomous driving apparatus by comparing the horizontal-object part or the vertical-object part with the first statistical map; and

perform autonomous driving based on the estimated pose,

wherein regions of the statistical maps that have statistical values larger than a predetermined value are extracted as the vertical-object part, and regions of the statistical maps that have statistical values smaller than the predetermined value are extracted as the horizontal-object part.

2. The apparatus of claim 1 , comprising the detection sensor.

3. The apparatus of claim 1 , comprising the autonomous driving apparatus.

4. The apparatus of claim 1 , wherein the statistical values of respective divided regions of the second statistical map comprises at least one of a mean, a mode, a maximum, a median, a minimum, a range, an interquartile range, a quartile deviation, a variance, a standard deviation, a coefficient of variation, and a covariance.

5. The apparatus of claim 1 , in the first and second statistical maps, a 3D space is divided in accordance with a predetermined rule, and one or more statistical values of 3D points contained in a divided region represent the 3D points in the divided region.

6. The apparatus of claim 5 , wherein in the first and second statistical maps, the 3D space is divided with respect to a 2D plane and one or more statistical values of the remaining dimension of 3D points contained in the divided region are calculated and are represented on the 2D plane.

7. The apparatus of claim 6 , wherein, in the first and second statistical maps, an (x, y) plane is divided into evenly spaced grids in the Cartesian coordinate system, and one or more statistical values of height z values of 3D points corresponding to the respective grids are represented on the (x, y) plane.

8. The apparatus of claim 6 , wherein, in the first and second statistical maps, statistical values of height z values corresponding to regions formed by dividing r and θ of an (r, θ) plane evenly in the cylindrical coordinate system are represented on the (r, θ) plane.

9. The apparatus of claim 6 , wherein, in the first and second statistical maps, statistical values of respective θ values of 3D points corresponding to regions formed by dividing r and ϕ of an (r, ϕ) plane evenly in the spherical coordinate system are represented on the (r, ϕ) plane.

10. The apparatus of claim 5 , wherein the one or more processors are configured to detect whether 3D points contained in each divided region are separated into two or more groups in the statistical maps.

11. The apparatus of claim 10 , wherein the one or more processors are configured to, responsive to detecting the two or more separated groups of 3D points in a divided region, device the divided region again such that each one of divided regions contains one group of 3D points only.

12. The apparatus of claim 1 , wherein the one or more processors are configured to perform the map matching based on a location of the autonomous driving apparatus which is estimated using data obtained by a motion sensor.

13. The apparatus of claim 1 , wherein in the estimating a pose of the autonomous driving apparatus, the first statistical map is compared with the vertical-object part or the horizontal-object part, based on each points located in a search range, and the position having a highest mutual similarity is estimated as a result, wherein the position having the highest mutual similarity refers to having the lowest error between the first statistical map and the vertical-object part or the horizontal-object part.

14. The apparatus of claim 1 ,

wherein in the estimating a pose of the autonomous driving apparatus, a map matching is performed using the first statistical map and the vertical-object part, and by using the result thereof, a final map matching is performed using the first statistical map and the horizontal-object part, or

wherein in the estimating a pose of the autonomous driving apparatus, a map matching is performed using the first statistical map and the horizontal-object part, and by using the result thereof, a final map matching is performed using the first statistical map and the vertical-object part.

15. The apparatus of claim 14 ,

wherein the map matching using the vertical-object part is performed with respect to (x, y, h) or a part thereof, and the map matching using the horizontal-object part is performed with respect to (z, h, r, p) or a part thereof, or

wherein in the estimating a pose of the autonomous driving apparatus, a map matching with respect to (h, r, p) is performed using the first statistical map and the horizontal-object part to store values of (r′, p′) which minimize errors with respect to the respective h values, and a map matching with respect to (x, y, h) is performed using the first statistical map and the vertical-object part to perform a map matching with respect to (x, y, h, r′, p′) using the values of (r′, p′) with respect to the respective h values stored in advance.

16. The apparatus of claim 1 , wherein in the estimating a pose of the autonomous driving apparatus, after a map matching performed using the first statistical map and the horizontal-object part and a map matching performed using the first statistical map and the vertical-object part, the two map matching results are combined to obtain a final map matching result.

17. The apparatus of claim 16 , wherein in the estimating a pose of the autonomous driving apparatus, a map matching with respect to (x, y, h) is performed using the first statistical map and the vertical-object part to calculate the value of (x′, y′, h′) which minimize errors, and a map matching of the first statistical map and the horizontal-object part with respect to (r, p, h) is performed to store values of (r, p) which minimize errors with respect to the respective h values, and (x′, y′, h′, r′, p′) is estimated as a final position by using (r′, p′) corresponding to h′.

18. The apparatus of claim 1 , wherein the one or more processors are further configured to:

acquire coordinates of surrounding objects around the autonomous driving apparatus;

identify a temporary object by comparing positions corresponding to the coordinates of the surrounding objects in the map data in order to identify a part corresponding to the temporary object; and

remove a part corresponding to the temporary object.

19. The apparatus of claim 18 , wherein the acquiring of the coordinates of the surrounding objects around the autonomous driving apparatus further comprises:

grouping the points indicating the same object of the points input from the detection sensor, and

acquiring the coordinate of the region that the same object of the grouped points occupies.

20. The apparatus of claim 18 , wherein in the identifying of the temporary object by comparing the positions corresponding to the coordinates of the surrounding objects in the map data, a spatial feature of the corresponding coordinates is found using statistical values corresponding to the coordinates of the surrounding objects in the first statistical map, and presence of a temporary object at the corresponding coordinates is identified based on the spatial feature.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2024
From: THORDRIVE, INC.
To: THORDRIVE CO., LTD
Reel/Frame 067955/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2023
From: OH, GYUMIN
To: THORDRIVE, INC.
Reel/Frame 063360/0425 →
Priority Claims (1)
KR 10-2019-0166900 · Dec 13, 2019 · national
Continuity (2)
Continuation 16830867 · Mar 26, 2020
Related Publication 20230251097A1 · Aug 10, 2023
References Cited (28)
US 9255805B1 · Ferguson et al. · 2016 [cited by applicant]
US 10203696B2 · Ferguson et al. · 2019 [cited by applicant]
US 20180188040A1 · Chen · 2018 [cited by examiner]
US 20180306922A1 · Wan · 2018 [cited by examiner]
US 20190080467A1 · Hirzer et al. · 2019 [cited by applicant]
US 20190121365A1 · Passot · 2019 [cited by examiner]
US 20190213896A1 · Gohl et al. · 2019 [cited by applicant]
US 20190219404A1 · Ahn · 2019 [cited by examiner]
US 20190266772A1 · Li · 2019 [cited by applicant]
US 20210117704A1 · Yao et al. · 2021 [cited by applicant]
JP 2018084573A · 2018 [cited by applicant]
JP 2019207220A · 2019 [cited by applicant]
KR 101060575B1 · 2011 [cited by applicant]
KR 101979374B1 · 2019 [cited by applicant]
KR 102009025B1 · 2019 [cited by applicant]
Suzuki, Taro, Mitsunori Kitamura, Yoshiharu Amano, and Takumi Hashizume, “6-DOF Localization for a Mobile Robot using Outdoor 3D Voxel Maps.” In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, … [cited by applicant]
Yang, Bisheng, Lina Fang, Qingquan Li, and Jonathan Li, “Automated Extraction of Road Markings from Mobile LiDAR Point Clouds.” Photogrammetric Engineering & Remote Sensing 78, No. 4 (2012), pp. 331-338. [cited by applicant]
Moosmann, Frank, and Christoph Stiller, “Joint Self-Localization and Tracking of Generic Objects in 3D Range Data.” In 2013 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2013, pp. 1138-1144. [cited by applicant]
Bedkowski, Janusz, Andrzej Maslowski, and Geert De Cubber, “Real time 3D localization and mapping for USAR robotic application.” Industrial Robot: An International Journal (2012), vol. 39 Iss: 5, pp. 464-474. [cited by applicant]
Senlet, Turgay, and Ahmed Elgammal, “A Framework for Global Vehicle Localization Using Stereo Images and Satellite and Road Maps.” In 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), IEE… [cited by applicant]
Xu, Yuquan, Vijay John, Seiichi Mita, Hossein Tehrani, Kazuhisa Ishimaru, and Sakiko Nishino, “3D Point Cloud Map Based Vehicle Localization Using Stereo Camera.” In 2017 IEEE Intelligent Vehicles Symposium (IV), IEEE, … [cited by applicant]
Biber, Peter, and Wolfgang Straßer, “The Normal Distributions Transform: A New Approach to Laser Scan Matching.” In Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. N… [cited by applicant]
Martin, Fernando, Rudolph Triebel, Luis Moreno, and Roland Siegwart, “Two different tools for three-dimensional mapping: DE-based scan matching and feature-based loop detection.” Robotica 32, No. 1 (2014): 19-41, pp. 1-… [cited by applicant]
Irie, Kiyoshi, Tomoaki Yoshida, and Masahiro Tomono, “Outdoor Localization Using Stereo Vision Under Various Illumination Conditions.” Advanced Robotics 26, No. 3-4 (2012): 327-348, 24 pages. [cited by applicant]
Litomisky, Krystof, and Bir Bhanu, “Removing Moving Objects from Point Cloud Scenes.” In International Workshop on Depth Image Analysis and Applications, Springer, Berlin, Heidelberg, 2012, pp. 1-10. [cited by applicant]
Shan, Tixiao, and Brendan Englot, “Lego-loam: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain.” In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2… [cited by applicant]
Menze, Moritz, and Andreas Geiger, “Object Scene Flow for Autonomous Vehicles.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3061-3070. [cited by applicant]
Huang, Xinyu, Xinjing Cheng, Qichuan Geng, Binbin Cao, Dingfu Zhou, Peng Wang, Yuanqing Lin, and Ruigang Yang, “The Apolloscape Dataset for Autonomous Driving.” In Proceedings of the IEEE Conference on Computer Vision a… [cited by applicant]